E g9"ddlmZddlmZddlZddlmZddlm Z ddl m Z ddl m Z ddlmZmZmZddlZdd lmZdd lmZdd lmZmZmZmZdd lmZmZm Z ej!ej"ej#ej$ej%ej&ej&d Z'ej#ej(dfej&ej)e fej!ej*dfej"ej*dfej$ej*dfej+ej)dfej%ej,dfiZ-ej*dej(dej)diZ.GddeZ/dS)) annotations)AnyN) infer_dtype)iNaT)NoBufferPresent)cache_readonly) ArrowDtypeBaseMaskedDtypeDatetimeTZDtype)is_string_dtype) PandasBuffer)Column ColumnBuffersColumnNullType DtypeKind) ArrowCTypes Endiannessdtype_to_arrow_c_fmt)iufbUMmzThis column is non-nullablezThis column uses NaN as nullz!This column uses a sentinel valueceZdZdZd d!d Zd"d Zed"d Zed#dZ d#dZ edZ edZ ed"dZ ed$dZd"dZd%d&dZd'dZd(dZd(dZd(dZdS)) PandasColumna A column object, with only the methods and properties required by the interchange protocol defined. A column can contain one or more chunks. Each chunk can contain up to three buffers - a data buffer, a mask buffer (depending on null representation), and an offsets buffer (if variable-size binary; e.g., variable-length strings). Note: this Column object can only be produced by ``__dataframe__``, so doesn't need its own version or ``__column__`` protocol. Tcolumn pd.Series allow_copyboolreturnNonect|tjrtd|jdt|tjs t dt|d||_||_ dS)zu Note: doesn't deal with extension arrays yet, just assume a regular Series/ndarray for now. zExpected a Series, got a DataFrame. This likely happened because you called __dataframe__ on a DataFrame which, after converting column names to string, resulted in duplicated names: zD. Please rename these columns before using the interchange protocol.zColumns of type  not handled yetN) isinstancepd DataFrame TypeErrorcolumnsSeriesNotImplementedErrortype_col _allow_copy)selfrr!s S/var/www/sysmax/venv/lib/python3.11/site-packages/pandas/core/interchange/column.py__init__zPandasColumn.__init__Ks fbl + + 2!.222 &"),, Y%&Wf&W&W&WXX X %intc|jjS)z2 Size of the column, in elements. )r/sizer1s r2r7zPandasColumn.size_sy~r4cdS)z7 Offset of first element. Always zero. rr8s r2offsetzPandasColumn.offsetes qr4tuple[DtypeKind, int, str, str]c|jj}t|tjrJ|jjj}||j\}}}}tj ||tj fSt|rLt|jdvr'tjdt|tj fSt!d||S)N)stringemptyz.Non-string object dtypes are not supported yet)r/dtyper'r(CategoricalDtypevaluescodes_dtype_from_pandasdtyper CATEGORICALrNATIVEr rSTRINGrr-)r1rArD_bitwidthc_arrow_dtype_f_strs r2rAzPandasColumn.dtypems  eR0 1 1 7I$*E ,,U[99  #%#!   U # # 749%%)<<<$(//%  &&VWW W//66 6r4c|t|jd}|td|dt |t r |jj}nKt |tr |j j}n)t |tr |jj}n|j}||j dzt||fS)z/ See `self.dtype` for details. N Data type z& not supported by interchange protocolr@) _NP_KINDSgetkind ValueErrorr'r numpy_dtype byteorderr baser itemsizer)r1rArPrSs r2rEz$PandasColumn._dtype_from_pandasdtypes}}UZ.. <W%WWWXX X eZ ( ( ()3II  / / ( ,II  / / ()3IIIU^a')=e)D)DiOOr4c|jdtjkstd|jjjdttj |jjj dS)a: If the dtype is categorical, there are two options: - There are only values in the data buffer. - There is a separate non-categorical Column encoding for categorical values. Raises TypeError if the dtype is not categorical Content of returned dict: - "is_ordered" : bool, whether the ordering of dictionary indices is semantically meaningful. - "is_dictionary" : bool, whether a dictionary-style mapping of categorical values to other objects exists - "categories" : Column representing the (implicit) mapping of indices to category values (e.g. an array of cat1, cat2, ...). None if not a dictionary-style categorical. rzCdescribe_categorical only works on a column with categorical dtype!T) is_ordered is_dictionary categories) rArrFr*r/catorderedrr(r,rYr8s r2describe_categoricalz!PandasColumn.describe_categoricalsg$z!} 555U  )-/!&ry1I'J'JKK   r4c|jd} t|\}}n!#t$rtd|dwxYw||fS)NrrMz not yet supported)rA_NULL_DESCRIPTIONKeyErrorr-)r1rPnullvalues r2 describe_nullzPandasColumn.describe_nullshz!} M+D1KD%% M M M%&K4&K&K&KLL L MU{s >c||jS)zB Number of null elements. Should always be known. )r/isnasumitemr8s r2 null_countzPandasColumn.null_counts. y~~##%%**,,,r4dict[str, pd.Index]cd|jjiS)z8 Store specific metadata of the column. z pandas.index)r/indexr8s r2metadatazPandasColumn.metadatas  00r4cdS)zE Return the number of chunks the column consists of. r:r8s r2 num_chunkszPandasColumn.num_chunkss qr4Nn_chunks int | Nonec#K|rr|dkrlt|j}||z}||zdkr|dz }td||z|D].}t|jj|||z|jV/dS|VdS)zy Return an iterator yielding the chunks. See `DataFrame.get_chunks` for details on ``n_chunks``. rmrN)lenr/rangerilocr0)r1ror7stepstarts r2 get_chunkszPandasColumn.get_chunkss  1 ty>>D8#Dh!## q$/488  "IN554<#78$:J   JJJJJr4rc|ddd} ||d<n#t$rYnwxYw ||d<n#t$rYnwxYw|S)a` Return a dictionary containing the underlying buffers. The returned dictionary has the following contents: - "data": a two-element tuple whose first element is a buffer containing the data and whose second element is the data buffer's associated dtype. - "validity": a two-element tuple whose first element is a buffer containing mask values indicating missing data and whose second element is the mask value buffer's associated dtype. None if the null representation is not a bit or byte mask. - "offsets": a two-element tuple whose first element is a buffer containing the offset values for variable-size binary data (e.g., variable-length strings) and whose second element is the offsets buffer's associated dtype. None if the data buffer does not have an associated offsets buffer. N)datavalidityoffsetsrzr{)_get_data_buffer_get_validity_bufferr_get_offsets_buffer)r1bufferss r2 get_bufferszPandasColumn.get_bufferss())++" "   "&";";"="=GJ      D  !%!9!9!;!;GI      D s2 ??A A('A(tuple[PandasBuffer, Any]c0|jdtjtjtjtjtjfvr|jdtjkrPt|jddkr2|jj d }n|j }t||j }|j}n*|jdtjkrB|jjj}t||j }||j}n|jdtjkr|j }t'}|D]@}t)|t*r)||dAtt1j|d }|j}nt5d |jjd ||fS) zZ Return the buffer containing the data and the buffer's associated dtype. rN)r!utf-8encodinguint8)rArMr&)rArINTUINTFLOATBOOLDATETIMErrr/dt tz_convertto_numpyr r0rFrC_codesrErH bytearrayr'strextendencodenp frombufferr-)r1np_arrbufferrArDbufrobjs r2r|zPandasColumn._get_data_buffers :a= M N O N      z!} 222s4:a=7I7IA7M7M0066??AA++--!&T5EFFFFJEE Z]i3 3 3I$+E!%D4DEEEF00==EE Z]i. . .)$$&&C A ; ;c3'';HHSZZZ99:::""-"A"A"ABBF JEE%&T49?&T&T&TUU Uu}r4c8|j\}}|jdtjkr|j}|dk}| }t jt|ft j }t|D]!\}}t|tr|n|||<"t|}tjdtjt jf} || fS t$|d} n#t&$rt)dwxYwt+| )z Return the buffer containing the mask values indicating missing data and the buffer's associated dtype. Raises NoBufferPresent if null representation is not a bit or byte mask. rshaperAr@z! so does not have a separate maskzSee self.describe_null)rbrArrHr/rrzerosrrbool_ enumerater'rr rrrrG_NO_VALIDITY_BUFFERr_r-r) r1r`invalidrvalidmaskrrrrAmsgs r2r}z!PandasColumn._get_validity_bufferCs, * g :a=I, , ,)$$&&CqLEiG83s88+RX>>>D#C.. E E3#-c3#7#7D%%WQ"$''F^Q (8*:KLE5=  @(.QQQCC @ @ @%&>?? ? @c"""s C00D c|jdtjkr|j}d}t jt|dzft j}t|D]J\}}t|tr(| d}|t|z }|||dz<Kt|}tjdtjt"jf}nt'd||fS)a Return the buffer containing the offset values for variable-size binary data (e.g., variable-length strings) and the buffer's associated dtype. Raises NoBufferPresent if the data buffer does not have an associated offsets buffer. rrmrrr@zJThis column has a fixed-length dtype so it does not have an offsets buffer)rArrHr/rrrrrint64rr'rrr rrINT64rrGr) r1rCptrr{rvrrrAs r2r~z PandasColumn._get_offsets_bufferis :a=I, , ,Y''))FChc&kkAo%7rxHHHG!&)) % %1a%%"'22A3q66MC!$A"'**F !! EE"5  u}r4)T)rr r!r"r#r$)r#r5)r#r<)r#rh)N)rorp)r#r)r#r)__name__ __module__ __qualname____doc__r3r7propertyr;rrArEr\rbrgrkrnrwrr|r}r~r:r4r2rr?s  &&&&&( X777^7:PPPP.  X 8X---^- 111X1  "####J....`$#$#$#$#L&&&&&&r4r)0 __future__rtypingrnumpyrpandas._libs.librpandas._libs.tslibsr pandas.errorsrpandas.util._decoratorsrpandas.core.dtypes.dtypesr r r pandasr(pandas.api.typesr pandas.core.interchange.bufferr *pandas.core.interchange.dataframe_protocolrrrrpandas.core.interchange.utilsrrrrrrrrHrrNUSE_NAN USE_SENTINEL NON_NULLABLErF USE_BYTEMASKr^rrr:r4r2rs^""""""(((((($$$$$$))))))222222 ,,,,,,777777              On,d3 4d; MN/6 N^0$7 N^0$7N7< ~2A6 !>:!DPPPPP6PPPPPr4