a vDf@sdZddlmZddlZddlmZddlmZedZ edZ edZ ed Z ed Z ed Zed Zed ZedZedZedZedZedZedZedZedZedZedZd#ddZddZd$ddZddZd%d d!Zd&d"dZ dS)'z4 Dispatch in dask.dataframe. Also see extension.py ) annotationsN)is_dask_collection)Dispatchmake_meta_dispatch make_meta_obj meta_nonemptymeta_lib_from_arrayhash_object_dispatchgroup_split_dispatchget_parallel_typeZCategoricalDtypeconcattolistis_categorical_dtypeunion_categoricalsZgrouperpartd_encode_dispatchpyarrow_schema_dispatchfrom_pyarrow_table_dispatchto_pyarrow_table_dispatchto_pandas_dispatchouterFTcKsFt|dkr|dStt|d}||f|||||d|SdS)aConcatenate, handling some edge cases: - Unions categoricals between partitions - Ignores empty partitions Parameters ---------- dfs : list of DataFrame, Series, or Index axis : int or str, optional join : str, optional uniform : bool, optional Whether to treat ``dfs[0]`` as representative of ``dfs[1:]``. Set to True if all arguments have the same columns and dtypes (but not necessarily categories). Default is False. ignore_index : bool, optional Whether to allow index values to be ignored/dropped during concatenation. Default is False. ignore_order : bool, optional Whether to ignore the order when doing the union of categoricals. Default is False. r)axisjoinuniformfilter_warning ignore_indexN)lenconcat_dispatchdispatchtype)dfsrrrrrkwargsfuncr#d/nfs/NAS7/SABIOD/METHODE/ermites/ermites_venv/lib/python3.9/site-packages/dask/dataframe/dispatch.pyr "s cCs"t|d|}tt|}||S)NZdtype)getattris_categorical_dtype_dispatchrrobjr"r#r#r$rOs cCstt|}|||dS)N) categoriesordered)categorical_dtype_dispatchrr)metar)r*r"r#r#r$categorical_dtypeUsr-cCstt|}||S)N)tolist_dispatchrrr'r#r#r$r ZscCst|tjtjtjfs.t|dr.t|r.|jSzt||dWSt y|durpt t |}|||dYSt tj}|||dYSYn0dS)a This method creates meta-data based on the type of ``x``, and ``parent_meta`` if supplied. Parameters ---------- x : Object of any type. Object to construct meta-data from. index : Index, optional Any index to use in the metadata. This is a pass-through parameter to dispatches registered. parent_meta : Object, default None If ``x`` is of arbitrary types and thus Dask cannot determine which back-end to be used to generate the meta-data for this object type, in which case ``parent_meta`` will be used to determine which back-end to select and dispatch to. To use utilize this parameter ``make_meta_obj`` has be dispatched. If ``parent_meta`` is ``None``, a pandas DataFrame is used for ``parent_meta`` that chooses pandas as the backend. Returns ------- A valid meta-data _meta)indexN) isinstancepdZSeriesZ DataFrameIndexhasattrrr/r TypeErrorrrr)xr0Z parent_metar"r#r#r$ make_meta_s   r7cCs tt|d}||||dS)Nr)sort_categories ignore_order)union_categoricals_dispatchrr)Zto_unionr8r9r"r#r#r$rs)rrFTF)NF)NN)FF)!__doc__ __future__rZpandasr2ZdaskrZ dask.utilsrrrrrr r r r+rr.r&r:Zgrouper_dispatchrrrrrr rr-r r7rr#r#r#r$sB    -  +