a vDf\.@sddlmZddlZddlZddlmZmZddl Z ddl m Z ddl m Z ddlmZmZmZmZddlmZddlmZdd lmZmZe renejZdd d dd d efd d ZdddZdddZdS)) annotationsN) is_list_like is_scalar)methods) PANDAS_GE_200) DataFrameSeriesapply_concat_applymap_partitionshas_known_categories) no_default)Mget_meta_library_Fc s ttjtjfr4tjf|||||||d|Sd} d} ttrjtsXt| tst| nttr|durj dk rt| j dk rt| j j dgdj }ntfd d |Dst| tfd d |Dst| ttjf|||||||d|S) a Convert categorical variable into dummy/indicator variables. Data must have category dtype to infer result's ``columns``. Parameters ---------- data : Series, or DataFrame For Series, the dtype must be categorical. For DataFrame, at least one column must be categorical. prefix : string, list of strings, or dict of strings, default None String to append DataFrame column names. Pass a list with length equal to the number of columns when calling get_dummies on a DataFrame. Alternatively, `prefix` can be a dictionary mapping column names to prefixes. prefix_sep : string, default '_' If appending prefix, separator/delimiter to use. Or pass a list or dictionary as with `prefix.` dummy_na : bool, default False Add a column to indicate NaNs, if False NaNs are ignored. columns : list-like, default None Column names in the DataFrame to be encoded. If `columns` is None then all the columns with `category` dtype will be converted. sparse : bool, default False Whether the dummy columns should be sparse or not. Returns SparseDataFrame if `data` is a Series or if all columns are included. Otherwise returns a DataFrame with some SparseBlocks. .. versionadded:: 0.18.2 drop_first : bool, default False Whether to get k-1 dummies out of k categorical levels by removing the first level. dtype : dtype, default bool Data type for new columns. Only a single dtype is allowed. .. versionadded:: 0.18.2 Returns ------- dummies : DataFrame Examples -------- Dask's version only works with Categorical data, as this is the only way to know the output shape without computing all the data. >>> import pandas as pd >>> import dask.dataframe as dd >>> s = dd.from_pandas(pd.Series(list('abca')), npartitions=2) >>> dd.get_dummies(s) Traceback (most recent call last): ... NotImplementedError: `get_dummies` with non-categorical dtypes is not supported... With categorical data: >>> s = dd.from_pandas(pd.Series(list('abca'), dtype='category'), npartitions=2) >>> dd.get_dummies(s) # doctest: +NORMALIZE_WHITESPACE Dask DataFrame Structure: a b c npartitions=2 0 bool bool bool 2 ... ... ... 3 ... ... ... Dask Name: get_dummies, 2 graph layers >>> dd.get_dummies(s).compute() # doctest: +ELLIPSIS a b c 0 True False False 1 False True False 2 False False True 3 True False False See Also -------- pandas.get_dummies )prefix prefix_sepdummy_nacolumnssparse drop_firstdtypez`get_dummies` with non-categorical dtypes is not supported. Please use `df.categorize()` beforehand to convert to categorical dtype.z`get_dummies` with unknown categories is not supported. Please use `column.cat.as_known()` or `df.categorize()` beforehand to ensure known categoriesNobjectstringcategory)includec3s|]}t|VqdSN)ris_categorical_dtype.0cdatac/nfs/NAS7/SABIOD/METHODE/ermites/ermites_venv/lib/python3.9/site-packages/dask/dataframe/reshape.py zget_dummies..c3s|]}t|VqdSrr rr!r#r$r%r&) isinstancepdrr get_dummiesrrNotImplementedErrorr dtypesany_metaZ select_dtypesrallr r) r"rrrrrrrkwargsZ not_cat_msgZunknown_cat_msgr#r!r$r)s`Z       r)meanc Csdt|r|durtdt|r(|dur0tdt||sFtdt||sZtdt|rttdd|Dst|stdgd }t|r||vrtd d d d |Dtj ||j j |d}t|r|}ntj j t||fd|gd}|dvrtt|r0tj|||jt|j|d}nBtj|t|j|d}|D]"} || ||j| || <qNntj|tjt|j|d}|||d} |dvrt|gtjtj|d| d} |dvrt|gtjtj|d| d} |dkr| S|dkr| S|dkr| | S|dkr8t|gtjtj|d| dS|dkr\t|gtjtj|d| dStdS) a Create a spreadsheet-style pivot table as a DataFrame. Target ``columns`` must have category dtype to infer result's ``columns``. ``index``, ``columns``, and ``aggfunc`` must be all scalar. ``values`` can be scalar or list-like. Parameters ---------- df : DataFrame index : scalar column to be index columns : scalar column to be columns values : scalar or list(scalar) column(s) to aggregate aggfunc : {'mean', 'sum', 'count', 'first', 'last'}, default 'mean' Returns ------- table : DataFrame See Also -------- pandas.DataFrame.pivot_table Nz.'index' must be the name of an existing columnz0'columns' must be the name of an existing columnz 'columns' must be category dtypezs'columns' must have known categories. Please use `df[columns].cat.as_known()` beforehand to ensure known categoriescSsg|] }t|qSr#)r)rvr#r#r$ r&zpivot_table..z4'values' must refer to an existing column or columns)r0sumcountfirstlastzaggfunc must be either z, css|]}d|dVqdS)'Nr#)rxr#r#r$r%r&zpivot_table..)name)names)r5r6)rrindex)rr;)r;rvalues)r3r0Zpivot_table_sum)chunkZ aggregatemetatokenZ chunk_kwargs)r4r0Zpivot_table_countr3r4r0r5Zpivot_table_firstr6Zpivot_table_last)r ValueErrorrrr rr.joinr(ZCategoricalIndexcat categoriesZ MultiIndexZ from_productsortedrrIndexr-Zastyper+npfloat64r Z pivot_sumZ pivot_aggZ pivot_countZ pivot_firstZpivot_agg_firstZ pivot_lastZpivot_agg_last) Zdfr;rr<ZaggfuncZavailable_aggfuncsZcolumns_contentsZ new_columnsr>Z value_colr/Zpv_sumZpv_countr#r#r$ pivot_tables   "         rHvaluec CsPtjddi,|jtjt|||||ddWdS1sB0YdS)a Unpivots a DataFrame from wide format to long format, optionally leaving identifier variables set. This function is useful to massage a DataFrame into a format where one or more columns are identifier variables (``id_vars``), while all other columns, considered measured variables (``value_vars``), are "unpivoted" to the row axis, leaving just two non-identifier columns, 'variable' and 'value'. Parameters ---------- frame : DataFrame id_vars : tuple, list, or ndarray, optional Column(s) to use as identifier variables. value_vars : tuple, list, or ndarray, optional Column(s) to unpivot. If not specified, uses all columns that are not set as `id_vars`. var_name : scalar Name to use for the 'variable' column. If None it uses ``frame.columns.name`` or 'variable'. value_name : scalar, default 'value' Name to use for the 'value' column. col_level : int or string, optional If columns are a MultiIndex then use this level to melt. Returns ------- DataFrame Unpivoted DataFrame. See Also -------- pandas.DataFrame.melt zdataframe.convert-stringFmelt)r>id_vars value_varsvar_name value_name col_levelr?N)daskconfigsetr rrJr )framerKrLrMrNrOr#r#r$rJ=s)rJ)NNNr0)NNNrIN) __future__rnumpyrFZpandasr(Zpandas.api.typesrrrPZdask.dataframerZdask.dataframe._compatrZdask.dataframe.corerrr r Zdask.dataframe.utilsr Z dask.typingr Z dask.utilsrrboolZuint8Z_get_dummies_dtype_defaultr)rHrJr#r#r#r$s8