a tDf81@sddlmZddlZddlZddlmZddlmZddl m Z m Z m Z m Z mZmZmZmZmZmZddlmZddlmZddlmZdd lmZmZe eejfej eeejfej!e eejfej"e eejfej#e ej$j%ej$j#e eejfee ej$j%eeejd8d d Z&e ej$j%d9d dZ'eej$j%d:ddZ(e)de )de)de)de)dddZ*e)de )dddZ+e)de )de)de)dddZ,e)de )dddZ-ddZ.eej$j%d d!Z/eeejfd"d#Z0d$d%Z1d&d'd(d)Z2eeejfd*d+Z3d,d-Z4Gd.d/d/eZ5eejd0d1Z6Gd2d3d3e5Z7ed4d5e5d6d7Z8e89d5e7dS);) annotationsN)chunk)Array) concatenate_lookup divide_lookup einsum_lookup empty_lookupnannumel_lookup numel_lookuppercentile_lookuptensordot_lookupto_cupy_dispatchto_numpy_dispatch)divide) ma_divide _percentile)CreationDispatchDaskBackendEntrypointlinearcCs t|||SNr)aqmethodr`/nfs/NAS7/SABIOD/METHODE/ermites/ermites_venv/lib/python3.9/site-packages/dask/array/backends.py percentile#srcCs`tjj||d}dd|D}tdd|Dr8td|r\t|}t|dkr\|d|_|S) N)axiscSsg|]}t|dr|jqS) fill_value)hasattrr).0irrr +z _concatenate..css|]}t|tjVqdSr) isinstancenpndarray)r frrr ,r#z_concatenate..zADask doesn't support masked array's with non-scalar `fill_value`sr)r%ma concatenateany ValueErroruniquelenr)ZarraysroutZ fill_valuesrrr _concatenate(s   r1cs2z t|Wn0ty<tt| dttd|Yn 0|\zt}tWntyvgd}Yn0zt}tWntygd}Yn0|j|j}|j|j}d}||krd}nlt|D]b}||krd}q@|dkr"||7<|dkr܈||7<q|sNtdfddt|D} | } d} D]} | | 9} qtd| f} fd d| D}fd dt|D} | }d} D]} | | 9} q| df}fd d| D}||  | }|| |}t j ||}| ||S) Nrr)TFzshape-mismatch for sumcsg|]}|vr|qSrrr k)axes_arrr"fr#z_tensordot..csg|] }|qSrrr r)as_rrr"lr#csg|]}|vr|qSrrr3)axes_brrr"nr#csg|] }|qSrrr7)bsrrr"tr#) iter TypeErrorlistranger/shapendimr-Z transposeZreshaper%r*dot)rbaxesnanbZndaZndbequalr4notinZ newaxes_aZN2rZ newshape_aZoldaZ newaxes_bZ newshape_bZoldbatZbtresr)r8r5r9r:r _tensordot8sj          rJcupycsddltjjtjjtjtt jt t jt t jfdd}ttjfdd}tjfdd}dS)Nrcsj|fi|Sr)ZasnumpydatakwargsrKrr cupy_to_numpysz$register_cupy..cupy_to_numpycsj|fi|Sr)ZasarrayrLrOrr numpy_to_cupysz$register_cupy..numpy_to_cupycs(|dd|ddj|i|S)NZcastingorder)popeinsum)argsrNrOrr _cupy_einsums  z#register_cupy.._cupy_einsum)rKrregisterr&r+r tensordotr rr _numel_arrayliker _nannumelrr r%r)rPrQrVrrOr register_cupy|s   r[Zcupyxc s|ddlm}zddlmmWn.tyN}ztd|WYd}~n d}~00dfdd }t||t|tdS)Nr)spmatrixhstackvstackz>Stacking of sparse arrays requires at least CuPy version 8.0.0cs4|dkr|S|dkr |Sd|}t|dS)Nrr)zECan only concatenate cupy sparse matrices for axis in {0, 1}. Got %s)r-Lrmsgr]rr_concat_cupy_sparsesz+register_cupyx.._concat_cupy_sparse)r) Zcupyx.scipy.sparser\r^r_ ImportErrorrrWr _tensordot_scipy_sparse)r\ercrr]rregister_cupyxs  rgsparsecCsHddl}t|j|jt|j|jt|jtt |jt dS)Nr) rhrrWZCOOr+r rXr _numel_ndarrayr _nannumel_sparse)rhrrrregister_sparses rkscipycs:ddldfdd }tjj|tjjtdS)Nrcs<|dkrj|S|dkr(j|Sd|}t|dS)Nrr)zFCan only concatenate scipy sparse matrices for axis in {0, 1}. Got %s)rhr_r^r-r`rlrrr1s  z+register_scipy_sparse.._concatenate)r)Z scipy.sparserrWrhr\r re)r1rrmrregister_scipy_sparses rncCs|j|jkrdksnJt|dt|dkrBdksHnJ|d\}|d\}|dvrl|dvspJ|j||j|ksJ|dkr|dkr|j|S|dkr|dkr|j|jS|dkr|dkr||S|dkr|dkr||jSdS)Nr2rr))rr))r@r/r?T)rrBrCZa_axisZb_axisrrrres*    recKstjt|fi|S)z'Numel implementation for masked arrays.)rsumr%Z ones_likexrNrrr _numel_maskedsrscKst|fddi|S)zJNumel implementation for arrays that want to return numel of type ndarray.coerce_np_ndarrayT_numelrqrrrrisricKst|fddi|S)zKNumel implementation for arrays that want to return numel of the same type.rtFrurqrrrrYsrYbool)rtc s,|j|dd}|dd|dtj}durtj|d}|durN|S|rjtjdt||dStj||dt|d Stt t fsgt fd d D}|d urt fd d t tD}n t fdd t tD}|rt tj||d|Stj||||d SdS)a  A reduction to count the number of elements. This has an additional kwarg in coerce_np_ndarray, which determines whether to ensure that the resulting array is a numpy.ndarray, or whether we allow it to be other array types via `np.full_like`. keepdimsFrNdtype)ry)r))r?rry)r?ryc3s|]}|VqdSrrr Zdim)r?rrr(r#z_numel..Tc3s"|]}|vr|ndVqdS)r)Nrrzrr?rrr(sc3s|]}|vr|VqdSrrrzr{rrr(r#)r?getr%float64prodfullr/Z full_liker$tupler=mathr>Z broadcast_toarray)rrrtrNrxryr~Z new_shaperr{rrvs,    rvcKstjt|fi|S)z;A reduction to count the number of elements, excluding nans)rrpr%isnanrqrrrrZ%srZcKs&t|fi|}t|dr"|S|S)a  A reduction to count the number of elements in a sparse array, excluding nans. This will in general result in a dense matrix with an unpredictable fill value. So make it official and convert it to dense. https://github.com/dask/dask/issues/7169 todense)rZrr)rrrNnrrrrj+srjc@seZdZdZeddZeddZeddddd Zedddd d Z edddd d Z edddddZ eddddddZ dS)ArrayBackendEntrypointzjDask-Array version of ``DaskBackendEntrypoint`` See Also -------- NumpyBackendEntrypoint cCstdS)zReturn the backend-specific RandomState class For example, the 'numpy' backend simply returns ``numpy.random.RandomState``. NNotImplementedErrorselfrrr RandomStateAsz"ArrayBackendEntrypoint.RandomStatecCstdS)z$Return the default BitGenerator typeNrrrrrdefault_bit_generatorJsz,ArrayBackendEntrypoint.default_bit_generatorN)rymetacKstdS)ztCreate an array of ones Returns a new array having a specified shape and filled with ones. Nrr?ryrrNrrronesOszArrayBackendEntrypoint.onescKstdS)zvCreate an array of zeros Returns a new array having a specified shape and filled with zeros. NrrrrrzerosXszArrayBackendEntrypoint.zeroscKstdS)z`Create an empty array Returns an uninitialized array having a specified shape. NrrrrremptyaszArrayBackendEntrypoint.emptycKstdS)zCreate a uniformly filled array Returns a new array having a specified shape and filled with fill_value. Nr)r?rryrrNrrrriszArrayBackendEntrypoint.fullr)cKstdS)zCreate an ascending or descending array Returns evenly spaced values within the half-open interval ``[start, stop)`` as a one-dimensional array. Nr)startstopstepryrrNrrrarangerszArrayBackendEntrypoint.arange)Nr)) __name__ __module__ __qualname____doc__propertyrr staticmethodrrrrrrrrrr9s  rcKs|SrrrLrrrto_numpy_dispatch_from_numpy|src@sBeZdZeddZeddddZeddZed d Zd S) NumpyBackendEntrypointcCstSr)r)clsrrrto_backend_dispatchsz*NumpyBackendEntrypoint.to_backend_dispatchr)rMcKs(t|jtjr|S|j|fi|Sr)r$Z_metar%r&Z map_blocksr)rrMrNrrr to_backendsz!NumpyBackendEntrypoint.to_backendcCstjjSr)r%randomrrrrrrsz"NumpyBackendEntrypoint.RandomStatecCstjjSr)r%rZPCG64rrrrrsz,NumpyBackendEntrypoint.default_bit_generatorN) rrr classmethodrrrrrrrrrrs  rrnumpyarray_creation_dispatch) module_namedefaultZentrypoint_classname)r)r)r2): __future__rrrr%Z dask.arrayrZdask.array.corerZdask.array.dispatchrrrrr r r r r rZdask.array.numpy_compatrZ np_dividerZdask.array.percentilerZ dask.backendsrrrWobjectr&r+rXrTrr*Z masked_arrayrr1rJZ register_lazyr[rgrkrnrersrirYrvrZrjrrrrZregister_backendrrrrsx   0         C      ( C