a DfP@sdZddlZddlmZddlmZmZgdfddZdadifd d Z d(d d Z d)ddZ idfddZ d*ddZ d+ddZd,ddZd-ddZd.ddZd/ddZd0d d!Zd1d"d#Zd2d%d&ZeZe Ze ZeZeZeZeZeZed'krdS)3zN higher-level shell utilities for user environment and filesystem exploration N)shutils)kbytes disk_used;cCs4d}|D]}|dt|t|f7}q|t|S)agenerate a filter pattern from list of strings Args: list (list(str), default=[]): a list of filter elements. separator (str, default=';'): the separator string. Returns: a string composed of filter elements joined by the separator. z%s%s)strrstrip)list separatorfilteritemrV/nfs/NAS7/SABIOD/METHODE/ermites/ermites_venv/lib/python3.9/site-packages/pox/utils.pypatterns rc Cs|durtj}i}||||d|vr2|StsHddl}|dad}t||}|s^q|d\}}|d}|dddkr|dddkr|dd}||vr||d} |d|t ||||}t |}|| }qL|}qL|S) aexpand shell variables in string Expand shell variables of form ``$var`` and ``${var}``. Unknown variables are left unchanged. If a reference dictionary (*ref*) is provided, restrict lookups to *ref*. A second reference dictionary (*secondref*) can also be provided for failover searches. If *ref* is not provided, lookup variables are defined by the user's environment variables. Args: string (str): a string with shell variables. ref (dict(str), default=None): a dict of lookup variables. secondref (dict(str), default={}): a failover reference dict. Returns: string with the selected shell variables substituted. Examples: >>> expandvars('found:: $PYTHONPATH') 'found:: .:/Users/foo/lib/python3.4/site-packages' >>> >>> expandvars('found:: $PYTHONPATH', ref={}) 'found:: $PYTHONPATH' N$rz\$(\w+|\{[^}]*\})r{}) osenvironupdate_varprogrecompilesearchspangroup expandvarslen) stringrefZ secondrefZrefdictrimjnametailrrrr$s0         rc Cs|dur i}i}||ptj}|D]X}d|vr$|dddd}z||||<Wq$tyztj|||<Yq$0q$|S)aget a dictionary of all variables defined in path Extract shell variables of form ``$var`` and ``${var}``. Unknown variables will raise an exception. If a reference dictionary (*ref*) is provided, first try the lookup in *ref*. Failover from *ref* will lookup variables defined in the user's environment variables. Use *sep* to override the path separator (``os.sep``). Args: path (str): a path string with shell variables. ref (dict(str), default=None): a dict of lookup variables. sep (str, default=None): the path separator string. Returns: dict of shell variables found in the given path string. Examples: >>> getvars('$HOME/stuff') {'HOME': '/Users/foo'} Nrrrr)splitrseplstripr KeyErrorr)pathr!r(ZndictdirsdirkeyrrrgetvarsZs  r/TcCs|s tj}|stj}d}d}d}|||g}|dvr8|}n0|dvrF|}n"|dvrT|}n|rdtd|dSd } ||D]} zdt| d } | } | |D]} | | |} qt| d }| | ||rtd | |fWqv|rtd | d} Yqv0qv| S)aconvert text files to given platform type Ensure given files use the appropriate ``os.linesep`` and other formatting. Args: files (list(str)): a list of filenames. platform (str, default=None): platform name as in ``os.name``. pathsep (str, default=None): the path separator string. verbose (bool, default=True): if True, print debug statements.. Returns: 0 if converted, otherwise return 1.  z  )Zlinux2linuxunixZlinposixZriscos)ZwindowsZ mswindowswindosntZos2Zce)macmacosxz#Error: Platform '%s' not recognizedrrwzConverted '%s' to '%s' formatzFile conversion failed for '%s'r) rr%pathsepprintr'openreadclosereplacewrite)filesplatformr=verboseZMACZWINZLINlinesepZ newlinesepZ allconvertedfileinfile filestringr"outfilerrrconvert~s<       rLc Csr|dkr |}t|d}|}|ddl}|D]\}}||||}q6t|d}|||dS)amake text substitutions given by *sub* in the given file Args: file (str): path to original file. sub (dict(str), default={}: dict of string replacements ``{old:new}``. outfile (str, default=None): if given, don't overwrite original file. Returns: None Notes: ``replace`` uses regular expressions, thus a pattern may be used as *old* text. ``replace`` can fail if order of substitution is important. Nr;rr<)r?r@rAritemsrsubrC) rHrNrKinputrJroldnewoutputrrrrBs    rBFc Csz||vr||}nd}|r"d}n|}|||dvrV||d|}|rZ||7}nd}|rn|dkrn|d7}t|||S)aget the slice for a given sequence Slice indicies are determined by the positions of *start* and *stop*. If *start* is not found in the sequence, slice from the beginning. If *stop* is not found in the sequence, slice to the end. Args: sequence (list): an ordered sequence of elements. start (int): index for start of the slice. stop (int): index for stop position in the sequence. step (int, default=1): indices until next member of the slice. sequential (bool, default=False): if True, *start* must preceed *stop*. inclusive (bool, default=False): if True, include *stop* in the slice. Returns: slice corresponding to given *start*, *stop*, and *step*. Nr)indexslice) sequencestartstopstep sequential inclusivebeginhereendrrr index_slices  r^cCs t||||||}d||S)aslice a list of strings, then join the remaining strings If *start* is not found in the sequence, slice from the beginning. If *stop* is not found in the sequence, slice to the end. Args: sequence (list): an ordered sequence of elements. start (int): index for start of the slice. stop (int): index for stop position in the sequence. step (int, default=1): indices until next member of the slice. sequential (bool, default=True): if True, *start* must preceed *stop*. inclusive (bool, default=True): if True, include *stop* in the slice. Returns: string produced by slicing the given sequence and joining the elements. r)r^join)rUrVrWrXrYrZislicerrr index_joinsrac Cs |s tj}|rtd||dtjkr2tj|}tj|\}}tj|||dd}tjddd}tjddd} g} dd l } |D]J} | | d |r| tj | |r|r|| vs| r| | vr| | q| D]} | | q|r|rtd |n td ||r|St |tjd ddS)aretrieve the path(s) for a package Args: package (str): name of the package to search for. root (str, default=None): path string of top-level directory to search. all (bool, defualt=False): if True, return everywhere package is found. verbose (bool, default=True): if True, print messages about the search. recurse (bool, default=True): if True, recurse down the root directory. Returns: string path (or list of paths) where package is found. Notes: On some OS, recursion can be specified by recursion depth (an integer). ``findpackage`` will do standard pattern matching for package names, attempting to match the head directory of the distribution. zsearching %s...rd)recursetypeZBLD_ROOTFallZ EXPORT_ROOTN*z%s found %s not foundT)counterminimumrf)rcurdirr>r(r+r'rfindenvfnmatchbasenameappendremoveselect) packagerootrfrFrcZpackdirZbasedirZ targetdirZbldrootZexprootZremlistrnr-rrr findpackages<    rurc Cst|}g}|D]T}z||}Wn6ty8d}Yn"tyX||krPdnd}Yn0||q|rz|||s|dkr|gSdS|rt|} nt|} |s||| Sg} g} |D]}| |q|| } t | D]*} | | || | || q|| S)afind items in iterable with the max (or min) count of the given counter. Find the items in an iterable that have the maximum number of *counter* (e.g. counter='3' counts occurances of '3'). Use ``minimum=True`` to search for the minimum number of occurances of the *counter*. Args: iterable (list): an iterable of iterables (e.g. lists, strings, etc). counter (str, default=''): the item to count. minimum (bool, default=False): if True, find min count (else, max). reverse (bool, default=False): if True, reverse order of the results. all (bool, default=True): if False, only return the first result. Returns: list of items in the iterable with the min (or max) count. Examples: >>> z = ['zero','one','two','three','4','five','six','seven','8','9/81'] >>> select(z, counter='e') ['three', 'seven'] >>> select(z, counter='e', minimum=True) ['two', '4', 'six', '8', '9/81'] >>> >>> y = [[1,2,3],[4,5,6],[1,3,5]] >>> select(y, counter=3) [[1, 2, 3], [1, 3, 5]] >>> select(y, counter=3, minumim=True, all=False) [4, 5, 6] rrTN) rdcount TypeErrorAttributeErrorrpreverseminmaxrSrangepop)iterablerirjryrfityper#r rvx shortlisttmpZ occurancesr"rrrrr+s8     rrc Cs~t|\}}t||||d}|sBt||}||||iSi}tt|D]&} || |vrR||| || iqR|S)areturn a dict of items with the max (or min) count of the given counter. Get the items from a dict that have the maximum number of the *counter* (e.g. counter='3' counts occurances of '3') in the values. Use ``minimum=True`` to search for minimum number of occurances of *counter*. Args: dict (dict): dict with iterables as values (e.g. lists, strings, etc). counter (str, default=''): the item to count. minimum (bool, default=False): if True, find min count (else, max). all (bool, default=True): if False, only return the first result. Returns: dict of items composed of the entries with the min (or max) count. Examples: >>> z = ['zero','one','two','three','4','five','six','seven','8','9/81'] >>> z = dict(enumerate(z)) >>> selectdict(z, counter='e') {3: 'three', 7: 'seven'} >>> selectdict(z, counter='e', minimum=True) {8: '8', 9: '9/81', 2: 'two', 4: '4', 6: 'six'} >>> >>> y = {1: [1,2,3], 2: [4,5,6], 3: [1,3,5]} >>> selectdict(y, counter=3) {1: [1, 2, 3], 3: [1, 3, 5]} >>> selectdict(y, counter=3, minumim=True) {2: [4, 5, 6]} re)ziprMrrr rSr|rr) dictrirjrfkeysvaluesrrZ shortdictr"rrr selectdictis rcCs0|r |s d}|r,d||f}|r,d||f}|S)abuild string for a remote connection of the form ``[[user@]host:]path`` Args: path (str): path string for location of target on (remote) filesystem. host (str, default=None): string name/ip address of (remote) host. user (str, default=None): user name on (remote) host. loopback (bool, default=False): if True, ensure *host* is used. Returns: a remote connection string. Notes: if loopback=True and host=None, then host will be set to localhost. localhostz%s:%sz%s@%sr)r+hostuserloopbackrrrremotes    rcCs|dd}|dd}||kr<|r2dd|fSdd|fS|dd}|dd}||krjd||fS|rvd|}|||fS)aparse remote connection string of the form ``[[user@]host:]path`` Args: path (str): remote connection string. loopback (bool, default=False): if True, ensure *host* is used. login_flag (bool, default=False): if True, prepend user with ``-l``. Returns: a tuple of the form ``(user, host, path)``. Notes: if loopback=True and host=None, then host will be set to localhost. :rrrr@z-l )r')r+rZ login_flagdpathZrhostZdhostZduserrrr parse_remotes  rcCsddl}ddl}|j|j}|d}|r0dnd}d} |r\|jdddks\d|}d } |rhd |vrld nd} t|d rd t|vr| rt|nd t| d } qd |vrtt |nt|} n,t |r| d d|j ddD} nd} | r d |vr d nd} d | || g| g}|s|r| d }|j dt|} | rltdd|D| krt|j}ntj|dd}|sd}|S)aget the command to launch the selected version of python ``which_python`` composes a command string that can be used to launch the desired python executable. The user's path is searched for the executable, unless ``lazy=True`` and thus only a lazy-evaluating command (e.g. ``which python``) is produced. Args: version (bool, default=False): if True, include the version of python. lazy (bool, default=False): if True, build a lazy-evaluating command. fullpath (bool, default=True): if True, provide the full path. ignore_errors (bool, default=True): if True, ignore path search errors. Returns: string of the implicit or explicit location of the python executable. Notes: if version is given as an int or float, include the version number in the command string. if the executable is not found, an error will be thrown unless ``ignore_error=True``. rNpypypythonrr5z `which {0}`.) 2345678910-css|]}t|VqdSN)r.0r"rrr zwhich_python..r:css|]}t|VqdSr)intrrrrrrT) ignore_errors)rsysr+ro executable startswithrEformatrr_r'floatbool version_infortuplerwhich)versionZlazyfullpathrrrbaseZIS_PYPYtargetr&DOTZ pyversionZDASHZ sysversionrrr which_pythons2  "    rc Csddlm}t|}d}tjddd}tj|s|rB|dddddl}| ||d 7}||kr&|stt d |t d |qq&dS) ablock execution by waiting for a file to appear at the given path Args: path (str): the path string to watch for the file. sleep (float, default=1): the time between checking results. tries (int, default=150): the number of times to try. ignore_errors (bool, default=False): if True, ignore timeout error. Returns: None Notes: if the file is not found after the given number of tries, an error will be thrown unless ``ignore_error=True``. using ``subproc = Popen(...)`` and ``subproc.wait()`` is usually a better approach. However, when a handle to the subprocess is unavailable, waiting for a file to appear at a given path is a decent last resort. r)callsyncFreT)shellNrrhz$Warning: exceeded timeout (%s tries)) subprocessrrrrrr+existstimesleepIOErrorr>) r+rtriesrrZmaxcountrirrrrrwait_fors     r__main__)NN)NNT)rFF)rTT)NFTT)rFFT)rFT)NNF)FF)FFTT)rrF)__doc__rrrZ_diskrrrrrr/rLrBr^rarurrrrrrrZ makefilterZgetVarsZ replaceTextZgetLinesZ makeTargetZ parseTargetZ prunelistZ prunedict__name__rrrr s8 6 $ /   . > +   8 &