U M[^H@s~ddlmZddlZddlZddlZddlZddlZddlZddlZddl m Z m Z ddl m Z ddlZddlmZddlmZddlmZz,ddlmZmZmZmZmZmZmZmZWnek rYnXd Zd Z e!Z"d Z#Gd d d ej$Z%Gddde&Z'Gddde&Z(Gdddej)Z*Gdddej+Z,dddddZ-e.ddddZ/eddZ0dd Z1dWdde.dd"d#d$Z2e.e.d%d&d'Z3d(d)d*d+Z4dXe.e5d-d.d/Z6e.e5dd0d1Z7e.e5d2d3d4Z8dYe.e5e.d6d7d8Z9dZd9d(d:d;d<Z:e5d)d=d>Z;didfe.d?d(d9d@dAdBdCZe.d9dPdQdRZ?d]e.e.e@ddTdUdVZAdS)^)ENOENTN)errorrequest)urlparse)contextmanagerwraps) HTTPMessage)AnyDictListMappingOptionalSequenceTupleUnionz/etc/machine-idz/var/lib/dbus/machine-idz0(?P\d+\.\d+) (LTS )?\((?P\w+).*c@s.eZdZejdejdiZejedddZ dS) LogFormatterzERROR: %(message)szDEBUG: %(message)s)recordreturncCs |j|jd}t||S)Nz %(message)s)FORMATSgetZlevelnologging Formatterformat)selfrZlog_fmtr//usr/lib/python3/dist-packages/uaclient/util.pyr/szLogFormatter.formatN) __name__ __module__ __qualname__rZERRORDEBUGrZ LogRecordstrrrrrrr(s rcs,eZdZdejddddfdd ZZS) UrlErrorN Optional[int]zOptional[Dict[str, str]] Optional[str])causecodeheadersurlcsRt|ddrt|j}nt|}t|||_||_|jdkrHi|_||_dS)Nreason)getattrr!r)super__init__r&r'r()rr%r&r'r(Z cause_error __class__rrr,5s    zUrlError.__init__)NNN)rrrrZURLErrorr, __classcell__rrr-rr"4sr"cs,eZdZdedeeddfdd ZZS)ProcessExecutionErrorNr#)cmd exit_codestdoutstderrrcs<||_||_||_|sd}nd}t|j|||ddS)Nz"Invalid command specified '{cmd}'.zEFailed running command '{cmd}' [exit({exit_code})]. Message: {stderr})r2r5r3)r4r5r3r+r,r)rr2r3r4r5Z message_tmplr-rrr,IszProcessExecutionError.__init__)Nr1r1)rrrr!r,r/rrr-rr0Hsr0cs eZdZdZfddZZS)DatetimeAwareJSONEncoderzBA json.JSONEncoder subclass that writes out isoformat'd datetimes.cs t|tjr|St|SN) isinstancedatetimeZ isoformatr+default)ror-rrr:bs z DatetimeAwareJSONEncoder.default)rrr__doc__r:r/rrr-rr6_sr6cs,eZdZdZfddZeddZZS)DatetimeAwareJSONDecodera, A JSONDecoder that parses some ISO datetime strings to datetime objects. Important note: the "some" is because we seem to only be able extend Python's json library in a way that lets us convert string values within JSON objects (e.g. '{"lastModified": "2019-07-25T14:35:51"}'). Strings outside of JSON objects (e.g. '"2019-07-25T14:35:51"') will not be passed through our decoder. (N.B. This will override any object_hook specified using arguments to it, or used in load or loads calls that specify this as the cls.) cs.d|kr|dtj|d|ji|dS)N object_hook)popr+r,r>)rargskwargsr-rrr,vs z!DatetimeAwareJSONDecoder.__init__c CsT|D]F\}}t|trztj|d}Wntk rD|}YnX|||<q|S)Nz%Y-%m-%dT%H:%M:%S)itemsr8r!r9strptime ValueError)r;keyvalue new_valuerrrr>{s   z$DatetimeAwareJSONDecoder.object_hook)rrrr<r, staticmethodr>r/rrr-rr=hs r=zDict[str, Any]) orig_accessrcCstt|td|kgs$td|td}|di}|di|i}|D]8\}}|d|}t|tr| |qV||d|<qVdS)aApply series-specific overrides to an entitlement dict. This function mutates orig_access dict by applying any series-overrides to the top-level keys under 'entitlement'. The series-overrides are sparse and intended to supplement existing top-level dict values. So, sub-keys under the top-level directives, obligations and affordance sub-key values will be preserved if unspecified in series-overrides. To more clearly indicate that orig_access in memory has already had the overrides applied, the 'series' key is also removed from the orig_access dict. :param orig_access: Dict with original entitlement access details Z entitlementz?Expected entitlement access dict. Missing "entitlement" key: {}seriesN) allr8dict RuntimeErrorrget_platform_inforr?rBupdate)rIZ series_nameZorig_entitlementZ overridesrErFZcurrentrrrapply_series_overridess    rP)pathrc CsDzt|Wn0tk r>}z|jtkr.|W5d}~XYnXdSr7)osunlinkOSErrorerrnor)rQerrrdel_files  rWc cstddtjD}|s,tddVdS|d}|j}|tjkrNdVdS|dz dVW5||XdS)a A context manager that disables logging to console in its body N.B. This _will not_ disable console logging if it finds the console handler is configured at DEBUG level; the assumption is that this means we want as much output as possible, even if it risks duplication. This context manager will allow us to gradually move away from using the logging framework for user-facing output, by applying it to parts of the codebase piece-wise. (Once the conversion is complete, we should have no further use for it and it can be removed.) (Note that the @contextmanager decorator also allows this function to be used as a decorator.) cSsg|]}|jdkr|qS)Zconsole)name).0Zhandlerrrr s z*disable_log_to_console..z0disable_log_to_console: no console handler foundNri)rZ getLoggerZhandlersdebuglevelr ZsetLevel)Zpotential_handlersZconsole_handlerZ old_levelrrrdisable_log_to_consoles     r]csfdd}|S)aDecorator to retry on exception for retry_sleeps. @param retry_sleeps: List of sleep lengths to apply between retries. Specifying a list of [0.5, 1] tells subp to retry twice on failure; sleeping half a second before the first retry and 1 second before the second retry. @param exception: The exception class to catch and retry for the provided retry_sleeps. Any other exception types will not be caught by the decorator. cstfdd}|S)Nc sn}z ||WSk rf}z4|s.|tt|dt|t|dW5d}~XYqXqdS)N Retrying %d more times.r)copyrr[r!lentimesleepr?)r@rAZsleepsrV) exceptionf retry_sleepsrr decorators  z)retry..wrapper..decoratorr)rdrfrcre)rdrwrappers zretry..wrapperr)rcrerhrrgrretrys rir1) orig_dictnew_dictrQrc Csi}|D]\}}||t}|s(|n |d|}t|trp||krft||||d}|rn|||<qt||<q ||kr td|||||<q |D]\}}||kr|||<q|S)zChecks to see if this code running in a container of some sortzsystemd-detect-virtz--quietz --containerT)Zcontainer_typezsystemd/containerF)rIOErrorrTrRrQrrru)rfilenamerQrrr is_containerVs rcCstj|ot|tjSr7)rRrQisfileaccessX_OKrmrrris_exedsr)r(rcCs6z t|}Wntk r"YdSX|jdkr2dSdS)NF)ZhttpsZhttpT)rrDZscheme)r(Z parsed_urlrrris_service_urlis  rT)rdecoderc Cs4td|t|d}|}W5QRX|dS)z!Read filename and decode content.zReading file: %srbutf-8)rr[openreadr)rrstreamrzrrrrvss  rvr$) release_filercCsH|sd}i}t|D]*}|dd\}}|r|d||<q|S)Nz/etc/os-release=")rv splitlinesrr)rdatalinerErFrrrr{srcCs td}|dkrdSdS)z Display a confirmation prompt, returning a bool indicating the response This function will only prompt a single time, and defaults to "no" (i.e. it returns False). zAre you sure? (y/N) )yZyesTF)inputrr)rFrrrprompt_for_confirmationsrzOptional[bytes]z1Tuple[Any, Union[HTTPMessage, Mapping[str, str]]])r(rr'methodrcCs|r |s d}tj||||d}td|p*d|||t|}|d}dt|j ddkrlt |}td |pxd||j|||jfS) NZPOST)rr'rz#URL [%s]: %s, headers: %s, data: %sZGETrzapplication/jsonz Content-typer1z,URL [%s] response: %s, headers: %s, data: %s) rZRequestrr[Zurlopenrrr!r'rjsonloads)r(rr'rZreqZresprzrrrreadurls,  rFz Sequence[str]zOptional[List[int]]zOptional[float]zTuple[str, str])r@rcscapturetimeoutrc Csdd|D}|dkrdg}z(tj|tjtjd}|j|d\}}Wnbtk rz(td||j|d|dd Wn$t k rtd|d YnXYnX|j|krtd||j|d|dd |rt d d||j||d|dfS) aRun a command and return a tuple of decoded stdout, stderr. @param args: A list of arguments to feed to subprocess.Popen @param rcs: A list of allowed return_codes. If returncode not in rcs raise a ProcessExecutionError. @param capture: Boolean set True to log the command and response. @param timeout: Optional float indicating number of seconds to wait for subp to return. @return: Tuple of utf-8 decoded stdout, stderr @raises ProcessExecutionError on invalid command or returncode not in rcs. @raises subprocess.TimeoutError when timeout specified and the command exceeds that number of seconds. cSs$g|]}t|tr|n|dqS)r)r8bytesencode)rYxrrrrZsz_subp..Nr)r4r5)r r)r2r3r4r5)r2zRan cmd: %s, rc: %s stderr: %s) subprocessPopenPIPEZ communicaterTr0rr returncoderUnboundLocalErrorrr[)r@rrrZ bytes_argsprocrerrrrr_subpsJ  rzOptional[List[float]])r@rrrrerc Cs|dk r|nd}zt||||\}}WqWqtk r}zD|rRtt||sXtt|dt|t| dW5d}~XYqXq||fS)aRun a command and return a tuple of decoded stdout, stderr. @param subp: A list of arguments to feed to subprocess.Popen @param rcs: A list of allowed return_codes. If returncode not in rcs raise a ProcessExecutionError. @param capture: Boolean set True to log the command and response. @param timeout: Optional float indicating number of seconds to wait for a subp call to return. @param retry_sleeps: Optional list of sleep lengths to apply between retries. Specifying a list of [0.5, 1] instructs subp to retry twice on failure; sleeping half a second before the first retry and 1 second before the next retry. @return: Tuple of utf-8 decoded stdout, stderr @raises ProcessExecutionError on invalid command or returncode not in rcs. @raises subprocess.TimeoutError when timeout specified and the command exceeds that number of seconds. Nr^r) r_rr0rr[r!r`rarbr?)r@rrrrerrrVrrrrs $r)programrcCsrtjj|krt|r|SddtjddtjD}dd|D}|D]"}tj||}t|rJ|SqJdS)z;Find whether the provided program is executable in our PATHcSsg|]}|dqS)r)rrYprrrrZszwhich..PATHr1cSsg|]}tj|qSr)rRrQabspathrrrrrZsN) rRrQseprenvironrrpathseprr)rpathsZnormalized_pathsrQZ program_pathrrrwhichs  r)rrzmoderc CsJtd|t|d}||d|W5QRXt||dS)a:Write content to the provided filename encoding it if necessary. @param filename: The full path of the file to write. @param content: The content to write to the file. @param mode: The filesystem mode to set on the file. @param omode: The open mode used when opening the file (w, wb, a, etc.) zWriting file: %swbrN)rr[rwriterflushrRchmod)rrzrZfhrrrry%s   ry)r1)r)T)N)NFN)NFNN)r)BrUrr9rrrRrrraZurllibrrZ urllib.parserrx contextlibr functoolsrZ http.clientr typingr r r r rrrr ImportErrorrsrtobjectrnrrrrr"r0Z JSONEncoderr6Z JSONDecoderr=rPr!rWr]riror{rNboolrrrrvrrrrrrintryrrrrs     ,   "" )! +    ; *