U AdD@s:dZddlZddlZddlZddlZddlmZmZddlm Z ddl m Z m Z m Z mZmZmZmZddlZddlmZddlmZddlmZdd lmZdd lmZmZmZmZdd l m!Z!e"e#Z$d Z%d Z&dZ'dddddddZ(e)dddZ*d:ee e)e e)e fdddZ+GdddeZ,GdddeZ-GdddeZ.e)e/dd d!Z0Gd"d#d#ej1Z2e3dd$d%Z4d;ej5e)e3d'd(d)Z6dd4d5Z?e#d6kr6ddl@Z@d7ZAe@jBeAd8ZCeCDeEeFer?r3rBr@r%r%r7r&rAys rAc@seZdZdddZdS)LXDSocketAdapterNcCsttSr9)rALXD_SOCKET_PATH)r6urlZproxiesr%r%r&get_connectionszLXDSocketAdapter.get_connection)N)r=r>r?rFr%r%r%r&rCsrC) metadata_typerc Cst|tr|S|dkriSzt|}Wn8tk r`}ztdj||d|W5d}~XYnX|dkr~tdj||d|S)a6Convert raw instance data from str, bytes, YAML to dict :param metadata_type: string, one of as: meta-data, vendor-data, user-data network-config :param metadata_value: str, bytes or dict representing or instance-data. :raises: InvalidMetaDataError on invalid instance-data content. NzAInvalid {md_type}. Expected str, bytes or dict but found: {value})Zmd_typevaluez:Invalid {md_type} format. Expected YAML but found: {value}) isinstancedictr load_yamlAttributeErrorrInvalidMetaDataExceptionformat)rGZmetadata_valueZparsed_metadataexcr%r%r&_raw_instance_data_to_dicts. rPcseZdZUdZejZeee fe d<ejZ eee fe d<ej j dZ ee dfe d<dZedd fd d Zed d dZed ddZe d ddZe d ddZeed ddZZS) DataSourceLXDZLXD_network_config_crawled_metadata)user.meta-datarrrr.sensitive_metadata_keysTN)ci_pkl_versionrcst|d|_dS)NT)r2 _unpickleskip_hotplug_detect)r6rVr7r%r&rWs zDataSourceLXD._unpicklercCstS)z@Check platform environment to report if this datasource may run.)is_platform_viabler<r%r%r&_is_platform_viablesz!DataSourceLXD._is_platform_viablecCs|stddStjtjdtd|_td|jd|_ |jdi}|di}|rftd|}t |j t st t |j |g|_ d|jkr|jd|_d |jkrtd |jd |_d |jkr|jd |_d S) z=Crawl LXD socket API instance data and return True on successz+Not an LXD datasource: No LXD socket found.FzCrawl of metadata service)Zlogfuncmsgfunc meta-datar-rTrrrT)rZr r.rZlog_time read_metadatarSrPgetmetadatarIrJZ mergemanydictrKZ userdata_rawrRZvendordata_raw)r6r-Z user_metadatar%r%r& _get_datasB         zDataSourceLXD._get_datacCsdjttdS)z.Return subplatform details for this datasourcez"LXD socket API v. {ver} ({socket}))Zverr:)rNLXD_SOCKET_API_VERSIONrDr<r%r%r&_get_subplatformszDataSourceLXD._get_subplatformcCsBttjd}|di}t|ts,t|}|d|jdkS)z%Return True if instance_id unchanged. metadata_keysr]z instance-id) r^ MetaDataKeys META_DATAr_rIrJrrKr`)r6Zsys_cfgresponsemdr%r%r&check_instance_ids     zDataSourceLXD.check_instance_idcCs|jtjkr~|jtjkr |t|jtr~|jdrPt d|jd|_n.|jdr~dd|jd D}t ||_|jtjkrt dt |_t t|jS)zNetwork config read from LXD socket config/user.network-config. If none is present, then we generate fallback configuration. rz,LXD datasource using provided network configdevicescSs g|]\}}|ddkr|qS)r*Znicr%).0kvr%r%r& s z0DataSourceLXD.network_config..z8LXD datasource generating network config using fallback.) rRrUNSETrSrarIrJr_r r.itemsr/r )r6rkr%r%r&network_configs(         zDataSourceLXD.network_config)r=r>r?ZdsnamerrprRr rstr__annotations__rS DataSourcerUr rXintrWboolrZrarcrjpropertyrJrrr@r%r%r7r&rQs   "rQcCs"tjtrtttjSdS)z=Return True when this platform appears to have an LXD socket.F)ospathexistsrDstatS_ISSOCKlstatst_moder%r%r%r&rYs rYT)sessionrEdo_raisec Cstt|||}|js*td||j|jiSz |WStk rn}zt dj ||jd|W5d}~XYnXdS)NSkipping %s on [HTTP:%d]:%szFUnable to process LXD config at {url}. Expected JSON but found: {resp})rEresp) _do_requestokr r. status_codetextZjsonrrrMrN)rrErZ url_responserOr%r%r&_get_json_responses(  r)rrErrcCstdddD]:}||}d|jkrBtdtd|j||q qHq td|j||r||js|t dj |j||j d |S) Nrig?z,[GET] [HTTP:%d] %s, retrying %d more time(s)z[GET] [HTTP:%d] %sz3Invalid HTTP response [{code}] from {route}: {resp})codeZrouter) ranger_rtimesleepr r!r.rrrMrNr)rrErZretriesrhr%r%r&r/s*    rc@s0eZdZeZeZeZeZeeBeBZdS)rfN) r=r>r?rZNONECONFIGDEVICESrgALLr%r%r%r&rfLs rfc@s@eZdZefedddZejedddZ e eddd Z d S) _MetaDataReader api_versioncCs||_tt|j|_dSr9)rr combine_urlLXD_URL _version_url)r6rr%r%r&r3Usz_MetaDataReader.__init__)rrc Csdii}t|jd}t||}t|D]}tt|}t||dd}|jsbt d||j |j q(| dd}|j |d|<|t kr(t ||kr|j |t |<q(td||dd d q(|S) aIterate on LXD API config items. Promoting CONFIG_KEY_ALIASES Any CONFIG_KEY_ALIASES which affect cloud-init behavior are promoted as top-level configuration keys: user-data, network-data, vendor-data. LXD's cloud-init.* config keys override any user.* config keys. Log debug messages if any user.* keys are overridden by the related cloud-init.* key. r-Frr/rz,Ignoring LXD config %s in favor of %s value.userz cloud-initr))rrrrsortedrrrr r.rr rpartitionCONFIG_KEY_ALIASESr!replace) r6rr-Z config_urlZ config_routesZ config_routeZconfig_route_urlZconfig_route_responseZcfg_keyr%r%r&_process_configYs@      z_MetaDataReader._process_config)rerc Cst}||jtd|ji}tj|krLt |jd}t ||j |d<tj |krf| ||tj|krt |jd}t||dd}|r||d<|W5QRSQRXdS)NZ_metadata_api_versionr]rkFr)requestsSessionZmountrrCrrfrgrrrrrupdaterrr)r6rerriZmd_routerErkr%r%r&__call__s"     z_MetaDataReader.__call__N) r=r>r?rbrsr3rrrJrrfrr%r%r%r&rTs7r)rrercCst|d|dS)a8Fetch metadata from the /dev/lxd/socket routes. Perform a number of HTTP GETs on known routes on the devlxd socket API. Minimally all containers must respond to /meta-data when the LXD configuration setting `security.devlxd` is true. When `security.devlxd` is false, no /dev/lxd/socket file exists. This datasource will return False from `is_platform_viable` in that case. Perform a GET of /config` and walk all `user.*` configuration keys, storing all keys and values under a dict key LXD_SOCKET_API_VERSION: config {...}. In the presence of the following optional user config keys, create top level aliases: - user.user-data -> user-data - user.vendor-data -> vendor-data - user.network-config -> network-config :param api_version: LXD API version to operated with. :param metadata_keys: Instance of `MetaDataKeys` indicating what keys to fetch. :return: A dict with the following optional keys: meta-data, user-data, vendor-data, network-config, network_mode, devices. Below is a dict representation of all raw configuration keys and values provided to the container surfaced by the socket under the /1.0/config/ route. rrd)r)rrer%r%r&r^s#r^cCs t|tSr9)rZlist_from_depends datasources)Zdependsr%r%r&get_datasource_listsr__main__z*Query LXD metadata and emit a JSON object.) descriptionrd)N)T)T)G__doc__ryr:r|renumrrZ json.decoderrtypingrrrrr r r rZrequests.adaptersr Zurllib3.connectionr Zurllib3.connectionpoolrZ cloudinitrZloggingrrrrZ cloudinit.netrZ getLoggerr=r rDrbrrrsr'r/r0rArCrJrPrurQrwrYrrZResponserrfrrr^ZDEP_FILESYSTEMrrargparserArgumentParserparser parse_argsprintZ json_dumpsr%r%r%r&s  $         &  m  Q *