D7net
Home
Console
Upload
information
Create File
Create Folder
About
Tools
:
/
lib
/
python3.6
/
site-packages
/
cloudinit
/
cmd
/
__pycache__
/
Filename :
main.cpython-36.pyc
back
Copy
3 \�me�� � @ s` d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlmZ d dl m Z d dl m Z d dl m Z d dl m Z d dl mZ d dl mZ d d l mZ d d l mZ d d l mZ d d l mZ d d lmZ d dlmZ d dlmZ d dlmZ d dl m Z m Z m Z m Z m!Z!m"Z" d dl#m$Z$ d dl%m&Z& d dl'm(Z(m)Z)m*Z*m+Z+ dZ,dZ-e(e)e*d�Z.ej/e0�Z1dJdd�Z2dd � Z3dKd d �Z4d d � Z5d!d"� Z6ed#�d$d%�Z7d&d'� Z8dMd*d+�Z9dNee:e;f d-�d.d/�Z<d0d1� Z=d2d3� Z>d4d5� Z?d6d7� Z@d8d9� ZAd:d;� ZBdOd<d=�ZCe jDd>�d?d@�ZEdAdB� ZFdCdD� ZGdPdEdF�ZHe0dGk�r\dHejIk�rBdIejIdH< eHejJ�ZKeK�r\ejLeK� dS )Q� N)�Tuple)�netinfo)�signal_handler)�sources)�stages)� url_helper)�util)�version)�warnings)� reporting)� atomic_helper)�read_cfg_paths)�cc_set_hostname)�Modules)�validate_cloudconfig_schema)� LogExporter�setup_basic_logging� setup_logging� reset_logging�configure_root_logger� DEPRECATED)�events)�load)� PER_INSTANCE� PER_ALWAYS�PER_ONCE� CLOUD_CONFIGzOCloud-init v. {version} running '{action}' at {timestamp}. Up {uptime} seconds.zcloud_%s_modules)�instance�always�once� c C s^ | rt jjd| � t jjdd � t jjd� tjt jd� t jjdd � t jjd� d S )Nz%s �-�< � )�file)�sys�stderr�write� traceback� print_exc)�msg� r+ �/usr/lib/python3.6/main.pyr) H s r) c C s t j� r tj� } tjd| � d S )Nz PID [%s] started cloud-init.)r Zis_Linux�os�getppid�LOG�info)Zppidr+ r+ r, �log_ppidR s r1 c C s, |s t | �}tjd| ddtd� t� |S )Nz%s FT)Zconsoler& �log)�welcome_formatr Z multi_logr/ r1 )�actionr* r+ r+ r, �welcomeX s r5 c C s t jtj� tj� tj� | d�S )N)r �uptimeZ timestampr4 )�WELCOME_MSG_TPL�formatr �version_stringr r6 Z time_rfc2822)r4 r+ r+ r, r3 ` s r3 c C s2 g }| j r.x"| j D ]}|jtjj|j�� qW |S )N)�files�appendr- �path�realpath�name)�argsZfn_cfgsZfhr+ r+ r, � extract_fnsi s r@ )�modsc C sv t | }| j|�\}}t|�t|� }|dkrXd||f }tjjd| � tj|� g S tjdt|�t|�� |S d S )Nr z)No '%s' modules to run under section '%s'z%s z Ran %s modules with %s failures)�MOD_SECTION_TPLZ run_section�lenr% r& r' r/ �debug)rA � action_nameZsectionZfull_section_name� which_ran�failuresZtotal_attemptedr* r+ r+ r, �run_module_sectionv s rH c C s | j d�rtj| j d�� d S )Nr )�getr Zupdate_configuration)�cfgr+ r+ r, �apply_reporting_cfg� s rK �cloud-config-url�urlc C s@ t j| �}x |D ]}||kr||| fS qW td| |f ��d S )Nz!No keys (%s) found in string '%s')r Zkeyval_str_to_dict�KeyError)�cmdline�names�data�keyr+ r+ r, �parse_cmdline_url� s rS T)�returnc C s( |dkrt j� }yt|�\}}W n tk r: tjdfS X |jd �}|r�tjj | �r�|rxd| |f }tj }|r�tj}nd| |f }tj }||fS |ddd d �}|s�|r�tj }d |d < ntj}d |d < d} d} �yt j f |�} d} | j� �r�d } t| t j��rDy | t| jt| �d��7 } W n tk �r0 Y nX | j| ��sVd} n| jj| ��sVd} | �r�|dk�r�ttt jdddd d��fS n0|dk�r�tj }ntj }|d|� dt| �� �fS n|d|| jf fS | | j } W n0 t jk �r } z|d||f fS d}~X nX t j| | d d � tj d ||| f fS ) a� Write data from url referenced in command line to path. path: a file to write content to if downloaded. network: should network access be assumed. cmdline: the cmdline to parse for cloud-config-url. This is used in MAAS datasource, in "ephemeral" (read-only root) environment where the instance netboots to iscsi ro root. and the entity that controls the pxe config has to configure the maas datasource. An attempt is made on network urls even in local datasource for case of network set up in initramfs. Return value is a tuple of a logger function (logging.DEBUG) and a message indicating what happened. Nz!No kernel command line url found.�file://�/z_file '%s' existed, possibly from local stage download of command line url '%s'. Not re-writing.zafile '%s' existed, possibly from previous boot download of command line url '%s'. Not re-writing.� � T)rM ZtimeoutZretries�stream� Z sec_betweeng�������?s #cloud-config� )Z chunk_sizeFrM z!The kernel command line key `url`z22.3zD Please use `cloud-config-url` kernel command line parameter instead)Z deprecatedZdeprecated_versionZ extra_messageZ return_logzcloud-config-urlz contents of 'z' did not start with z$url '%s' returned code %s. Ignoring.z retrieving url '%s' failed: %si� )�modez*wrote cloud-config data from %s='%s' to %s)rU rV ) r Z get_cmdlinerS rN �logging�DEBUG� startswithr- r< �exists�INFO�WARNr Zread_file_or_url�ok� isinstanceZ UrlResponse�nextZ iter_contentrC � StopIteration�contentsr �strZ deprecate�codeZUrlError� write_file)r< �networkrO Z cmdline_namerM Z path_is_local�m�level�kwargsrQ �headerZrespZsniffed_contentZ is_cloud_cfg�er+ r+ r, �attempt_cmdline_url� s� rq c C s� dt jjt jjf }tjj| jjd�d�}tjj |�rlt |�j � }||kr�t j d� | jd� tj||� n*tjj | jjd��r�t jd� tj||� dS ) z�Purge the cache if python version changed on us. There could be changes not represented in our cache (obj.pkl) after we upgrade to a new version of python, so at that point clear the cache z%d.%drQ zpython-versionz-Python version change detected. Purging cacheTZobj_pklzMWriting python-version file. Cache compatibility status is currently unknown.N)r% � version_info�major�minorr- r< �join�paths� get_cpathr` �open�readr/ rD � purge_cacher rj � get_ipath_curr0 )�initZcurrent_python_versionZpython_version_pathZcached_python_versionr+ r+ r, �$purge_cache_on_python_version_change s r} c C s t j| jd�rdS |j S )NZdisable_network_activationF)r �get_cfg_option_boolrJ �local)r| r? r+ r+ r, �_should_bring_up_interfaces& s r� c - C s t jt jg}|jrt jg}ttjjdt d�|j d�g}|jsJt | �}n t d| �}t j ||j d�}|j t|�� d }d }y.|jtjdf� tj� tj|j| �\}}W n< tk r� d}tjt|� t|� |jtj|f� Y nX |j�r tjd� t � t |j� t |j� t | |d � x |D ]\} }tj | |� �q&W y |j!� W n" tk �rn tjtd � Y nX |j"} t#|� |j�r�t j$nt j%} | t j%k�r�d } t&j'j(d t)j*� � nZd } tj+|jdd�} | �r�tjd� d } n(| j,d�}tjj-|��r tjd|� d } |j.� t/||�}yB|j0| d� | t j%k�r\|j1j2| k�r\tjd| |j1� d g fS W n� t j3k �r� | t j$k�r�tjd� n tjtd� |j4�s�|j5|d� tjd| � | t j$k�r�d g fS d dgfS n tjd| � Y nX t6|� |j7� }tjd| | ||j8� � | t j$k�r(t9|d d d � |j5|d� | t j$k�rx|j1j2| k�rhtjd | |j1� |j1g fS tjd | |j1� |j:� |j;� t9|d!d"d � y2|j<� j=d#|j>t?gt?d$�\}}|�s�|j>t@� W n* tk �r� tjtd%� |j1d%gfS X |j"j,d&�}tjj-|��r<tjA|�jBd'k�r<tCtDtjE|��ddd(d)� n tjd*� t |j� tF|t|�|j d+�}yR|}|}tjG|j| �\}}||k�s�||k�r�tjHd,||� tj|j| �\}}W n" tk �r� tjtd-� Y nX t |j� |jI� tJ|j1|jd.� |j1tK|| | �fS )/Nz%s.dz91_kernel_cmdline_url.cfg)r< rk z%s-local)�ds_deps�reporterzClosing stdin.z#Failed to setup output redirection!z@Logging being reset, this logger may no longer be active shortly)r* z0Failed to initialize, likely bad things to come!�trustz%s ZcheckZmanual_cache_cleanFz"manual cache clean set from configZmanual_clean_markerz(manual cache clean found from marker: %s)�existingz)[%s] Exiting. datasource %s in local modezNo local datasource foundz8No instance datasource found! Likely bad things to come!)Zbring_upz [%s] Exiting without datasourcez No instance datasource found.z2[%s] barreling on in force mode without datasourcez5[%s] %s will now be targeting instance id: %s. new=%sr rk )�stage� retry_stagez.[%s] Exiting. datasource %s not in local mode.z6[%s] %s is in local mode, will apply init modules now.zinit-netzmodules:config� consume_data)r? ZfreqzConsuming user data failed!Z cloud_configr T)�config�strictZ log_detailsZlog_deprecationsz2Skipping user-data validation. No user-data found.)r� z#Stdout, stderr changing to (%s, %s)z'Failed to re-adjust output redirection!)� datasourcerJ )Lr ZDEP_FILESYSTEMZ DEP_NETWORKr rq r- r< ru r r3 r �Initr� �read_cfgr@ r; r] r^ r � close_stdin� fixup_outputrJ � Exception�logexcr/ r) rb rD r r rK r5 r2 Z initializerv r} Z DSMODE_LOCALZDSMODE_NETWORKr% r& r' r Z debug_infor~ r{ r` rz r� �fetchr� Zdsmode�DataSourceNotFoundException�forceZapply_network_config� _maybe_persist_instance_dataZ instancifyZis_new_instance�_maybe_set_hostnameZsetup_datasource�update�cloudifyZrunr� r r �stat�st_sizer r � load_filer Zget_output_cfg�warningZactivate_datasource�di_report_warnrH )r> r? ZdepsZ early_logs�w_msgr| ZoutfmtZerrfmtr* ZlvlZ path_helperr\ r� ZmcfgZmfileZbring_up_interfacesZiidZranZ_resultsZcloud_cfg_pathrA Z outfmt_origZ errfmt_origr+ r+ r, � main_init, s r� c C s� d|krt jd� d S |d }|d kr4t jd� d S t|t�sNt jd|� d S |jd�}|d krnt jd� d S t|t�s�t jd|� d S | jjd�d }|j t j �r�|t t j �d � }nt jd | |� ||kr�t jd | ||� d S t jd ||t|�d � d S )NZ di_reportz no di_report found in config.zdi_report was None.z%di_report config not a dictionary: %sZdatasource_listz(no 'datasource_list' found in di_report.z(di_report/datasource_list not a list: %s�.rX z1Datasource '%s' came from unexpected module '%s'.z:used datasource '%s' from '%s' was in di_report's list: %sZdsid_missing_source)�source�dslist)r/ rD rd �dictr� rI �list� __module__� rpartitionr_ r Z DS_PREFIXrC r Z show_warningrh )r� rJ Zdicfgr� �modnamer+ r+ r, r� sB r� c C s( |j }td| |f �}tjg |jd�}|jt|�� y|jdd� W n> tj k r� d| }t j t |� t |� |js~|gS Y nX t|� t|t|�|jd�}y$t jd� t j� t j|j|� W n tk r� t j t d� Y nX |jr�t jd � t� t|j� t|j� t||d � t|||�S ) Nz%s:%s)r� r� r� )r� zGCan not apply stage %s, no datasource found! Likely bad things to come!)r� z Closing stdinz#Failed to setup output redirection!z@Logging being reset, this logger may no longer be active shortly)r* )r\ r3 r r� r� r� r@ r� r r� r r� r/ r) r� r� r rD r� r� rJ r� r r rK r5 rH )rE r? r> r� r| r* rA r+ r+ r, � main_modules> s: r� c C s� |j }t| �}tjg |jd�}|jt|�� y|jdd� W n4 tj k rp t j t d� t d� |jsldS Y nX t|� t|t|�|jd�}|j}|r�t jd|� |j}|r�t jd|� tj|�}y$t jd � t j� t j|jd � W n" tk �r t j t d � Y nX |j�r$t jd � t� t|j� t |j� t | |d � |j |||�\}} | �rlt j d |� dS |�s�t j d|� dS dS d S )N)r� r� r� )r� z;Failed to fetch your datasource, likely bad things to come!rZ )r� z Using passed in arguments %sz Using passed in frequency %sz Closing stdinz#Failed to setup output redirection!z@Logging being reset, this logger may no longer be active shortly)r* zRan %s but it failed!z Did not run %s, does it exist?r ) r> r3 r r� r� r� r@ r� r r� r r� r/ r) r� r� r � module_argsrD Z frequency�FREQ_SHORT_NAMESrI r� r� rJ r� r r rK r5 Z run_singler� ) r> r? Zmod_namer� r| rA Zmod_argsZmod_freqrF rG r+ r+ r, � main_singleu sV r� c C s` |d krt � }|jd�}|d kr,tjjd�}tjj|d�}tjj|d�}tjj|d�}tjj|d�}tj� } tj ||f� |j \} } | dkr�|j r�d} q�d} n | dkr�d|j } n t d | ��d } | | kr�t d j| ���d }| dk�rxL||||fD ]}tj|� q�W n,ytjtj|��}W n tk �r2 Y nX g d d d �}|d k�r^di i}d |d d< x,| D ]$}||d k�rd|j� |d |< �qdW |d }| |d< tj� || d< ttdd� | j��j� || d< tj||� tj tjj ||�|dd� yR| | |�}| d k�r(|\}}|d k �r,t |�|d< n|}dd� |D �|| d< W nP tk �r� } z2tj t d| � t!d| � t |�g|| d< W Y d d }~X nX tj� || d < d |d< ttd d� | j��j� || d< tj||� | d k�rPg }x2| D ]*}|| d �r�|j"|| j#dg �� �q�W tj|d|d |d �i� tj tjj ||�|dd� t$|| d �S )!NrQ z/run/cloud-initz status.jsonz result.jsonr| � init-local�modulesz modules-%szunknown name: %s�modules-config� modules-finalz'Invalid cloud init mode specified '{0}')�errors�start�finished�v1r� r� r� c S s t | t�S )N)rd r )�hr+ r+ r, �<lambda> s z status_wrapper.<locals>.<lambda>Zrecoverable_errorsT)r� c S s g | ] }t |��qS r+ )rh )�.0rp r+ r+ r, � <listcomp> s z"status_wrapper.<locals>.<listcomp>r� zfailed stage %szfailed run of stage %sr� c S s t | t�S )N)rd r )r� r+ r+ r, r� ! s )r� r� )r| r� r� r� )r| r� )%r rw r- r< �normpathru r] � getLoggerr Z ensure_dirsr4 r r\ � ValueErrorr8 Zdel_file�json�loadsr� r� �copy�timere �filterZhandlersZ export_logsr Z write_jsonZsym_link�relpathrh r� r/ r) �extendrI rC )r> r? Zdata_dZlink_drv Z status_pathZ status_linkZ result_pathZ result_linkZ root_logger�_name�functorr\ Zmodes�status�fZ nullstatusrl r� �retr� r� rp r+ r+ r, �status_wrapper� s� $ r� )r| c C s6 | j r2| jr2| jjd�}tjj|�s2| j jdd� dS )zCWrite instance-data.json file if absent and datasource is restored.Z instance_dataF)Z write_cacheN)r� Z ds_restoredrv Z get_runpathr- r< r` Zpersist_instance_data)r| Zinstance_data_filer+ r+ r, r� 7 s r� c C sx | j � }tj| j|dd�\}}}|rtytjd| j|d� W n8 tjk rr } ztjd||t |�� W Y dd}~X nX dS )z�Call set_hostname if metadata, vendordata or userdata provides it. @param stage: String representing current stage in which we are running. @param retry_stage: String represented logs upon error setting hostname. T)Z metadata_onlyZ set_hostnameNzGFailed setting hostname in %s stage. Will retry in %s stage. Error: %s.) r� r Zget_hostname_fqdnrJ r ZhandleZSetHostnameErrorr/ rD rh )r| r� r� ZcloudZhostnameZ_fqdn�_rp r+ r+ r, r� ? s r� c C s t jjdjttj��d � d S )Nr# )r% �stdoutr' ru �sortedr ZFEATURES)r> r? r+ r+ r, � main_featuresV s r� c " C s� t � | stj} tj| jd�d�}|jddddtj� dd� |jd d d d d tj d�d� |jdddddd� |jdddddd� |j d d� |j dd d �}d |_ |j d d d!�}|jd"d#dd$dd� |j d tfd%� |j d&d'd!�}|jd(d)d*d+d,dcd.� |j d&tfd%� |j d/d0d!�}|jd1d2d*d3d d4� |jd5d*d6dttj� �d7� |jd8dd9dd4� |jd:d;d<d=d>� |j d/tfd%� |j d?d@d!�}|j dAdBd!�}|j dAtfd%� |j dCdDd!�}|j dEdFd!�} |j dGdHd!�} |j dIdJd!�} |j dKdLd!�} |j dMdNd!�} | �rN| d }|dCk�r*ddOlm} ||� �n$|dEk�rLddOlm} || � �n|dGk�r�ddPlm}m} || � | j dG|fd%� n�|dIk�r�ddQlm}m} || � | j dI|fd%� n�|d?k�r�ddRl m}m } ||� |j dS|fd%� nf|dMk�r ddTl m}m } || � | j dM|fd%� n2|dKk�rNddUl m}m!} || � | j dK|fd%� |j"| dV�}|j#\} } | ddk�r�t$|j%�r~t&j'nt&j(� n|j%�r�t$� t)j*� d | k�s�d&| k�r�d |j+k�r�t,} d } d } | d k�r�|j-�r�de\} } ndf\} } nZ| d&k�rd[|j+ d\|j+ } } n8| d/k�r:d]|j. d^|j. } } |j/} n| } d_| } d} t0j1| | | d`�|_2|j2�$ t3j4t5j%da| d | | |fdb�}!W d Q R X t6j7� |!S )gNr )�progz --versionz-vr z %(prog)s z'Show program's version number and exit.)r4 r �helpz--filez-fr; r: z(Use additional yaml configuration files.�rb)r4 �destr� �typez--debugz-d� store_truez:Show additional pre-action logging (default: %(default)s).F)r4 r� �defaultz--forcezDForce running even if no datasource is found (use at your own risk).r� )r4 r� r� r� )r� Z Subcommands� subcommand)�titler� Tr| z2Initialize cloud-init and perform initial modules.)r� z--localz-lz+Start in local mode (default: %(default)s).)r4 r� z1Activate modules using a given configuration key.z--modez-mZstorez8Module configuration name to use (default: %(default)s).r� �final)r4 r� r� �choicesZsinglezRun a single module.z--namez-nzModule name to run.)r4 r� �requiredz --frequencyz Module frequency for this run.)r4 r� r� r� z--reportzEnable reporting.r� �*Zargumentz0Any additional arguments to pass to this module.)�nargs�metavarr� Zqueryz;Query standardized instance metadata from the command line.ZfeatureszList defined features.Zanalyzez-Devel tool: Analyze cloud-init logs and data.ZdevelzRun development tools.z collect-logsz*Collect and tar all cloud-init debug info.Zcleanz3Remove logs and artifacts so cloud-init can re-run.r� z/Report cloud-init status or wait on completion.Zschemaz-Validate cloud-config files using jsonschema.)� get_parser)r� �handle_collect_logs_args)r� �handle_clean_args)r� � handle_argsZrender)r� �handle_schema_args)r� �handle_status_args)r? � init-local� searching for local datasources� init-network�!searching for network datasourcesz modules-%szrunning modules for %sz single/%szrunning single module %szrunning 'cloud-init %s')Zreporting_enabledzcloud-init mode '%s')Zlogfuncr* Z get_uptime�funcr? )r| r� r� )r| r� )r� r� )r� r� )8r r% �argv�argparse�ArgumentParser�pop� add_argumentr r9 ZFileTypeZ set_defaultsZadd_subparsersr� Z add_parserr� r� r� r� �keysr� r� Zcloudinit.analyzer� Zcloudinit.cmd.devel.parserZcloudinit.cmd.devel.logsr� Zcloudinit.cmd.cleanr� Zcloudinit.cmd.queryr� �cloudinit.config.schemar� Zcloudinit.cmd.statusr� � parse_argsr4 r rD r] r^ ZWARNINGr Zattach_handlersr\ r� r r> Zreportr ZReportEventStackr� r Zlog_timer/ r Z flush_events)"Z sysv_args�parserZ subparsersZ parser_initZ parser_modZ parser_singleZ parser_queryZparser_featuresZparser_analyzeZ parser_develZparser_collect_logsZ parser_cleanZ parser_statusZ parser_schemar� Zanalyze_parserZ devel_parserZ logs_parserr� Z clean_parserr� Z query_parserZhandle_query_argsZ schema_parserr� Z status_parserr� r? r> r� ZrnameZ report_onZrdescZretvalr+ r+ r, �mainZ s@ r� �__main__ZTZz:/etc/localtime)r )N�rL rM )r� )TN)NN)N)Mr� r� r- r% r� r( r] Ztypingr Z cloudinitr r r r r r r r r r Zcloudinit.cmd.develr Zcloudinit.configr Zcloudinit.config.modulesr r� r Z cloudinit.logr r r r r r Zcloudinit.reportingr Zcloudinit.safeyamlr Zcloudinit.settingsr r r r r7 rB r� r� �__name__r/ r) r1 r5 r3 r@ rH rK rS �intrh rq r} r� r� r� r� r� r� r� r� r� r� r� �environr� Z return_value�exitr+ r+ r+ r, �<module> sx r a27G {