D7net
Home
Console
Upload
information
Create File
Create Folder
About
Tools
:
/
lib
/
python3.6
/
site-packages
/
cloudinit
/
config
/
__pycache__
/
Filename :
cc_growpart.cpython-36.opt-1.pyc
back
Copy
3 \�me"T � @ s* U d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl m Z m Z ddl m Z ddlmZ ddlmZ ddlmZ ddlmZmZmZ dd lmZ dd lmZ dd l m Z m Z dd l m Z m!Z! dd l"m#Z# dZ$e#Z%ddde$e ge%ed�ed�gg d�Z&e &e e&�Z ddgdd�Z'ed�Z(G dd� d�Z)ej*e+�Z,e-e!e.d �d d �Z/G d d � d e0�Z1G d!d"� d"e �Z2G d#d$� d$e2�Z3G d%d&� d&e2�Z4G d'd(� d(e2�Z5d)d*� Z6d+d,� Z7d-d.� Z8d/d0� Z9e:d1�d2d3�Z;d4d5� Z<ee-e-f d1�d6d7�Z=d8d9� Z>e-eee.dd:�d;d<�Z?d=e3fd>e4fd?e5ffZ@dS )@zGrowpart: Grow partitions� N)�ABC�abstractmethod)�suppress)�Path)�dedent)�Tuple)�subp� temp_utils�util)�Cloud)�Config)� MetaSchema� get_meta_doc)� ALL_DISTROS�Distro)� PER_ALWAYSa6 Growpart resizes partitions to fill the available disk space. This is useful for cloud instances with a larger amount of disk space available than the pristine image uses, as it allows the instance to automatically make use of the extra space. Note that this only works if the partition to be resized is the last one on a disk with classic partitioning scheme (MBR, BSD, GPT). LVM, Btrfs and ZFS have no such restrictions. The devices on which to run growpart are specified as a list under the ``devices`` key. There is some functionality overlap between this module and the ``growroot`` functionality of ``cloud-initramfs-tools``. However, there are some situations where one tool is able to function and the other is not. The default configuration for both should work for most cloud instances. To explicitly prevent ``cloud-initramfs-tools`` from running ``growroot``, the file ``/etc/growroot-disabled`` can be created. By default, both ``growroot`` and ``cc_growpart`` will check for the existence of this file and will not run if it is present. However, this file can be ignored for ``cc_growpart`` by setting ``ignore_growroot_disabled`` to ``true``. For more information on ``cloud-initramfs-tools`` see: https://launchpad.net/cloud-initramfs-tools On FreeBSD, there is also the ``growfs`` service, which has a lot of overlap with ``cc_growpart`` and ``cc_resizefs``, but only works on the root partition. In that configuration, we use it, otherwise, we fall back to ``gpart``. Note however, that ``growfs`` may insert a swap partition, if none is present, unless instructed not to via ``growfs_swap_size=0`` in either ``kenv(1)``, or ``rc.conf(5)``. Growpart is enabled by default on the root partition. The default config for growpart is:: growpart: mode: auto devices: ["/"] ignore_growroot_disabled: false Z cc_growpartZGrowpartzGrow partitionsz� growpart: mode: auto devices: ["/"] ignore_growroot_disabled: false z� growpart: mode: growpart devices: - "/" - "/dev/vdb1" ignore_growroot_disabled: true )�id�name�title� descriptionZdistros� frequencyZexamplesZactivate_by_schema_keys�auto�/F)�mode�devices�ignore_growroot_disabledz/cc_growpart_keydatac @ s e Zd ZdZdZdZdZdS )�RESIZE�SKIPPED�CHANGED�NOCHANGE�FAILEDN)�__name__� __module__� __qualname__r r r r � r$ r$ �!/usr/lib/python3.6/cc_growpart.pyr o s r )r �distror c C s� d }| dkrFx*t D ]"\}}||�}|j|d�r|}P qW |s�td��n^i }xt D ]\}} | ||< qPW | |krxtd| ��|| |�} | j|d�r�| }|s�td| ��|S )Nr )r zNo resizers availablezunknown resize mode %szmode %s not available)�RESIZERS� available� ValueError� TypeError) r r& r Z resize_class�_name�resizerZcurZmmap�k�vZmclassr$ r$ r% �resizer_factoryy s( r/ c @ s e Zd ZdS )�ResizeFailedExceptionN)r! r" r# r$ r$ r$ r% r0 � s r0 c @ s: e Zd Zed�dd�Zeeed�dd��Zedd� �Z d S ) �Resizer)r& c C s || _ d S )N)�_distro)�selfr& r$ r$ r% �__init__� s zResizer.__init__)r �returnc C s d S )Nr$ )r3 r r$ r$ r% r( � s zResizer.availablec C s d S )Nr$ )r3 �diskdev�partnum�partdevr$ r$ r% �resize� s zResizer.resizeN) r! r" r# r r4 r �list�boolr( r9 r$ r$ r$ r% r1 � s r1 c @ s" e Zd Zed�dd�Zdd� ZdS )�ResizeGrowPart)r c C sX t jj� }d|d< y*tjddg|d�\}}tjd|�r:dS W n tjk rR Y nX dS ) N�C�LANG�growpartz--help)�envz --update\s+TF)�os�environ�copyr �re�search�ProcessExecutionError)r3 r �myenv�outZ_errr$ r$ r% r( � s zResizeGrowPart.availablec & C s8 t jj� }d|d< t|�}| jj� }tj|dd���}t jj |d�}t jj |�sZt j |d� ||d< yt j dd||g|d � W nJ t j k r� } z,| jd kr�tjtd ||� t| �| �||fS d } ~ X nX yt j d||g|d � W n@ t j k �r } z tjtd ||� t| �| �W Y d d } ~ X nX W d Q R X |t|�fS ) Nr= r> T)�dirZ needs_exer? i� ZTMPDIRz --dry-run)r@ � z&Failed growpart --dry-run for (%s, %s)zFailed: growpart %s %s)rA rB rC �get_sizer2 Zget_tmp_exec_pathr Ztempdir�path�join�exists�mkdirr rF � exit_coder �logexc�LOGr0 ) r3 r6 r7 r8 rG �beforeZtmp_dirZtmpdZ growpart_tmp�er$ r$ r% r9 � s6 &zResizeGrowPart.resizeN)r! r" r# r: r( r9 r$ r$ r$ r% r< � s r< c @ s& e Zd ZdZed�dd�Zdd� ZdS )� ResizeGrowFSa� Use FreeBSD ``growfs`` service to grow root partition to fill available space, optionally adding a swap partition at the end. Note that the service file warns us that it uses ``awk(1)``, and as such requires ``/usr`` to be present. However, cloud-init is installed into ``/usr/local``, so we should be fine. We invoke the ``growfs`` with ``service growfs onestart``, so it doesn't need to be enabled in ``rc.conf``. )r c C s t jjd�o|dgkS )z'growfs only works on the root partitionz/etc/rc.d/growfsr )rA rL �isfile)r3 r r$ r$ r% r( � s zResizeGrowFS.availablec C sd t |�}y| jjddd� W n: tjk rV } z tjtd� t|�|�W Y d d }~X nX |t |�fS )NZonestart�growfs)�actionZservicez Failed: service growfs onestart) rK r2 Zmanage_servicer rF r rQ rR r0 )r3 r6 r7 r8 rS rT r$ r$ r% r9 � s zResizeGrowFS.resizeN)r! r" r# �__doc__r: r( r9 r$ r$ r$ r% rU � s rU c @ s" e Zd Zed�dd�Zdd� ZdS )� ResizeGpart)r c C s^ t jj� }d|d< y0tjddg|ddgd�\}}tjd|�r@d S W n tjk rX Y nX d S ) Nr= r> �gpart�helpr rJ )r@ �rcszgpart recover TF)rA rB rC r rD rE rF )r3 r rG Z_out�errr$ r$ r% r( � s zResizeGpart.availablec C s� yt j dd|g� W nF t jk rZ } z(|jdkrJtjtd|� t|�|�W Y dd}~X nX t|�}yt j ddd||g� W n> t jk r� } z tjtd||� t|�|�W Y dd}~X nX |t|�fS ) a9 GPT disks store metadata at the beginning (primary) and at the end (secondary) of the disk. When launching an image with a larger disk compared to the original image, the secondary copy is lost. Thus, the metadata will be marked CORRUPT, and need to be recovered. r[ Zrecoverr zFailed: gpart recover %sNr9 z-iz Failed: gpart resize -i %s %s)r rF rP r rQ rR r0 rK )r3 r6 r7 r8 rT rS r$ r$ r% r9 s zResizeGpart.resizeN)r! r" r# r: r( r9 r$ r$ r$ r% rZ � s rZ c C s0 t j| t j�}zt j|dt j�S t j|� X d S )Nr )rA �open�O_RDONLY�lseek�SEEK_END�close)�filename�fdr$ r$ r% rK s rK c C s� t jj| �}t jj|�}d| }tj� rVdtj| � }tjd|�}|rV|d |d fS t jj |�srt d| |f ��t jj |d�}t jj |�s�t d| ��tj |�j� }t jj|�}t jj|�} tj t jj | d��j� } t jjd | �} | |fS ) Nz/sys/class/block/%sz/dev/z/^(?P<dev>/dev/.+)[sp](?P<part_slice>\d+[a-z]*)$�devZ part_slicez%s had no syspath (%s)� partitionz%s not a partitionz /dev/block/%s)rA rL �realpath�basenamer Zis_BSDZfind_freebsd_partrD rE rN r) rM r* Z load_file�rstrip�dirname) ZdevpathZrpathZbnameZsyspathZfpart�mZptpath�ptnumZrsyspathZ disksyspathZ diskmajminZ diskdevpathr$ r$ r% �device_part_info& s( rn c C st | j d�r| S tj| �}|s$td��|d }tj� }|dkrp| rptjtj� �}|d krptjj |�rh|S td��|S )Nz/dev/z,Could not determine device of '%s' % dev_entr z /dev/rootz!Unable to find device '/dev/root') � startswithr Zget_mount_infor) Z is_containerZrootdev_from_cmdlineZ get_cmdlinerA rL rN )�devent�resultrf Z containerr$ r$ r% � devent2devQ s rr c C s, t jj| �}|jd�r(tjd| |� |S dS )a Returns underlying block device for a mapped device. If it is mapped, blockdev will usually take the form of /dev/mapper/some_name If blockdev is a symlink pointing to a /dev/dm-* device, return the device pointed to. Otherwise, return None. z/dev/dm-z$%s is a mapped device pointing to %sN)rA rL rh ro rR �debug)�blockdevrh r$ r$ r% �get_mapped_deviceh s ru )r5 c C s� t jd�stjd� dS yt j dd| g� W nH t jk rt } z*|jdkrXtjd| � ntjd|j� dS d}~X nX tt j��" t j dd |g� tjd | � d S Q R X dS ) z� Check if a device is an encrypted device. blockdev should have a /dev/dm-* path whereas partition is something like /dev/sda1. � cryptsetupz6cryptsetup not found. Assuming no encrypted partitionsF�status� z#Determined that %s is not encryptedzZReceived unexpected exit code %s from cryptsetup status. Assuming no encrypted partitions.NZisLuksz Determined that %s is encryptedT)r ZwhichrR rs rF rP �warningr )rt rg rT r$ r$ r% � is_encryptedx s" rz c C s� ddd| g}t j |�d }|jd�s2td|� ���y d|jd�d jd �d � �S tk r� } z td |� d |� d ��|�W Y d d }~X nX d S )NZdmsetupZdepsz--options=devnamer z1 dependz5Expecting '1 dependencies' from 'dmsetup'. Received: z/dev/z: (rJ �)zRan `z$`, but received unexpected stdout: `�`)r ro � RuntimeError�split� IndexError)rt ZcommandZdeprT r$ r$ r% �get_underlying_partition� s r� c 0 C s, t j� stjdfS y<t j� �}tj|�}W dQ R X |d }tj|�}|d }W n, t k rz } zt d�|�W Y dd}~X nX z t j dddd | g|d � W dy t j dd d |t |�g� W n0 t j k r� } ztjd |� W Y dd}~X nX y t j� W n" t k �r tjtd� Y nX X tjd| � d�fS )z�Use 'cryptsetup resize' to resize LUKS volume. The loaded keyfile is json formatted with 'key' and 'slot' keys. key is base64 encoded. Example: {"key":"XFmCwX2FHIQp0LBWaLEMiHIyfxt1SGm16VvUAVledlY=","slot":5} zNo encryption keyfile foundN�key�slotzZCould not load encryption key. This is expected if the volume has been previously resized.rv z --key-file�-r9 )�dataZ luksKillSlotz --batch-modez<Failed to kill luks slot after resizing encrypted volume: %sz8Failed to remove keyfile after resizing encrypted volumez'Successfully resized encrypted volume '�')� KEYDATA_PATHrN r r r_ �json�load�base64Z b64decode� Exceptionr} r �strrF rR ry �unlinkr rQ r )rt rg �fZkeydatar� Z decoded_keyr� rT r$ r$ r% �resize_encrypted� sD r� c = C s� t j |�}g }�x�|�r�|jd�}y t|�}W n: tk rh } z |j|tjd| f� wW Y d d }~X nX ytj|�}W n> t k r� } z"|j|tjd||f f� wW Y d d }~X nX tj |j � r�tj |j � r�|j|tjd| f� qt |�}|�r�y�t|�}t||��r^|dd� |D �k�r>|jd|� |jd|� wt||�\} } |j|| | f� n|j|tjd|� d�f� W q tk �r� } z$|j|tjd |� d |� �f� W Y d d }~X qX qyt|�\} } W nD ttfk �r } z"|j|tjd ||f f� wW Y d d }~X nX yZ| j| | |�\} }| |k�rP|j|tjd | | f f� n |j|tjd | | | |f f� W q tk �r� } z"|j|tjd| | |f f� W Y d d }~X qX qW |S )Nr z unable to convert to device: %szstat of '%s' failed: %sz device '%s' not a block devicec S s g | ] }|d �qS )r r$ )�.0�xr$ r$ r% � <listcomp> s z"resize_devices.<locals>.<listcomp>zResizing mapped device (z!) skipped as it is not encrypted.zResizing encrypted device (z ) failed: z device_part_info(%s) failed: %sz no change necessary (%s, %s)z changed (%s, %s) from %s to %sz'failed to resize: disk=%s, ptnum=%s: %s)rC �poprr r) �appendr r rA �stat�OSError�S_ISBLK�st_mode�S_ISCHRru r� rz �insertr� r� r rn r* r9 r r r0 )r, r �inforp rt rT ZstatretZunderlying_blockdevrg rw �messageZdiskrm �old�newr$ r$ r% �resize_devices� s� & &r� )r �cfg�cloud�argsr5 c C s� d|kr t jdt� t|d< |jd�}t|t�s>t jd� d S |jdd�}tj|�r||dkrltj ddd d � t jd |� d S tj|jd d ��r�t j j d�r�t jd� t jd� d S tj |ddg�}t|�s�t jd� d S yt||j|d�}W nB ttfk �r. } z t jd||� |dk�r |�d S d }~X nX tjt jdt||fd�} x@| D ]8\} } } | tjk�rtt jd| | � nt jd| | | � �qNW d S )Nr? z.No 'growpart' entry in cfg. Using default: %sz#'growpart' in config was not a dictr r Zoffz)Growpart's 'mode' key with value '{mode}'z22.2zUse 'off' instead.)Z deprecatedZdeprecated_versionZ extra_messagezgrowpart disabled: mode=%sr Fz/etc/growroot-disabledz0growpart disabled: /etc/growroot-disabled existsz&use ignore_growroot_disabled to ignorer r zgrowpart: empty device list)r& r z,growpart unable to find resizer for '%s': %sr� )Zlogfunc�msg�funcr� z'%s' resized: %sz '%s' %s: %s)rR rs �DEFAULT_CONFIG�get� isinstance�dictry r Zis_falseZ deprecaterA rL rV Zget_cfg_option_list�lenr/ r& r) r* Zlog_timer� r r r� ) r r� r� r� Zmycfgr r r, rT Zresized�entryrX r� r$ r$ r% �handle^ sT r� r? rW r[ )ArY r� rC r� ZloggingrA Zos.pathrD r� �abcr r � contextlibr Zpathlibr �textwrapr Ztypingr Z cloudinitr r r Zcloudinit.cloudr Zcloudinit.configr Zcloudinit.config.schemar r Zcloudinit.distrosr r Zcloudinit.settingsr ZMODULE_DESCRIPTIONr �metar� r� r Z getLoggerr! rR r� r: r/ r� r0 r1 r< rU rZ rK rn rr ru r; rz r� r� r� r� r' r$ r$ r$ r% �<module> st ' 3 '+7 8