| Server IP : 172.24.0.40 / Your IP : 216.73.216.10 Web Server : Apache System : Linux dbweb26.ust.edu.ph 4.18.0-513.5.1.el8_9.x86_64 #1 SMP Fri Sep 29 05:21:10 EDT 2023 x86_64 User : apache ( 48) PHP Version : 8.2.18 Disable Function : NONE MySQL : OFF | cURL : ON | WGET : ON | Perl : ON | Python : OFF | Sudo : ON | Pkexec : ON Directory : /proc/self/root/lib/python3.6/site-packages/vdo/vdomgmnt/__pycache__/ |
Upload File : |
3
&gndct � @ s� d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ dd lm Z dd
lm
Z
dd lm Z m Z dd lm
Z
dd
lmZ ddlmZmZ ddlmZmZ ddlmZmZmZ ddlmZmZ ddlZddlZddlZddl Z ddl Z ddl Z ddl m Z ddl!Z!ddl"Z"ddl#Z#ddl$Z$G dd� de �Z%G dd� dee%�Z&G dd� dee%�Z'G dd� dee%�Z(G d d � d ee%�Z)G d d � d e �Z*dS ) z�
VDOService - manages the VDO service on the local node
$Id: //eng/vdo-releases/aluminum/src/python/vdo/vdomgmnt/VDOService.py#41 $
� )�absolute_import)�division)�print_function)�unicode_literals� )�
ArgumentError)� Constants)�Defaults)�
MgmntUtils)�Service� ServiceError)�
SizeString)�VDOKernelModuleService)�DeveloperExitStatus�StateExitStatus)�SystemExitStatus�UserExitStatus)�Command� CommandError�
runCommand)� Transaction�
transactionalN)�
gethostbynamec s( e Zd ZdZed�f� fdd� Z� ZS )�VDOServiceErrorz)Base class for VDO service exceptions.
zVDO volume errorc s t t| �j|f|�|� d S )N)�superr �__init__)�self�msg�args�kwargs)� __class__� � /usr/lib/python3.6/VDOService.pyr > s zVDOServiceError.__init__)�__name__�
__module__� __qualname__�__doc__�_r �
__classcell__r! r! )r r" r 8 s r c s( e Zd ZdZed�f� fdd� Z� ZS )� VDODeviceAlreadyConfiguredErrorz8The specified device is already configured for a VDO.
zDevice already configuredc s t t| �j|f|�|� d S )N)r r) r )r r r r )r r! r" r H s z(VDODeviceAlreadyConfiguredError.__init__)r# r$ r% r& r' r r( r! r! )r r" r) B s r) c s( e Zd ZdZed�f� fdd� Z� ZS )�VDOServiceExistsErrorz VDO service exists exception.
zVDO volume existsc s t t| �j|f|�|� d S )N)r r* r )r r r r )r r! r" r R s z VDOServiceExistsError.__init__)r# r$ r% r& r' r r( r! r! )r r" r* L s r* c s( e Zd ZdZed�f� fdd� Z� ZS )�VDOMissingDeviceErrorz2VDO underlying device does not exist exception.
z Underlying device does not existc s t t| �j|f|�|� d S )N)r r+ r )r r r r )r r! r" r \ s z VDOMissingDeviceError.__init__)r# r$ r% r& r' r r( r! r! )r r" r+ V s r+ c s( e Zd ZdZed�f� fdd� Z� ZS )� VDOServicePreviousOperationErrorz3VDO volume previous operation was not completed.
z+VDO volume previous operation is incompletec s t t| �j|f|�|� d S )N)r r, r )r r r r )r r! r" r g s z)VDOServicePreviousOperationError.__init__)r# r$ r% r& r' r r( r! r! )r r" r, a s r, c s e Zd ZdZejd�ZdZdZe d�Z
e d�Z e d�Z e d�Z
e d �Ze d
�Ze d �Ze d �Ze d
�Ze d�Ze d�Ze d�Ze d�Ze d�Ze d�Ze d�Ze d�Ze d�ZdgZ ddddd d d d d d!d"d#� Z G d$d%� d%e �Z e d&d'� �Z!d(d)� Z"d�d+d,�Z#d-d.� Z$e%d/d0� �Z&e%d�d2d3��Z'd4d5� Z(d6d7� Z)d8d9� Z*d:d;� Z+e%d<d=� �Z,e%d>d?� �Z-e%d@dA� �Z.dBdC� Z/d�dEdF�Z0dGdH� Z1d�dIdJ�Z2d�dKdL�Z3d�dMdN�Z4dOdP� Z5dQdR� Z6dSdT� Z7dUdV� Z8dWdX� Z9e:dYdZ� �Z;e d[d\� �Z<e=� fd]d^��Z>� fd_d`�Z?e=� fdadb��Z@� fdcdd�ZA� fdedf�ZB� fdgdh�ZCe:didj� �ZDdkdl� ZEdmdn� ZFdodp� ZGdqdr� ZHdsdt� ZIdudv� ZJdwdx� ZKdydz� ZLd{d|� ZMd}d~� ZNdd�� ZOd�d�� ZPd�d�� ZQd�d�d��ZRd�d�� ZSd�d�� ZTd�d�� ZUd�d�� ZVd�d�� ZWd�d�� ZXd�d�� ZYd�d�� ZZd�d�� Z[d�d�� Z\d�d�� Z]d�d�� Z^d�d�� Z_d�d�� Z`d�d�� Zad�d�� Zbd�d�� Zcd�d�� Zdd�d�� Zed�d�� Zfd�d�� Zgd�d�� Zhd�d�d��Zid�d�� Zje%d�d�� �Zkd�d�� Zld�d�� Zmd�d�� Znd�d�� Zo� fd�dZpd�d�dĄZqd�dƄ Zrd�dȄ Zsd�dʄ Ztd�d̄ Zud�d΄ Zvd�dЄ Zwd�d�d҄Zxd�dԄ Zyd�dք Zzd�d Z{d�dڄ Z|� Z}S )��
VDOServicea� VDOService manages a vdo device mapper target on the local node.
Attributes:
ackThreads (int): Number of threads dedicated to performing I/O
operation acknowledgement calls.
activated (bool): If True, should be started by the `start` method.
bioRotationInterval (int): Number of I/O operations to enqueue for
one bio submission thread in a batch before moving on to enqueue for
the next.
bioThreads (int): Number of threads used to submit I/O operations to
the storage device.
blockMapCacheSize (sizeString): Memory allocated for block map pages.
blockMapPeriod (int): Block map period.
cpuThreads (int): Number of threads used for various CPU-intensive tasks
such as hashing.
device (path): The device used for storage for this VDO volume.
enableCompression (bool): If True, compression should be
enabled on this volume the next time the `start` method is run.
enableDeduplication (bool): If True, deduplication should be
enabled on this volume the next time the `start` method is run.
hashZoneThreads (int): Number of threads across which to subdivide parts
of VDO processing based on the hash value computed from the block data
indexCfreq (int): The Index checkpoint frequency.
indexMemory (str): The Index memory setting.
indexSparse (bool): If True, creates a sparse Index.
indexThreads (int): The Index thread count. If 0, use a thread per core
logicalSize (SizeString): The logical size of this VDO volume.
logicalThreads (int): Number of threads across which to subdivide parts
of the VDO processing based on logical block addresses.
maxDiscardSize (SizeString): the max discard size for this VDO volume.
physicalSize (SizeString): The physical size of this VDO volume.
physicalThreads (int): Number of threads across which to subdivide parts
of the VDO processing based on physical block addresses.
slabSize (SizeString): The size increment by which a VDO is grown. Using
a smaller size constrains the maximum physical size that can be
accomodated. Must be a power of two between 128M and 32G.
uuid (str): uuid of vdo volume.
writePolicy (str): sync, async, async-unsafe or auto.
z vdo.vdomgmnt.Service.VDOServicez !VDOServiceZVDOszAcknowledgement threadszBio submission threadszBio rotation intervalzBlock map cache sizezBlock map periodz
Block sizeZ CompressionzCPU-work threadsZ
DeduplicationzHash zone threadsz Logical sizezLogical threadszMax discard sizez
MD RAID5 modez
Physical sizezPhysical threadszVDO statisticsz Write policy�device�blockMapCacheSize�blockMapPeriod�maxDiscardSize�uuid�
ackThreads�bioRotationInterval�
bioThreads�
cpuThreads�hashZoneThreads�logicalThreads�physicalThreads) r/ r0 r1 r2 �
vdoAckThreads�vdoBioRotationInterval�
vdoBioThreads�
vdoCpuThreads�vdoHashZoneThreads�vdoLogicalThreads�vdoPhysicalThreadsc @ sT e Zd ZdZdZdZdZdZdZdZ eded ed
ed ed ede diZ
e d
d� �Z dS )zVDOService.OperationState� beginCreate�beginGrowLogical�beginGrowPhysical� beginImport�beginRunningSetWritePolicy�finished�unknown�createz grow logicalz
grow physical�importz write policyc C s | j | j| j| j| j| jgS )z�Return a list of the possible specific operation states.
"Specific operation state" means a state that is specifically set
via normal processing.
)rA rB rC rD rE rF )�clsr! r! r" �specificOperationStates� s z1VDOService.OperationState.specificOperationStatesN)
r# r$ r% rA rB rC rD rE rF rG �names� classmethodrK r! r! r! r" �OperationState� s rN c C sx x8| j D ].}t||d�dk rtd�j|�}t|td��qW t|dd�dk rt|jdkrt|jrttd�j|�}t|td��dS )z�Validates that any options specified in the arguments are solely
those which are modifiable.
Argument:
args - arguments passed from the user
Nz+Cannot change option {0} after VDO creation)�
exitStatusr2 � z8Cannot change uuid to a specific value when --all is set)� fixedOptions�getattrr' �formatr r r2 �all)rJ r �optionr r! r! r" �validateModifiableOptions� s z$VDOService.validateModifiableOptionsc C sd | j � | jr.td�j| j� �}| j|� dS | jtd�j| j� �� d| _| jj| j� | d� dS )zCMarks the VDO device as activated, updating the configuration.
z{0} already activatedNzActivating VDO {0}T)� _handlePreviousOperationFailure� activatedr' rS �getName� _announce�config�addVdo)r r r! r! r" �activate� s
zVDOService.activateTc C s^ | j � r(| jtd�j| j� | j� �� n2|rF| jtd�j| j� �� n| jsZ| jtd�� dS )z.Logs the VDO volume state during create/start.z'VDO instance {0} volume is ready at {1}zVDO volume created at {0}z,VDO volume cannot be started (not activated)N)�runningrZ r' rS �getInstanceNumber�getPathrX )r Z
wasCreatedr! r! r" �
announceReady s zVDOService.announceReadyc C sR | j td�j| j� �� | j� tdd| j� ddg� | j td�j| j� �� dS )zConnect to index.z Attempting to get {0} to connect�dmsetup�message�0z index-enablez{0} connect succeededN)rZ r' rS rY rW r )r r! r! r" �connect s
zVDOService.connectc C s� | j � | jtd�j| j� �� tj� }| j� rD| j� |j | j
� |j | j j
td�j| j� �� ttjd | jg�j� }|j d� |dkr�| jtj|d�� | jj| j� � dS )z�Convert the VDO device to be used by LVM. This will stop the VDO
device, run the conversion tool and then remove the entry from the
VDO config file.
zConverting VDO {0}z!Device {0} could not be convertedz/vdoprepareforlvmNrP z )rW rZ r' rS rY r � transactionr^ �stop� addUndoStage�start�
setMessage�log�errorr r ZconversionUtilityDirr. �strip�textwrap�indentr[ � removeVdo)r rf �outputr! r! r" �convert" s
zVDOService.convertFc C s� | j td�j| j� �� | jjdj| jj�� | j� | j � | j
� | j | j � | j
� | j| j� | j| jj� tj� }|j| jj� |jtj| jj| j� �� | j|� | j| j � | j � | j| jj � dS )z Creates and starts a VDO target.zCreating VDO {0}zconfFile is {0}N) rZ r' rS rY rk �debugr[ �filepathrW �_checkForExistingVDO�_validateParameters�_checkForExistingUUIDr2 �_setStableName�_installKernelModule� vdoLogLevel�_setOperationStaterN rA r rf rh �persist� functools�partialrp �_constructVdoFormat�_setUUID�_constructServiceStartrF )r �forcerf r! r! r" rH > s"
zVDOService.createc C sd | j � | js.td�j| j� �}| j|� dS | jtd�j| j� �� d| _| jj| j� | d� dS )zGMarks the VDO device as not activated, updating the configuration.
z{0} already deactivatedNzDeactivating VDO {0}FT)rW rX r' rS rY rZ r[ r\ )r r r! r! r" �
deactivateh s
zVDOService.deactivatec C s� | j � yDt� j� }|d kr4tdd| j� ddg� ntdd| j� ddg� W n0 tk
r| | jjtd �j | j� �� � Y nX d
S ) z*Disables deduplication on this VDO device.� � r rb rc rd z index-closez
index-disablez$Cannot stop deduplication on VDO {0}N)r� r� r )
rW r Z
targetVersionr rY � Exceptionrk rl r' rS )r �versionr! r! r" �
disconnectw s
zVDOService.disconnectc C s& | j � | j r | j� r | j� | jS )z9Returns the instance number of a vdo if running, or zero.)rW �instanceNumberr^ �_determineInstanceNumber)r r! r! r" r_ � s z VDOService.getInstanceNumberc C s t jjd| j� �S )z)Returns the full path to this VDO device.z /dev/mapper)�os�path�joinrY )r r! r! r" r` � s zVDOService.getPathc C st | j � | j� s.td�j| j� �}t|td��|j� || jk r^td�j| j�}t|t d��n&|| jkr�td�jt
j �}t|t d��| j | j
j� | jjtd�j| j� �� |j� }| jt|�d�}tj� }|j| jjtd�j| j� �� tdd | jd
|g� |jd � | jd � | j� | j � }|d
|d t
j }t dj|��| _| jjtd�j| j� �� | j | j
j � d S )zpGrows the logical size of this VDO volume.
Arguments:
newLogicalSize (SizeString): The new size.
z VDO volume {0} must be running)rO z(Can't shrink a VDO volume (old size {0})z.Can't grow a VDO volume by less than {0} bytesz)Increasing logical size of VDO volume {0})�
numSectorsz Device {0} could not be changedrb �reloadz--tableNF�
logicalBlocks� blockSizez{0}sz(Increased logical size of VDO volume {0}) rW r^ r' rS rY r r � roundToBlock� logicalSizer r �VDO_BLOCK_SIZEr{ rN rB rk �info� toSectors�_generateModifiedDmTable�strr rf rj rl r �_name�_suspend�_resume�_getVDOConfigFromVDO� SECTOR_SIZEr
rF )r ZnewLogicalSizer r� �vdoConfrf � vdoConfigr� r! r! r" � growLogical� sB
zVDOService.growLogicalc C s� | j � | j� s.td�j| j� �}t|td��| j| j�}|j � || j
k rjtd�j| j
�}t|t d��n&|| j
kr�td�jt j
�}t|t d��| j| jj� | jjtd�j| j� �� | jt|j� �d�}tj� }|j| jjtd�j| j� �� tdd | jd
|g� |jd � | j d � | j � | j � }|d
t j }|d | }t dj|��| _
| jjtd�j| j� �� | j| jj!� d S )z�Grows the physical size of this VDO volume.
Arguments:
newPhysicalSize (SizeString): The new size. If None, use all the
remaining free space in the volume
group.
z VDO volume {0} must be running)rO z(Can't shrink a VDO volume (old size {0})z.Can't grow a VDO volume by less than {0} bytesz*Increasing physical size of VDO volume {0})Z storageSizez Device {0} could not be changedrb r� z--tableNFr� �physicalBlocksz{0}sz)Increased physical size of VDO volume {0})"rW r^ r' rS rY r r �_getDeviceSizer. r� � physicalSizer r r� r{ rN rC rk r� r� r� �toBlocksr rf rj rl r r� r� r� r� r� r
rF )r r ZnewPhysicalSizer� rf r� �sectorsPerBlockr� r! r! r" � growPhysical� sD
zVDOService.growPhysicalc C sn | j td�j| j� �� | jjdj| jj�� | j� | j � }|d }|d t
j }|d | }t dj|��| _
|d | }t dj|��| _|d | _|d }|d
| _|d | _|d | _| j}|d
| _|dk r�|| _| j� | j� | j| j� | j� | j| j� | j| jj � t j � }|j | jj � |j t!j"| jj#| j� �� | j$| j� | j%� | j| jj&� dS )z Imports and starts a VDO target.zImporting VDO {0}zconfFile is {0}� VDOConfigr� r� z{0}sr� �slabSize� IndexConfig�memory�sparse�checkpointFrequency�UUIDN)'rZ r' rS rY rk rs r[ rt rW �_getConfigFromVDOr r� r
r� r� r� �indexMem� indexSparse�
indexCfreqr2 ru rv rw rx ry rz r{ rN rD r rf rh r| r} r~ rp r� r� rF ) r r[ r� r� r� r� � indexConfigr2 rf r! r! r" � importDevice s@
zVDOService.importDevicec C sX | j � ytdd| j� ddg� W n0 tk
rR | jjtd�j| j� �� � Y nX dS )z)Enables deduplication on this VDO device.rb rc rd z index-enablez%Cannot start deduplication on VDO {0}N)rW r rY r� rk rl r' rS )r r! r! r" � reconnectF s zVDOService.reconnectNc C s� | j td�j| j� �� ytj| j� W n0 tk
rX |sTtd�j| j�}t|��Y nX g }y | j ||� |sx| j
� W nV t k
r� |dk r�t |�dkr�|j
td�j| j� �� |jdd� |D �� � Y nX | jj| j� � | j� s�| j� dS )a% Removes a VDO target.
If removeSteps is not None it as an empty list to which the processing
commands for removal will be appended.
If force was not specified and the instance previous operation failure
is not recoverable VDOServicePreviousOperationError will be raised.
zRemoving VDO {0}z.Device {0} not found. Remove VDO with --force.Nr zSteps to clean up VDO {0}:c S s g | ]}d j |��qS )z {0})rS )�.0�sr! r! r" �
<listcomp>t s z%VDOService.remove.<locals>.<listcomp>)rZ r' rS rY r� �statr. �OSErrorr+ rg rW r, �len�append�extendr[ rp � _hasHolders�_clearMetadata)r r� � removeStepsr ZlocalRemoveStepsr! r! r" �removeR s, zVDOService.removec C s> y$t dddtj| j� g�}|j� dkS tk
r8 dS X dS )z-Returns True if the VDO service is available.rb �statusz--targetrP FN)r r �
vdoTargetNamerY rm r� )r �resultr! r! r" r^ � s zVDOService.runningc ! C s� | j td�j| j� �� | j� | jsD| jjtd�j| j� �� dS | j� rtt j
� rt| jj td�j| j� �� dS | j | j
� | j� | j� �y|r�y | j� W n0 tk
r� | jjtd�j| j� �� � Y nX tdd| jd| j� d | j� g� | j�s"y | j� W n tk
�r Y nX | j� | j�rP| jjtd
�j| j� | j�� y| j�rb| j � W n2 tk
�r� | jjtd �j| j� �� � Y nX | j � W n2 tk
�r� | jjtd �j| j� �� � Y nX dS )
z�Starts the VDO target mapper. In noRun mode, we always assume
the service is not yet running.
Raises:
ServiceError
zStarting VDO {0}z VDO service {0} not activatedNz0VDO service {0} already started; no changes madezDevice {0} not read-onlyrb rH z--uuidz--tablez$started VDO service {0} instance {1}z$Could not enable compression for {0}z&Could not set up device mapper for {0}) rZ r' rS rY rW rX rk r� r^ r � noRunMode�warning�_validateAvailableMemory� indexMemoryry �_checkConfiguration�
_forceRebuildr� rl r r� �_getUUID�_generateDeviceMapperTable�enableDeduplicationr� r� r� �enableCompression�_startCompression�_startFullnessMonitoring)r Z forceRebuildr! r! r" ri � sV zVDOService.startc
C s | j � | j� }d|d }|d }|d tj }tdj|d | ��}tdj|d | ��}tdj|d tj ��}|d
} | j| d �}
i } tj| | j< tj | j
�| t d �< tj | j �| | j
< tj | j�| | j< t|�| | j< t|�| | j< t|�| t d
�< || t d�< | d | t d�< |
| t d�< | j| t d�< tj | d �| t d�< | j� | t d�< | j� �r�| j| � |�r�| j| � n
| j| � tj� dk�rtj dd| j � g�| t d�< y&t dd| j � g�} t j!| �| | j"< W n$ t#k
�r t d�| | j"< Y nX | S ) zAReturns a dictionary representing the status of this object.
zVDO-r� r� r� z{0}sr� r� z{0}Br� r� r� ZActivatez Slab sizer� zIndex checkpoint frequencyzIndex memory settingzIndex parallel factorr� z Index sparsez Index statusr rb r� zDevice mapper statusZvdostatsz --verbosez
not available)$rW r� r r� r
rS r� �_getIndexMemory�vdoBlockSizeKey� enableStringrX r' r� �vdoCompressionEnabledKeyr� �vdoDeduplicationEnabledKeyr� �vdoLogicalSizeKey�vdoPhysicalSizeKey� indexThreads�_getDeduplicationStatusr^ �_getStatusFromDmsetupTable�_getPendingChanges�_getStatusFromConfigr� �getuidr
Z statusHelperrY r r` �yaml� safe_load�vdoStatisticsKeyr� )
r �pendingr[ r2 r� r� r� r� r� r� r� r� r� r! r! r" r� � sZ
zVDOService.statusc
C sd | j td�j| j� �� |}|sFy| j� d}W n tk
rD Y nX |r�| j� r�tj� r�| j r�| j
j td�j| j� �� dS | j� }|r�| j � r�td�j| j� �}t
|td��|r�| j� s�| �r(dd| j� g}|dk r�|jd j|�� |�r(|�r
t|dd
� n td �j| j� �}t
|td��d d
g}|dk �rJ|jd j|�� |�rb|�rbt|dd
� |�rt| j||� dd| j� g}|dk �r�|jd j|�� d}|�r|�rxbtd�D ]V}y t|� dS tk
�r� } zdt| �k�r�d}P W Y dd} ~ X nX tjd� �q�W |�s | j� | j� �r`|�rBtd�j| j� �}ntd�j| j� �}t
|td��dS )a� Stops the VDO target mapper. In noRun mode, assumes the service
is already running.
If removeSteps is not None it is a list to which the processing
commands will be appended.
If force was not specified and the instance previous operation failed
VDOServicePreviousOperationError will be raised.
Raises:
ServiceError
VDOServicePreviousOperationError
zStopping VDO {0}Tz VDO service {0} already stoppedNz"cannot stop VDO volume {0}: in use)rO Zumountz-f� )�noThrowz&cannot stop VDO volume with mounts {0}ZudevadmZsettlerb r� �
zDevice or resource busyFr z*cannot stop VDO service {0}: device in usezcannot stop VDO service {0}) rZ r' rS rY rW r, r^ r r� �previousOperationFailurerk r� r� r r �
_hasMountsr` r� r� r �_stopFullnessMonitoring�ranger� r� �time�sleep�)_generatePreviousOperationFailureResponser )
r r� r� �executer^ r �commandZinUseZunused_i�exr! r! r" rg sr
zVDOService.stopc C s� |r | j dj| j� d�� n| j dj| j� d�� | j� |rD| jsR| r�| j r�dj|r^dnd�}| jjt|�| j� � dS || _| jj | j� | d� | jr�| j
� n| j � dS ) zoChanges the compression setting on a VDO. If the VDO is running
the setting takes effect immediately.
z"Enabling compression on vdo {name})�namez#Disabling compression on vdo {name}z compression already {0} on VDO �enabled�disabledNT) rZ rS rY rW r� rk r� r' r[ r\ r� �_stopCompression)r �enablerc r! r! r" �setCompressionz s"
zVDOService.setCompressionc C s || _ d| _dS )a3 Sets the configuration reference and other attributes dependent on
the configuration.
This method must tolerate the possibility that the configuration is None
to handle instantiation from YAML representation. At present, there is
nothing for which we attempt to use the configuration.
FN)�_config�_configUpgraded)r r[ r! r! r" � setConfig� s zVDOService.setConfigc C sz |r | j dj| j� d�� n| j dj| j� d�� | j� |rD| jsR| r�| j r�dj|r^dnd�}| jjt|�| j� � dS || _| jj | j� | d� | j
� �rv| j�rn| j � d}x2t t
j�D ]$}| j� }|t
jkr�tjd � q�P q�W |t
jkr�nt|t
jk�r ttd
�j| j� �td ��nL|t
jk�rLtd �j| j� �}| jj|� n td
�j|| j� �}t|td ��n| j� dS )zqChanges the deduplication setting on a VDO. If the VDO is running
the setting takes effect immediately.
z$Enabling deduplication on vdo {name})r� z%Disabling deduplication on vdo {name}z!deduplication already {0} on VDO r� r� NTr z$Error enabling deduplication for {0})rO z2Timeout enabling deduplication for {0}, continuingz;Unexpected kernel status {0} enabling deduplication for {0})rZ rS rY rW r� rk r� r' r[ r\ r^ r� r� r ZDEDUPLICATION_TIMEOUTr� ZdeduplicationStatusOpeningr� r� ZdeduplicationStatusOnlineZdeduplicationStatusErrorr r �warnr� )r r� rc r� Z_ir! r! r" �setDeduplication� sJ
zVDOService.setDeduplicationc C sD | j � | jt|d| j�t|d| j�t|d| j�� d}x�| jD ]�}t||d�}|dk r@|dkr�| j� r~| jdj | j
� �� q@y| j |� | j |� W n: t
k
r� } z | jdj | j
� |�� w@W Y dd}~X nX t| | j| |� d }q@t| | j| |� d }q@W |�r@| jj| j
� | d � | j� �r@| jtd
�j | j
� �� dS ) z�Sets any of the modifiable options that are specified in the arguments.
Argument:
args - arguments passed from the user
Raises:
ArgumentError
r> r? r@ FNr2 zBCan't modify uuid on VDO {0} while it is running. Skipping change.z3Can't modify uuid on VDO {0}. Skipping change: {1}.Tz7Note: Changes will not apply until VDO {0} is restarted)rW � _validateModifiableThreadCountsrR r7 r8 r9 �modifiableOptionsr^ rZ rS rY rw r� r �setattrr[ r\ r' )r r ZmodifiedrU �valuer� r! r! r" �setModifiableOptions� sB
z VDOService.setModifiableOptionsc C s^ | j � || jkrZ|| _| j� s6| jj| j� | d� n$| j| jj� | j � | j| jj
� dS )zaChanges the write policy on a VDO. If the VDO is running it is
restarted with the new policyTN) rW � writePolicyr^ r[ r\ rY r{ rN rE � _performRunningSetWritePolicyrF )r Zpolicyr! r! r" �setWritePolicy s
zVDOService.setWritePolicyc C s6 ddddddddd d
d d d
ddddddddddddgS )z8Returns the list of standard attributes for this object.r3 rX r4 r5 r/ r0 r6 � compression�
deduplicationr. r7 r� r� r� r� �logicalBlockSizer� r8 r1 �_operationStater� r9 r� r2 r� r! r! r! r! r" �getKeys# s2 zVDOService.getKeysc C s
| dd �S )NZ YAMLInstancer! )rJ r! r! r" �_yamlMakeInstanceA s z VDOService._yamlMakeInstancec s� t t| �j}tj| j�|d< t| j�|d< tj| j�|d< tj| j �|d< tj| j
�|d< t| j �|d< t| j �|d< t| j
�|d< t| j�|d < | j|d
< |S ) NrX r/ r r r� r� r1 r� r� r� )r r- � _yamlDatar r� rX r� r/ r� r� r� r� r1 r� r� r� )r �data)r r! r" r F s
zVDOService._yamlDatac s" t t| �j|� | j|dtj| j��tjk| _t| j|dt | j
���| _
| j|dtj| j ��tjk| _ | j|dtj| j ��tjk| _ | j|dtj| j
��tjk| _
t| j|dt | j���| _t| j|dt | j���| _t| j|dt | j���| _t| j|d t | j���| _d
|k�r |d
| _d S ) NrX r/ r r r� r� r1 r� r� r� )r r- �_yamlSetAttributes�_defaultIfNoner r� rX r� r
r� r/ r� r� r� r� r1 r� r� r� )r Z
attributes)r r! r" r V s<
z VDOService._yamlSetAttributesc s. t t| �j}|jddddddddd d
g
� |S ) NrX r/ r r r� r� r1 r� r� r� )r r- � _yamlSpeciallyHandledAttributesr� )r Zspecials)r r! r" r � s z*VDOService._yamlSpeciallyHandledAttributesc s� |dkr| j � S |dkr | j� S |dkr0| j� S |dkr@| j� S |dkrXtt| �j|�S |dkrh| j� S |dkrx| j� S t dj
t | �j |d ���d S )
Nr[ �
isConstructed�operationStater� r� Z%unrecoverablePreviousOperationFailurer� z('{obj}' object has no attribute '{attr}')�obj�attr)
�_computedConfig�_computedIsConstructed�_computedOperationState�!_computedPreviousOperationFailurer r- � __getattr__�._computedUnrecoverablePreviousOperationFailure�_computedWritePolicy�AttributeErrorrS �typer# )r r� )r r! r" r � s zVDOService.__getattr__c s, t t| �j|� | j|� | jj| _d | _|jd�| _ | j
|dt j �| _ | j
|dt j
�| _
| j
|dt j�| _| j
|dt j�| _| j
|dt j�| _| j
|dt j�| _tj| _| j
|dt j�}|tjkr�d | _| j
|d
t j�}|tjk| _| j
|d t j�}|tjk| _| j
|d t j�}|tjk| _ | j
|d
t j �| _ |jdt d��| _ | j
|dt j �| _ | j
|dt j!�| _!t j"| _"t d�| _#| j
|dt j$�| _$| j
|dt j%�| _%| j
|dt j&�| _'d| _(d| _)|jd�| _*|jd�| _+| j
|dt j,�| _-| j.| j
|dt j/�� | j
|dt j0�}|tjk| _1| j
|d t j2�| _3d S ) Nr. r: r; r< r/ r0 r= �
emulate512i r r r] r> ZvdoLogicalSizerd r? r1 r@ Z vdoSlabSizer� Fr rz r2 �cfreqr� � sparseIndex�udsParallelFactor)4r r- r r� rN rG r �_previousOperationFailure�getr. r
r r3 r4 r5 r/ r0 r6 r r� r r r� r r� r r� r] rX r7 r
r� r8 r1 � mdRaid5Moder� r9 r� r� � _writePolicy�_writePolicySetr� rz r2 r r� �_setMemoryAttrr� r r� r r� ) r r� Zconf�kwr r r r] r� )r r! r" r � sp
zVDOService.__init__c s` |dkr| j |� n2|dkr*|| _d| _n |dkr4ntt| �j||� |dkr\t| |�j� d S ) Nr� r� TZ
identifierr1 r� r� )r1 r� r� )r" r r! r r- � __setattr__rR r� )r r� r� )r r! r" r$ � s zVDOService.__setattr__c C s | j |�}|d kr|S |S )N)r )r r� �defaultr� r! r! r" r
s
zVDOService._defaultIfNonec C s | j j|� t|� d S )N)rk r� �print)r rc r! r! r" rZ s zVDOService._announcec C sZ | j j� }|d| j k r6td�j| j� �}t|td��t| j t
j �| _ t | j t
j
�| _ dS )zQCheck and fix the configuration of this VDO.
Raises:
ServiceError
r� i z$Insufficient block map cache for {0})rO Ni )r/ r� r8 r' rS rY r r �maxr0 r ZblockMapPeriodMin�minZblockMapPeriodMax)r �
cachePagesr r! r! r" r� s
z VDOService._checkConfigurationc
C s� |dks|dkrdS dddt jg}dd� t|dd �j� D �}td
d� |D ��}|td d� | jj� j� D ��O }t|�}g }xF|D ]>}y,t j
td |g��}||d
kr�|j |� W q� Y q�X q�W t |�dkr�dj
|�}td�j||�} t| td��dS )z� Checks that the device does not have an already existing UUID.
Arguments:
uuid (str) - the uuid to check for
Raises: VDOServiceError
NrP rb �tablez--targetc S s g | ]}|d kr|�qS )zNo devices foundr! )r� �liner! r! r" r� < s z4VDOService._checkForExistingUUID.<locals>.<listcomp>T)r� c S s g | ]}|j d �d �qS )r� � )�split)r� r* r! r! r" r� > s c S s g | ]
}|j �qS r! )r. )r� �vdor! r! r" r� @ s �
vdodumpconfigr� r z, z6UUID {0} already exists in VDO volume(s) stored on {1})rO )r r� r �
splitlines�setr[ Z
getAllVdos�values�listr� r� r� r� r� r' rS r r )
r r2 �cmdZ vdoTablesZvdosZ conflictVdosr. r[ Z conflictListr r! r! r" rw + s(
z VDOService._checkForExistingUUIDc C sp | j r td�j| j� �}t|��| jj| j�rFtd�j| j�}t|��| j � rltd�j| j� �}t
|t d��dS )z�Check to see if there is an existing VDO volume running with the
same name as this VDO, or it already exists in this config file
Raises:
VDOServiceExistsError VDODeviceAlreadyConfiguredError
z VDO volume {0} already existsz)Device {0} already configured for VDO usez2Name conflict with extant device mapper target {0})rO N) r r' rS rY r* r[ ZisDeviceConfiguredr. r) �_mapperDeviceExistsr r )r r r! r! r" ru R s
z VDOService._checkForExistingVDOc C s� y6t j| j�j}tj|�s4| jjdj| jd�� dS W n8 tk
rn } z | jjdj| j|d�� dS d}~X nX dddj| jd�d d
d g}t |� dS ) z.Clear the VDO metadata from the storage devicez-Not clearing {devicePath}, not a block device)�
devicePathNz,Not clearing {devicePath}, cannot stat: {ex})r6 r� Zddz if=/dev/zerozof={devicePath}z oflag=directzbs=4096zcount=1)
r� r� r. �st_mode�S_ISBLKrk rs rS r� r )r �moder� r� r! r! r" r� j s"
zVDOService._clearMetadatac C sl ddl m} | jsfd}y| jj| j� �}W n tk
r> Y n"X |j| jj kr`|j
| jj dd� d| _| jS )z[Update the instance properties as necessary and return the
configuration instance.
r )�
ConfigurationNF)r| T) rP r: r� r� �getVdorY r r rN rG r{ rF )r r: �servicer! r! r" r s
zVDOService._computedConfigc C s | j | jjkS )zYReturns a boolean indicating if the instance represents a fully
constructed vdo.
)r
rN rF )r r! r! r" r � s z!VDOService._computedIsConstructedc C s4 | }y| j j| j� �}W n tk
r, Y nX |jS )z�Return the operation state of the instance.
If there is an instance in the configuration the state reported is from
that instance else it's from this instance.
)r[ r; rY r r )r r< r! r! r" r � s z"VDOService._computedOperationStatec C s. | j dkr(| j| jjko$| j| jjk| _ | j S )zCReturns a boolean indicating if the instance operation failed.
N)r r
rN rG rF )r r! r! r" r � s
z,VDOService._computedPreviousOperationFailurec C s | j o| j| jj| jjgkS )zhReturns a boolean indicating if a previous operation failure cannot be
automatically recovered.
)r� r
rN rA rD )r r! r! r" r � s
z9VDOService._computedUnrecoverablePreviousOperationFailurec C s: | }| j s4y| jj| j� �}W n tk
r2 Y nX |jS )z�Return the write policy of the instance.
If this instance's write policy was not explicitly set and there is an
instance in the configuration the write policy reported is from that
instance else it's from this instance.
)r! r[ r; rY r r )r r< r! r! r" r � s z VDOService._computedWritePolicyc C s | j j� }ttj|d�d �S )zCCompute the --slab-bits parameter value for the slabSize attribute.r� g�������?)r� r� �int�mathrk )r Zblocksr! r! r" �_computeSlabBits� s
zVDOService._computeSlabBitsc C s6 | j jdj| j� �� tj� }| j� |j| j� d S )Nz construction - starting; vdo {0}) rk rs rS rY r rf ri rh rg )r rf r! r! r" r� � s z!VDOService._constructServiceStartc C s� | j jdj| j� �� tj� }| j|� |j| j� | j � }|d t
j }|d | }t dj|��| _
|d | }t dj|��| _d S )Nz1construction - formatting logical volume; vdo {0}r� r� z{0}sr� )rk rs rS rY r rf �
_formatTargetrh r� r� r r� r
r� r� )r r� rf r� r� r� r� r! r! r" r � s
z VDOService._constructVdoFormatc C s~ dj | j� �}y,t|d��}t|j� j� �| _W dQ R X W n> tk
rx } z"| jj t
d�j | j� |�� W Y dd}~X nX dS )z;Determine the instance number of a running VDO using sysfs.z/sys/kvdo/{0}/instance�rNz8unable to determine VDO service {0} instance number: {1}) rS rY �openr= �readrm r� r� rk r� r' )r r� �f�errr! r! r" r� s z#VDOService._determineInstanceNumberc C s t d| jg� dS )zaCalls vdoforcerebuild to exit read-only mode and force a metadata
rebuild at next start.
ZvdoforcerebuildN)r r. )r r! r! r" r� s zVDOService._forceRebuildc C s> dg}|j dt| j� � | j}|dkr.tj}| js<tj| _|j dt|� � | jr^|j d� | jj � dkr�|j d| jj
� � | jtjkr�|j dt| j � � � |r�|j d � |j | j � y&t
|�j� }|r�| jtj|d
�� W nV tk
�r8 } z8|j� j� }tjd |�}|d k �r$t|td
��|�W Y d d }~X nX d S )zFormats the VDO target.Z vdoformatz--uds-checkpoint-frequency=g z--uds-memory-size=z --uds-sparser z--logical-size=z --slab-bits=z--forcez z.*Cannot format deviceN)rO )r� r� r� r� r r� r� r� r� �toBytesZ asLvmTextr? r. r �rstriprZ rn ro r ZgetStandardError�re�matchr r )r r� Z commandLine�memValrq �erl ZdetectionMatchr! r! r" r@ s6
zVDOService._formatTargetc C s� | j j� }| jj� }| jj� }djdt| j�dt| j�dt| j �dt| j
�dt| j �dt| j �dt| j
�g�}d t|�tjd
| jt| j� d �t| j�t|�t| j�| j| j| jd t|�|g}| js�|jd
dg� dj|�}|S )zRGenerate the device mapper table line from the properties of this
object.
r� �ack�bior4 �cpu�hash�logical�physicalrd ZV2r� �
maxDiscardr �off)r� r� r/ r� r1 r� r� r3 r5 r4 r6 r7 r8 r9 r r� r. r� r r0 r r� r� r� r� )r r� r) ZmaxDiscardBlocksZthreadCountConfigZ argumentsr� r! r! r" r� = s0
z%VDOService._generateDeviceMapperTablec s� t dd| jg�j� }| jj|� d }|jd�}|jd�}tt||��� x t|j � �D ]\}}|� |< qTW dj
� fdd�|D �|t � �d � �S ) z�Changes the specified parameters in the dmsetup table to the specified
values.
Raises:
CommandError if the current table cannot be obtained
Returns:
a valid new dmsetup table.
rb r* z6logicalStart numSectors targetName version storagePathz1 storageSize blockSize cacheBlocks blockMapPeriodz! mdRaid5Mode writePolicy poolNamer� c s g | ] }� | �qS r! r! )r� �key)�dmTabler! r" r� x s z7VDOService._generateModifiedDmTable.<locals>.<listcomp>NzglogicalStart numSectors targetName version storagePath storageSize blockSize cacheBlocks blockMapPeriodz�logicalStart numSectors targetName version storagePath storageSize blockSize cacheBlocks blockMapPeriod mdRaid5Mode writePolicy poolName) r r� rG rk r� r- �dict�zipr3 �itemsr� r� )r r r* �
tableOrderZtableOrderItems�
tableItemsrT �valr! )rU r" r� [ s
z#VDOService._generateModifiedDmTablec C s, t d�j| j� | jj| j d�}t|��dS )ah Generates the required response to a previous operation failure.
Logs a message indicating that the previous operation failed and raises the
VDOServicePreviousOperationError exception with the same message.
Arguments:
operation (str) - the operation that failed; default to "create".
Raises:
VDOServicePreviousOperationError
z8VDO volume {0} previous operation ({1}) is incomplete{2}z(; recover by performing 'remove --force'N)r' rS rY rN rL r
r, )r r r! r! r" r� | s
z4VDOService._generatePreviousOperationFailureResponsec C s� | j s$| jjtd�j| j� �� dS | j| jj� krXtd�j| j� | j�}t |t
d��n�| j| jj krp| j � n|| j| jj
kr�| j� nd| j| jjkr�| j� nL| j| jjkr�| j � n4| j| jjkr�| j� n td�j| j�}t |t
d��d| _dS )aB Handles a previous operation failure.
If the failure can be corrected automatically it is.
If not, the method logs a message indicating that the previous operation
failed and raises the VDOServicePreviousOperationError exception with
the same message.
Raises:
VDOServicePreviousOperationError if the previous operation failure
is a non-recoverable error.
VDOServiceError if unexpected/unhandled operation state is
encountered. Excepting corruption or incorrect setting of state this
indicates that the developer augmented the code with an operation (new or
old) which can experience a catastrophic failure requiring some form of
recovery but failed to update specificOperationStates() and/or failed to
add a clause to this method to address the new failure.
z0No failure requiring recovery for VDO volume {0}Nz.VDO volume {0} in unknown operation state: {1})rO z5Missing handler for recover from operation state: {0}F)r� rk rs r' rS rY r
rN rK r r rA r� rB �_recoverGrowLogicalrC �_recoverGrowPhysicalrD rE � _recoverRunningSetWritePolicyr )r r r! r! r" rW � s0
z*VDOService._handlePreviousOperationFailurec C sr |}t j|t j�s&ttd�j|d���tjt j|�j �rRt
dd|g�}|j � j � }|dkrnttd�j|d���|S )z�Take the server name and convert it to a device name that
can be opened from the kernel
Arguments:
devicePath (path): path to a device.
Raises:
ArgumentError
z{path} does not exist)r� �readlinkz-frP z {path} could not be resolved)
r� �access�F_OKr r' rS r� �S_ISLNK�lstatr7 r Zrunrm )r r6 Z resolvedPathr4 r! r! r" �_getBaseDevice� s
zVDOService._getBaseDevicec C s t jtd| jg��}|S )zbReturns a dictionary of the configuration values as reported from
the actual vdo storage.
r/ )r� r� r r. )r r[ r! r! r" r� � s z VDOService._getConfigFromVDOc C s t jtd| jg��}|d S )ztReturns a dictionary of the index configuration values as reported
by the actual uds index used by the vdo.
r/ r� )r� r� r r. )r r[ r! r! r" �_getIndexConfigFromVDO� s z!VDOService._getIndexConfigFromVDOc C s t jtd| jg��}d|d S )z>Returns the uuid as reported from the actual vdo storage.
r/ zVDO-r� )r� r� r r. )r r[ r! r! r" r� � s zVDOService._getUUIDc C s t jtd| jg��}|d S )zbReturns a dictionary of the configuration values as reported from
the actual vdo storage.
r/ r� )r� r� r r. )r r[ r! r! r" r� � s z VDOService._getVDOConfigFromVDOc C sN t d�}y,tdd| j� g�}|jd�}|tjj }W n tk
rH Y nX |S )Nz
not availablerb r� r� )r' r rY r- r ZdmsetupStatusFieldsZdeduplicationStatusr� )r r� rq Zfieldsr! r! r" r� � s
z"VDOService._getDeduplicationStatusc C s8 | j |�}tjj|�}tdd| d g�}tdj|��S )z�Get the size of the device passed in.
Arguments:
devicePath (path): path to a device.
Returns:
Size of device as a SizeString object
�catz/sys/class/block/z/sizez{0}s)rd r� r� �basenamer r
rS )r r6 ZbasePathZbaseNamerq r! r! r" r� s
zVDOService._getDeviceSizec C sf y t ddddd|g�j� }W n4 tk
rP } z| jjdt|� � dS d}~X nX |dkr^dS |S dS ) z�Get the UUID of the device passed in,
Arguments:
devicePath (path): path to a device.
Returns:
UUID as a string, or None if none found
Zblkidz-sr� z-or� zblkid failed: NrP )r rm r rk r� r� )r r6 rq r� r! r! r" �_getDeviceUUID s zVDOService._getDeviceUUIDc C s8 |dks4d }|| }|d
kr"d}n|d kr0d}nd}|S ) z�Takes the input indexMemory value from vdodumpconfig and
converts it into a fractional Gigabyte value, if necessary.
Returns:
The index memory value (in Gigabytes).
i r� � � g �?i g �?g �?l i ���i ���r! )r rJ ZmaxInt32r! r! r" r� - s zVDOService._getIndexMemoryc C s� | j � }tdj|d tj ��}td�|| j< td�|| j< td�|| j< td�|| j < td�|| j
< td�|| j < td�|| j < td�|| j
< |d |td�< tj|d dk�|td�< t|�|| j< |d || j< |d
|td �< d |k�rtdj|d tj ��}t|�|| j< d
|k�r.|d
|| j< d|k�rF|d || j< d|k�r^|d || j < d|k�rv|d || j
< d|k�r�|d || j < d|k�r�|d || j < d|k�r�|d || j
< dS )zlUpdates the input status dictionary with parameter values from
the dmsetup table for the running device.z{0}BZ cacheBlocksz non-existentZ storagePathzStorage devicer� i zEmulate 512 byter0 r� zConfigured write policyrR rL rM r4 rN rO rP rQ N)�_getCurrentDmTabler
rS r r� r' �vdoMaxDiscardSizeKey�vdoAckThreadsKey�vdoBioSubmitThreadsKey�vdoBioRotationIntervalKey�vdoCpuThreadsKey�vdoHashZoneThreadsKey�vdoLogicalThreadsKey�vdoPhysicalThreadsKeyr� r� �vdoBlockMapCacheSizeKey�vdoBlockMapPeriodKey)r �
statusDictrU ZcacheBlocksInBytesZdiscardBlocksInBytesr! r! r" r� D sJ
z%VDOService._getStatusFromDmsetupTablec C s� | j |td�< tj| jdk�|td�< t| j�|| j< | j|| j < | j
|td�< t| j �|| j < | j
|| j< | j|| j< | j|| j< | j|| j< | j|| j< | j|| j< | j|| j< dS )zcUpdates the input status dictionary with parameter values from
the config file for this object.zStorage devicei zEmulate 512 bytezConfigured write policyN)r. r' r r� r r� r/ rt r0 ru r� r1 rl r3 rm r5 rn r4 ro r6 rp r7 rq r8 rr r9 rs )r rv r! r! r" r� v s z VDOService._getStatusFromConfigc C s� t dd| jg�j� }| jj|� d}|jd�}|jd�}|t|�d� }|dt|�� }|j|ddd � � |j|d
dd � � d d � |D �}tt ||��}|S )z�Obtains the dmsetup table for the VDO device.
Raises:
CommandError if the current table cannot be obtained.
Returns:
The current dmsetup table.
rb r* z*logicalStart numSectors targetName versionz. storagePath storageSize blockSize cacheBlocksz0 blockMapPeriod mdRaid5Mode writePolicy poolNamer� Nr r� r c S s g | ]}|j � rt|�n|�qS r! )� isdecimalr= )r� �ir! r! r" r� � s z1VDOService._getCurrentDmTable.<locals>.<listcomp>zXlogicalStart numSectors targetName version storagePath storageSize blockSize cacheBlocksz�logicalStart numSectors targetName version storagePath storageSize blockSize cacheBlocks blockMapPeriod mdRaid5Mode writePolicy poolName)
r r� rG rk r� r- r� r� rV rW )r r* rY rZ ZtableOptionalItemsrU r! r! r" rk � s
z VDOService._getCurrentDmTablec C s� | j | j| j| j| j| j| j| j| j| j d�
}x|| j
D ]r}||krDq6|| |krRq6t | | j
| d�}t ||| �}|dk r6t |�|kr6dj
dt |��}|| ||| < q6W dS )zrUpdates the input status dictionary with pending changes to modifiable
parameters for the running device.
)
r/ r0 r1 r: r; r< r= r> r? r@ Nz{0}[{1}]z )rt ru rl rm ro rn rp rq rr rs r� rR r� rS )r rv ZoptionToStatusKeysrU Z configValueZ statusValueZ pendingValuer! r! r" r� � s(
z VDOService._getPendingChangesc
C s� y*t j| j� �}t j|j�}t j|j�}W n tk
r> dS X dj||d�}t jj |�r�t j
|�}t |�dkr�| j j
dj| j� dj|�d�� dS dS ) z�Tests whether other devices are holding the VDO device open. This
handles the case where there are LVM entities stacked on top of us.
Returns:
True iff the VDO device has something holding it open.
Fz&/sys/dev/block/{major}:{minor}/holders)�major�minorr z&{path} is being held open by {holders}r� )r� �holdersT)r� r� r` ry �st_rdevrz r� rS r� �isdir�listdirr� rk r� r� )r �stry rz ZholdersDirectoryr{ r! r! r" r� � s
zVDOService._hasHoldersc C sR t dgdd�}|rNtjdtj| j� � d �}x |j� D ]}|j|�r8dS q8W dS )z�Tests whether filesystems are mounted on the VDO device.
Returns:
True iff the VDO device has something mounted on it.
ZmountT)r� z(\A|\s+)z\s+F)r rH �compile�escaper` r0 �search)r Z mountListZmatcherr+ r! r! r" r� � s
zVDOService._hasMountsc C sZ t � }y |j� W n0 tk
rB | jjtd�j|j� �� � Y nX |dk rV|j|� dS )z�Install the kernel module providing VDO support.
Arguments:
logLevel: the level of logging to use; if None, do not set level
z Kernel module {0} not installedN) r ri r� rk rl r' rS rY Z setLogLevel)r ZlogLevelZkmsr! r! r" ry � s z VDOService._installKernelModulec C s, yt j| j� � dS tk
r& dS X dS )zOReturns True if there already exists a dm target with the name of
this VDO.TFN)r� r� r` r� )r r! r! r" r5 s
z VDOService._mapperDeviceExistsc C s� t j� }|j| jjtd�j| j� �� | j| j d�}|j| jjtd�j| j� �� t
dd| j d|g� |jd� | j d� | j
� dS ) zHPeforms the changing of the write policy on a running vdo instance.
z Device {0} could not be read)r� z Device {0} could not be changedrb r� z--tableNF)r rf rj rk rl r' rS rY r� r� r r� r� r� )r rf r� r! r! r" r� s
z(VDOService._performRunningSetWritePolicyc C s� | j s"| jjtd�j| j� �� nz| j| jjkrPtd�j| j� �}t |t
d��nL| j � }|d |d t j
}tdj|��| _| j� r�| j� | j| jj� dS )zcRecovers a VDO target from a previous grow logical failure.
Raises:
VDOServiceError
z5No grow logical recovery necessary for VDO volume {0}zCPrevious operation failure for VDO volume {0} not from grow logical)rO r� r� z{0}sN)r� rk rs r' rS rY r
rN rB r r r� r r� r
r� r^ r� r{ rF )r r r� r� r! r! r" r\ ' s
z VDOService._recoverGrowLogicalc C s� | j s"| jjtd�j| j� �� nz| j| jjkrPtd�j| j� �}t |t
d��nL| j � }|d |d t j
}tdj|��| _| j� r�| j� | j| jj� dS )zdRecovers a VDO target from a previous grow physical failure.
Raises:
VDOServiceError
z6No grow physical recovery necessary for VDO volume {0}zDPrevious operation failure for VDO volume {0} not from grow physical)rO r� r� z{0}sN)r� rk rs r' rS rY r
rN rC r r r� r r� r
r� r^ r� r{ rF )r r r� r� r! r! r" r] G s
z VDOService._recoverGrowPhysicalc C sr | j s"| jjtd�j| j� �� nL| j| jjkrPtd�j| j� �}t |t
d��n | j � r`| j � | j
| jj� dS )z�Recovers a VDO target from a previous setting of write policy against
a running VDO.
Raises:
VDOServiceError
z9No set write policy recovery necessary for VDO volume {0}zGPrevious operation failure for VDO volume {0} not from set write policy)rO N)r� rk rs r' rS rY r
rN rE r r r^ r� r{ rF )r r r! r! r" r^ g s
z(VDOService._recoverRunningSetWritePolicyc C s� | j jtd�j| j� �� ytdd| j� g� W n@ tk
rp } z$| j jtd�j| j� |�� � W Y dd}~X nX | j� | j jtd�j| j� �� dS )zResumes a suspended VDO.zResuming VDO volume {0}rb Zresumez"Can't resume VDO volume {0}; {1!s}NzResumed VDO volume {0}) rk r� r' rS rY r r� rl r� )r r� r! r! r" r� � s zVDOService._resumec s. t |�}|dkrt|�}tt| �jd|� d S )Ng �?r� )�floatr= r r- r$ )r r� r� )r r! r" r" � s zVDOService._setMemoryAttrc C s. || _ |r*| jj| j� | dd� | jj� d S )NT)�replace)r r[ r\ rY r| )r �stater| r! r! r" r{ � s z VDOService._setOperationStatec s t jj| j��d�g }t jj��r��fdd��fdd�t j��D �D �}�d k r�| j��� � d k r�| jjdj � d�� � fdd�|D �}t
|�d kr�| jjd
j �|d �� d d� |D �}t
|�d kr�|}|j � |d | _| jjd
j | jd�� n| jjdj ��d�� d S )Nz/dev/disk/by-idc s g | ]}t jj|�� kr|�qS r! )r� r� �realpath)r� Zabsname)r� r! r" r� � s z-VDOService._setStableName.<locals>.<listcomp>c 3 s | ]}t jj� |�V qd S )N)r� r� r� )r� r� )�idDirr! r" � <genexpr>� s z,VDOService._setStableName.<locals>.<genexpr>zpruning {uuid} from aliases)r2 c s g | ]}� |kr|�qS r! r! )r� �a)�
deviceUUIDr! r" r� � s r z'found aliases for {original}: {aliases})�original�aliasesc S s g | ]}t jd |�dk r|�qS )z.*/[dm][dm]-uuid-N)rH rI )r� r� r! r! r" r� � s z using {new})�newz+no aliases for {original} found in {idDir}!)r� r� ) r� r� r� r. r} r~ rh rk rs rS r� �sort)r r� Z uuidAliasesr! )r� r� r� r" rx � s2
zVDOService._setStableNamec C s� |dkr dS y.|dkr&t d| jg� nt dd|| jg� W nB tk
r| } z&td�j| j� |�}t|td��W Y dd}~X nX dS )z�Sets a new uuid for the vdo volume, either by providing a value
or having the tool generate a new random one.
Arguments:
uuid (str) - the uuid to set
Raises:
Exception
NrP Z
vdosetuuidz--uuidz,Can't set the UUID for VDO volume {0}; {1!s})rO )r r. r� r' rS rY r r )r r2 r� r r! r! r" r� � s
zVDOService._setUUIDc C s | j d� dS )z9Starts compression on a VDO volume if it is running.
TN)�_toggleCompression)r r! r! r" r� � s z VDOService._startCompressionc C sJ yt dd| j� g� W n. tk
rD | jjtd�j| j� �� Y nX d S )N� vdodmeventdz-rz$Could not register {0} with dmeventd)r rY r� rk r� r' rS )r r! r! r" r� � s z#VDOService._startFullnessMonitoringc C s | j d� dS )z8Stops compression on a VDO volume if it is running.
FN)r� )r r! r! r" r� � s zVDOService._stopCompressionc C s: dd| j � g}|d k r&|jdj|�� |r6t|dd� d S )Nr� z-ur� T)r� )rY r� r� r )r r� r� r� r! r! r" r� � s
z"VDOService._stopFullnessMonitoringc C s� | j jtd�j| j� |r dnd�� | jdd� y tdd|r@dnd | j� g� W n@ tk
r� } z$| j jtd
�j| j� |�� � W Y dd}~X nX | j jtd �j| j� �� dS ) zSuspends a running VDO.z"Suspending VDO volume {0} with {1}�flushzno flushTNrb ZsuspendrP z --noflushz#Can't suspend VDO volume {0}; {1!s}zSuspended VDO volume {0}) rk r� r' rS rY r� r r� rl )r r� r� r! r! r" r� s zVDOService._suspendc C sR | j � s dS | jtd�j|r dnd| j� �� tdd| j� dd|rFd nd
g� dS ) z�Turns compression on or off if the VDO is running.
Arguments:
enable (boolean): True if compression should be enabled
Nz{0} compression on VDO {1}ZStartingZStoppingrb rc rd r ZonrS )r^ rZ r' rS rY r )r r� r! r! r" r� s z VDOService._toggleCompressionc
C s� t djtjt|����}d}yPtdddg�}x<|j� D ]0}tjd|�}|dk r6|j d�}t dj|��}q6W W n t
k
r� Y nX |dkr�| j j d � dS |j
� |j
� kr�ttd
j|d ����dS ) a= Validates whether there is likely enough kernel memory to at least
create the index. If there is an error getting the info, don't
fail the create, just let the real check be done in vdoformat.
Arguments:
indexMemory - the amount of memory requested or default.
Raises:
ArgumentError
z{0}gNZgrepZ MemAvailablez
/proc/meminfozMemAvailable:\s*(\d+)r z{0}kz#Unable to validate available memoryzGNot enough available memory in system for index requirement of {needed})Zneeded)r
rS �localer� r� r r0 rH rI �groupr� rk r� rF r r' )r r� Z memoryNeededZmemoryAvailabler� r+ r� Z availabler! r! r" r� s"
z#VDOService._validateAvailableMemoryc C sl |dkr| j }|dkr | j}|dkr*| j}|dksB|dksB|dkrh|dkoX|dkoX|dk rhttd���dS )aY Validates that the hash zone, logical and physical thread counts
are consistent (all zero or all non-zero).
Arguments:
hashZone - hash zone thread count to use, may be None
logical - logical thread count to use, may be None
physical - physical thread count to use, may be None
Raises:
ArgumentError
Nr zRhash zone, logical and physical threads must either all be zero or all be non-zero)r7 r8 r9 r r' )r ZhashZonerP rQ r! r! r" r� A s z*VDOService._validateModifiableThreadCountsc C s$ | j | j� | j| j| j| j� d S )N)r� r� r� r7 r8 r9 )r r! r! r" rv Z s z VDOService._validateParameters)T)F)FN)F)F)FN)F)N)T)T)~r# r$ r% r& �loggingZ getLoggerrk Zyaml_tagZvdosKeyr' rm rn ro rt ru r� r� rp r� rq r� rr rl ZvdoMdRaid5ModeKeyr� rs r� ZvdoWritePolicyKeyrQ r� �objectrN rM rV r] ra re r rr rH r� r� r_ r` r� r� r� r� r� r^ ri r� rg r� r� r� r� r � staticmethodr r �propertyr r r r r r$ r
rZ r� rw ru r� r r r r r r r? r� r r� r� r@ r� r� r� rW rd r� re r� r� r� r� rh r� r� r� rk r� r� r� ry r5 r� r\ r] r^ r� r" r{ rx r� r� r� r� r� r� r� r� r� rv r( r! r! )r r" r- m s� '
) 7 ; >
8
=
G
_
23 4 J '
* !3
2!$
+
"r- )+r& Z
__future__r r r r rP r r r r
r r r
r r r r r Z vdo.utilsr r r r r r} r� r� r> r� rH Zsocketr r� rn r� r� r r) r* r+ r, r- r! r! r! r" �<module> s@