Submit
Path:
~
/
/
usr
/
lib64
/
python3.6
/
site-packages
/
borg
/
__pycache__
/
File Content:
upgrader.cpython-36.pyc
3 y��b5 � @ s� d dl Z d dlZd dlZd dlZddlmZmZ ddlmZ ddl m Z ddl m Z m Z m Z ddlmZ ddlmZ dd lmZmZ ee�Zd ZG d d � d e�ZG d d� de�ZG dd� de�ZG dd� de�ZdS )� N� )� KeyfileKey�KeyfileNotFoundError)�REPOSITORY_README)�ProgressIndicatorPercent)� get_base_dir� get_keys_dir� get_cache_dir)�Lock)� create_logger)� Repository�MAGICs ATTICSEGc sn e Zd Z� fdd�Zddd�Zdd� Zedd d ��Zedd d ��Zd d� Z edd� �Z dd� Z dd� Z � Z S )�AtticRepositoryUpgraderc s" d|d< d|d< t � j||� d S )NF�lockZcheck_segment_magic)�super�__init__)�self�args�kw)� __class__� � /usr/lib64/python3.6/upgrader.pyr s z AtticRepositoryUpgrader.__init__TFc C s2 | �� d}|sFdj | jtjj� �}tjd|� |sFtj| j|tj d� tjd� t tjj | jd�ddd �j � | _ d d � | jj� D �}y | j� }W n tk r� tjd � Y nX | j||� W dQ R X t tjj | jd�dd �j � | _ z6| j|� | j||d� | j||||d� | j� W d| j j� d| _ X |S )a� convert an attic repository to a borg repository those are the files that need to be upgraded here, from most important to least important: segments, key files, and various caches, the latter being optional, as they will be rebuilt if missing. we nevertheless do the order in reverse, as we prefer to do the fast stuff first, to improve interactivity. Nz&{}.before-upgrade-{:%Y-%m-%d-%H:%M:%S}z making a hardlink copy in %s)Z copy_functionz1opening attic repository with borg and convertingr Tg �?)� exclusiveZtimeoutc S s g | ] \}}|�qS r r )�.0�i�filenamer r r � <listcomp>. s z3AtticRepositoryUpgrader.upgrade.<locals>.<listcomp>z no key file found for repository)r )�dryrun�inplace)r r �progress)�format�path�datetimeZnow�logger�info�shutilZcopytree�os�linkr �join�acquirer �ioZsegment_iterator�find_attic_keyfiler �warning�convert_keyfiles� convert_cache�convert_repo_index�convert_segments� borg_readme�release)r r r r Zbackup�segments�keyfiler r r �upgrade s0 z AtticRepositoryUpgrader.upgradec C s> t jj| jd�}t j|� t|d��}|jt� W d Q R X d S )NZREADME�w)r& r! r( �remove�open�writer )r Zreadme�fdr r r r1 A s z#AtticRepositoryUpgrader.borg_readmec C s~ t jdt| � � t| �}t|ddd�}xDt| �D ]8\}}|rH|j|� |rXtjd� q2tj |t t |d� q2W |rz|j � dS )a convert repository segments from attic to borg replacement pattern is `s/ATTICSEG/BORG_SEG/` in files in `$ATTIC_REPO/data/**`. luckily the magic string length didn't change so we can just replace the 8 first bytes of all regular files in there.zconverting %d segments...zConverting segments %3.0f%%zupgrade.convert_segments)Ztotal�msgZmsgidg����MbP?)r N) r# r$ �lenr � enumerateZshow�timeZsleepr �header_replace� ATTIC_MAGICr Zfinish)r3 r r r Z segment_countZpir r r r r r0 G s z(AtticRepositoryUpgrader.convert_segmentsc C s� t | d���}|jd� |jt|��|kr�|rB|jd� |j|� nLtj| | d � t | d�� }|j|� |j|j� � W d Q R X tj| d � W d Q R X d S )Nzr+br z.tmp�wb)r8 �seek�readr< r9 r& �rename�unlink)r Z old_magicZ new_magicr ZsegmentZ new_segmentr r r r? ] s z&AtticRepositoryUpgrader.header_replacec C s t j| �S )ae find the attic keyfiles the keyfiles are loaded by `KeyfileKey.find_key_file()`. that finds the keys with the right identifier for the repo. this is expected to look into $HOME/.attic/keys or $ATTIC_KEYS_DIR for key files matching the given Borg repository. it is expected to raise an exception (KeyfileNotFoundError) if no key is found. whether that exception is from Borg or Attic is unclear. this is split in a separate function in case we want to use the attic code here directly, instead of our local implementation.)�AtticKeyfileKey� find_key_file)r r r r r+ r s z*AtticRepositoryUpgrader.find_attic_keyfilec C s� t jd| � t| d��}|j� }W dQ R X |jtjtjd�}tj j t � tj j | ��} t jd| � |s�t| d��}|j |� W dQ R X dS )a� convert key files from attic to borg replacement pattern is `s/ATTIC KEY/BORG_KEY/` in `get_keys_dir()`, that is `$ATTIC_KEYS_DIR` or `$HOME/.attic/keys`, and moved to `$BORG_KEYS_DIR` or `$HOME/.config/borg/keys`. no need to decrypt to convert. we need to rewrite the whole key file because magic string length changed, but that's not a problem because the keyfiles are small (compared to, say, all the segments).zconverting keyfile %s�rNr zwriting borg keyfile to %sr6 )r# r$ r8 rC �replacerF �FILE_IDr r& r! r( r �basenamer9 )r4 r �f�datar r r r- � s z(AtticRepositoryUpgrader.convert_keyfilesc C s^ | j � }|dkr"tjd| j � n8tjj| jd| �}tjd| � |sZtj|dd|d� dS )a� convert some repo files those are all hash indexes, so we need to `s/ATTICIDX/BORG_IDX/` in a few locations: * the repository index (in `$ATTIC_REPO/index.%d`, where `%d` is the `Repository.get_index_transaction_id()`), which we should probably update, with a lock, see `Repository.open()`, which i'm not sure we should use because it may write data on `Repository.close()`... Nz%no index file found for repository %szindex.%dzconverting repo index %ss ATTICIDXs BORG_IDX)r ) Zget_index_transaction_idr# r, r! r& r( r$ r r? )r r r Ztransaction_id�indexr r r r/ � s z*AtticRepositoryUpgrader.convert_repo_indexc s� t jjdt jjt� dd��� t jj� | j�� t jjt� | j��� ��fdd�}t jj� �r�t jj��spt j �� xd D ] }||� qvW x4dD ],}||�}t j d | � �s�t j |d d � q�W d S )a� convert caches from attic to borg those are all hash indexes, so we need to `s/ATTICIDX/BORG_IDX/` in a few locations: * the `files` and `chunks` cache (in `$ATTIC_CACHE_DIR` or `$HOME/.cache/attic/<repoid>/`), which we could just drop, but if we'd want to convert, we could open it with the `Cache.open()`, edit in place and then `Cache.close()` to make sure we have locking right ZATTIC_CACHE_DIRz.cacheZatticc s� t jj� | �}t jj|�rht jj�| �}t jj|�rBtjd|� n"tjd||f � �sdtj||� |S tjd| |f � dS dS )a copy the given attic cache path into the borg directory does nothing if dryrun is True. also expects attic_cache_dir and borg_cache_dir to be set in the parent scope, to the directories path including the repository identifier. :params path: the basename of the cache file to copy (example: "files" or "chunks") as a string :returns: the borg file that was created or None if no Attic cache file was found. z<borg cache file already exists in %s, not copying from Atticz©ing attic cache file from %s to %sz no %s cache file found in %sN) r& r! r( �existsr# r, r$ r% Zcopyfile)r! Z attic_fileZ borg_file)�attic_cache_dir�borg_cache_dirr r r �copy_cache_file� s z>AtticRepositoryUpgrader.convert_cache.<locals>.copy_cache_file�config�files�chunkszconverting cache %ss ATTICIDXs BORG_IDXN)rS rT )rU )r& �environ�getr! r( r �id_strr rO �makedirsr# r$ r r? )r r rR �cacher )rP rQ r r r. � s z%AtticRepositoryUpgrader.convert_cache)TFF)TFF)T)�__name__� __module__� __qualname__r r5 r1 � staticmethodr0 r? r+ r- r/ r. � __classcell__r r )r r r s ( r c @ s, e Zd ZdZdZedd� �Zedd� �ZdS )rF z*backwards compatible Attic key file parserz ATTIC KEYc C s t jjdt jjt� dd��S )z,Determine where to repository keys and cacheZATTIC_KEYS_DIRz.attic�keys)r& rV rW r! r( r r r r r r � s z AtticKeyfileKey.get_keys_dirc C s� | j }|� }tjj|�s$t|j|��xhtj|�D ]Z}tjj||�}t|d��8}|j� j � }|r�|j | j �r�|dd� |j kr�|S W dQ R X q0W t|j|��dS )aw copy of attic's `find_key_file`_ this has two small modifications: 1. it uses the above `get_keys_dir`_ instead of the global one, assumed to be borg's 2. it uses `repository.path`_ instead of `repository._location.canonical_path`_ because we can't assume the repository has been opened by the archiver yet rH � N) r r& r! rO r �listdirr( r8 �readline�strip� startswithrJ rX )�cls� repositoryr �keys_dir�namer r: �liner r r rG � s "z AtticKeyfileKey.find_key_fileN) r[ r\ r] �__doc__rJ r^ r � classmethodrG r r r r rF � s rF c @ s& e Zd Zd dd�Zdd� Zdd� Zd S ) �BorgRepositoryUpgraderTFc C sV t jd� | �> y | j� }W n tk r: t jd� Y nX | j||� W dQ R X dS )zDconvert an old borg repository to a current borg repository z$converting borg 0.xx to borg currentz no key file found for repositoryN)r# r$ �find_borg0xx_keyfiler r, � move_keyfiles)r r r r r4 r r r r5 s z BorgRepositoryUpgrader.upgradec C s t j| �S )N)�Borg0xxKeyfileKeyrG )r r r r rn % s z+BorgRepositoryUpgrader.find_borg0xx_keyfilec C sF t jj|�}t jjt� |�}yt j||� W n tk r@ Y nX d S )N)r& r! rK r( r rD �FileExistsError)r r4 r r Z new_keyfiler r r ro ( s z$BorgRepositoryUpgrader.move_keyfilesN)TFF)r[ r\ r] r5 rn ro r r r r rm s rm c @ s( e Zd ZdZedd� �Zedd� �ZdS )rp z.backwards compatible borg 0.xx key file parserc C s t jjdt jjt� dd��S )NZ BORG_KEYS_DIRz.borgr` )r& rV rW r! r( r r r r r r 5 s z Borg0xxKeyfileKey.get_keys_dirc C s� | j }|� }tjj|�s$t|j|��xrtj|�D ]d}tjj||�}t|d��B}|j� j � }|r�|j | j �r�|t | j �d d � |j kr�|S W d Q R X q0W t|j|��d S )NrH r )r r& r! rO r rb r( r8 rc rd re rJ r< rX )rf rg r rh ri r r: rj r r r rG : s ,z Borg0xxKeyfileKey.find_key_fileN)r[ r\ r] rk r^ r rl rG r r r r rp 2 s rp )r" r& r% r> Z crypto.keyr r Z constantsr Zhelpersr r r r Zlockingr r# r rg r r r[ r@ r rF rm rp r r r r �<module> s" a%
Submit
FILE
FOLDER
Name
Size
Permission
Action
__init__.cpython-36.opt-1.pyc
289 bytes
0644
__init__.cpython-36.pyc
719 bytes
0644
__main__.cpython-36.opt-1.pyc
165 bytes
0644
__main__.cpython-36.pyc
165 bytes
0644
_version.cpython-36.opt-1.pyc
133 bytes
0644
_version.cpython-36.pyc
133 bytes
0644
archive.cpython-36.opt-1.pyc
61040 bytes
0644
archive.cpython-36.pyc
61249 bytes
0644
archiver.cpython-36.opt-1.pyc
177490 bytes
0644
archiver.cpython-36.pyc
178018 bytes
0644
cache.cpython-36.opt-1.pyc
40019 bytes
0644
cache.cpython-36.pyc
40279 bytes
0644
constants.cpython-36.opt-1.pyc
1870 bytes
0644
constants.cpython-36.pyc
1915 bytes
0644
fuse.cpython-36.opt-1.pyc
17457 bytes
0644
fuse.cpython-36.pyc
17531 bytes
0644
helpers.cpython-36.opt-1.pyc
81995 bytes
0644
helpers.cpython-36.pyc
82837 bytes
0644
locking.cpython-36.opt-1.pyc
13814 bytes
0644
locking.cpython-36.pyc
13888 bytes
0644
logger.cpython-36.opt-1.pyc
7593 bytes
0644
logger.cpython-36.pyc
7593 bytes
0644
lrucache.cpython-36.opt-1.pyc
1994 bytes
0644
lrucache.cpython-36.pyc
2191 bytes
0644
nanorst.cpython-36.opt-1.pyc
5565 bytes
0644
nanorst.cpython-36.pyc
5669 bytes
0644
patterns.cpython-36.opt-1.pyc
13541 bytes
0644
patterns.cpython-36.pyc
13541 bytes
0644
remote.cpython-36.opt-1.pyc
36814 bytes
0644
remote.cpython-36.pyc
37012 bytes
0644
repository.cpython-36.opt-1.pyc
49853 bytes
0644
repository.cpython-36.pyc
50395 bytes
0644
selftest.cpython-36.opt-1.pyc
3406 bytes
0644
selftest.cpython-36.pyc
3566 bytes
0644
shellpattern.cpython-36.opt-1.pyc
1775 bytes
0644
shellpattern.cpython-36.pyc
1775 bytes
0644
upgrader.cpython-36.opt-1.pyc
12017 bytes
0644
upgrader.cpython-36.pyc
12017 bytes
0644
version.cpython-36.opt-1.pyc
1948 bytes
0644
version.cpython-36.pyc
1948 bytes
0644
xattr.cpython-36.opt-1.pyc
11749 bytes
0644
xattr.cpython-36.pyc
11749 bytes
0644
N4ST4R_ID | Naxtarrr
