a &0__@sVddlmZddlZddlmZddlmZddlmZm Z m Z m Z m Z m Z mZmZmZmZmZmZmZddlmZdejhZd d Zd d Zd dZddZddZddZdZdZ Gddde!Z"gZ#ddZ$Gddde"Z%Gddde%Z&e$Gdd d e&Z'e$Gd!d"d"e&Z(e$Gd#d$d$e&Z)e$Gd%d&d&e&Z*e$Gd'd(d(e&Z+e$Gd)d*d*e&Z,e$Gd+d,d,e&Z-e$Gd-d.d.e%Z.e$Gd/d0d0e%Z/e$Gd1d2d2e%Z0d3d4Z1d5d6d7d8d9Z2d:d;Z3dd?Z5d@dAZ6e!Z7e!Z8e!Z9e:e7e8e9gZ;dBdCZdHdIZ?dJdKZ@e;fdLdMZAdRdPdQZBdS)S)absolute_importN)_)getattr) changelogerrorfileloghg localrepomanifestmetadatapycompat requirementsrevlogscmutilutilvfs) compression generaldeltacCsddhS)zObtain requirements required to be present to upgrade a repo. An upgrade will not be allowed if the repository doesn't have the requirements returned by this function. revlogv1storereporr3/usr/lib/python3/dist-packages/mercurial/upgrade.pyrequiredsourcerequirements'srcCstjdtjhS)zObtain requirements that will prevent an upgrade from occurring. An upgrade cannot be performed if the source repository contains a requirements in the returned set. s parentdelta)rZTREEMANIFEST_REQUIREMENTZSHARED_REQUIREMENTrrrrblocksourcerequirements5s rcCsbtjtjtjtjh}tjD]B}tj|}|r|r| d|| dkr| dq|S)zObtain requirements that can be removed during an upgrade. If an upgrade were to create a repository that dropped a requirement, the dropped requirement must appear in the returned set for the upgrade to be allowed. exp-compression-%szstdrevlog-compression-zstd rSPARSEREVLOG_REQUIREMENTSIDEDATA_REQUIREMENTCOPIESSDC_REQUIREMENTNODEMAP_REQUIREMENTr compengines available revlogheaderaddnamerZ supportedr)ZenginerrrsupportremovedrequirementsGs    r+c Cspdddddtjtjtjtjtjh }tjD]B}tj|}|r(| r(| d|| dkr(| dq(|S) zObtain requirements that upgrade supports in the destination. If the result of the upgrade would create requirements not in this set, the upgrade is disallowed. Extensions should monkeypatch this to add their custom requirements. dotencodefncacherrrrrr) rr!r"r#r$ZSHARESAFE_REQUIREMENTrr%r&r'r(r)r*rrrsupporteddestrequirements]s$     r.cCshdddtjtjtjtjh}tjD]B}tj|}|r |r | d|| dkr | dq |S)aObtain requirements that can be added to a repository during upgrade. This is used to disallow proposed requirements from being added when they weren't present before. We use a list of allowed requirement additions instead of a list of known bad additions because the whitelist approach is safer and will prevent future, unknown requirements from accidentally being added. r,r-rrrrr r*rrrallowednewrequirementszs     r/cCstSN)setrrrrpreservedrequirementssr2s deficiencys optimizationc@s0eZdZdZddZddZddZdd Zd S) improvementaRepresents an improvement that can be made as part of an upgrade. The following attributes are defined on each instance: name Machine-readable string uniquely identifying this improvement. It will be mapped to an action later in the upgrade process. type Either ``deficiency`` or ``optimisation``. A deficiency is an obvious problem. An optimization is an action (sometimes optional) that can be taken to further improve the state of the repository. description Message intended for humans explaining the improvement in more detail, including the implications of it. For ``deficiency`` types, should be worded in the present tense. For ``optimisation`` types, should be worded in the future tense. upgrademessage Message intended for humans explaining what an upgrade addressing this issue will do. Should be worded in the future tense. cCs||_||_||_||_dSr0r)type descriptionupgrademessage)selfr)r5r6r7rrr__init__szimprovement.__init__cCst|tstS|j|jkSr0) isinstancer3NotImplementedr)r8otherrrr__eq__s zimprovement.__eq__cCs ||k Sr0rr<rrr__ne__szimprovement.__ne__cCs t|jSr0)hashr)r8rrr__hash__szimprovement.__hash__N)__name__ __module__ __qualname____doc__r9r>r?rBrrrrr3s r3cCst||Sr0)allformatvariantappend)clsrrrregisterformatvariants rJc@sDeZdZdZeZdZdZdZdZ ddZ e ddZ e ddZ dS) formatvariantz6an improvement subclass dedicated to repository formatNcCs tdSr0NotImplementedErrorrArrrr9szformatvariant.__init__cCs tdS)z.current value of the variant in the repositoryNrLrrrrfromreposzformatvariant.fromrepocCs tdS)z1current value of the variant in the configurationNrLrrrr fromconfigszformatvariant.fromconfig)rCrDrErF deficiencyr5r)r6r7defaultr9 staticmethodrNrOrrrrrKs rKc@s8eZdZdZdZeddZeddZeddZ dS) requirementformatvariantzformatvariant based on a 'requirement' name. Many format variant are controlled by a 'requirement'. We define a small subclass to factor the code. NcCst|t|Sr0)r newreporequirementsdefaultcreateoptsuirrr_newreporequirementss z-requirementformatvariant._newreporequirementscCs|jdusJ|j|jvSr0) _requirementrrIrrrrrNsz!requirementformatvariant.fromrepocCs |jdusJ|j||jvSr0)rYrXrWrZrrrrO sz#requirementformatvariant.fromconfig) rCrDrErFrYrRrX classmethodrNrOrrrrrSs  rSc@s(eZdZdZdZdZedZedZdS)fncacher-TsYlong and reserved filenames may not work correctly; repository performance is sub-optimalssrepository will be more resilient to storing certain paths and performance of certain operations should be improvedN rCrDrEr)rYrQrr6r7rrrrr\sr\c@s(eZdZdZdZdZedZedZdS) dotencoder,TsLstorage of filenames beginning with a period or space may not work correctlysNrepository will be better able to store files beginning with a space or periodNr]rrrrr^%sr^c@s(eZdZdZdZdZedZedZdS) generaldeltarTsdeltas within internal storage are unable to choose optimal revisions; repository is larger and slower than it could be; interaction with other repositories may require extra network and CPU resources, making "hg push" and "hg pull" slowersrepository storage will be able to create optimal deltas; new repository data will be smaller and read times should decrease; interacting with other repositories using this storage model should require less network and CPU resources, making "hg push" and "hg pull" fasterNr]rrrrr_8sr_c@s*eZdZdZejZdZedZ edZ dS) sparserevlogs sparserevlogTsXin order to limit disk reading and memory usage on older version, the span of a delta chain from its root to its end is limited, whatever the relevant data in this span. This can severly limit Mercurial ability to build good chain of delta resulting is much more storage space being taken and limit reusability of on disk delta during exchange.sRevlog supports delta chain with more unused data between payload. These gaps will be skipped at read time. This allows for better delta chains, making a better compression and faster exchange with server.N) rCrDrEr)rr!rYrQrr6r7rrrrr`Ss r`c@s*eZdZdZejZdZedZ edZ dS)sidedatassidedataFsUAllows storage of extra data alongside a revision, unlocking various caching options.s2Allows storage of extra data alongside a revision.N) rCrDrEr)rr"rYrQrr6r7rrrrramsrac@s*eZdZdZejZdZedZ edZ dS)persistentnodemapspersistent-nodemapFs9persist the node -> rev mapping on disk to speedup lookups#Speedup revision lookup by node id.N) rCrDrEr)rr$rYrQrr6r7rrrrrb}srbc@s*eZdZdZejZdZedZ edZ dS) copiessdcs copies-sdcFs/Stores copies information alongside changesets.sAAllows to use more efficient algorithm to deal with copy tracing.N) rCrDrEr)rr#rYrQrr6r7rrrrrcsrcc@s<eZdZdZdZedZedZeddZ eddZ d S) removecldeltachainsplain-cl-deltaTschangelog storage is using deltas instead of raw entries; changelog reading and any operation relying on changelog data are slower than they could beszchangelog storage will be reformated to store raw entries; changelog reading will be faster; changelog size may be reducedcs"|j}|jtfdd|DS)Nc3s|]}||kVqdSr0r).0rev chainbaserr z.removecldeltachain.fromrepo..)rrhall)rZclrrgrrNszremovecldeltachain.fromrepocCsdS)NTrrrrrrOszremovecldeltachain.fromconfigN) rCrDrEr)rQrr6r7rRrNrOrrrrrds rdc@s<eZdZdZdZedZedZeddZ eddZ d S) compressionengines compressionzlibsMCompresion algorithm used to compress data. Some engine are faster than others;revlog content will be recompressed with the new algorithm.cCs:d}|jD]*}|j}|ds$|dr |ddd}q |S)Nrmsrevlog-compression-sexp-compression--)r startswithsplit)rIrrZreqprefixrrrrNs  zcompressionengine.fromrepocCs4|jdd}|D]}|tjvr|Sqd|S)Nsformatsrevlog-compression,)rWZ configlistrr%join)rIrr%comprrrrOs   zcompressionengine.fromconfigN rCrDrEr)rQrr6r7r[rNrOrrrrrls rlc@s<eZdZdZdZedZedZeddZ eddZ d S) compressionlevelscompression-leveldefaultscompression levels#revlog content will be recompressedcCsPt|}d}|dkr&|jdd}n|dkr<|jdd}|durHdSt|SNrmsstoragesrevlog.zlib.levelrsrevlog.zstd.levelrx)rlrNrW configintbytesrIrrulevelrrrrNs zcompressionlevel.fromrepocCsPt|}d}|dkr&|jdd}n|dkr<|jdd}|durHdSt|Sry)rlrOrWrzr{r|rrrrOs zcompressionlevel.fromconfigNrvrrrrrws rwcCs&g}tD]}||s||q|S)z8returns a list of deficiencies that the repo suffer from)rGrNrH)r deficienciesZfvrrrfinddeficienciess   rre-delta-parentre-delta-multibase re-delta-allre-delta-fulladd)s redeltaparentsredeltamultibases redeltaallsredeltafulladdcCsg}|tdttdtdd|tdttdtdd|tdttd td d|td ttd td d|S)z8Determine optimisation that could be used during upgraders]deltas within internal storage will be recalculated to choose an optimal base revision where this was not already done; the size of the repository may shrink and various operations may become faster; the first time this optimization is performed could slow down upgrade execution considerably; subsequent invocations should not run noticeably slowersHdeltas within internal storage will choose a new base revision if neededr4rsdeltas within internal storage will be recalculated against multiple base revision and the smallest difference will be used; the size of the repository may shrink significantly when there are many merges; this optimization will slow down execution in proportion to the number of merges in the repository and the amount of files in the repository; this slow down should not be significant unless there are tens of thousands of files and thousands of mergessdeltas within internal storage will choose an optimal delta by computing deltas against multiple parents; may slow down execution time significantlyrsdeltas within internal storage will always be recalculated without reusing prior deltas; this will likely make execution run several times slower; this optimization is typically not neededsndeltas within internal storage will be fully recomputed; this will likely drastically slow down execution timersevery revision will be re-added as if it was new content. It will go through the full storage mechanism giving extensions a chance to process it (eg. lfs). This is similar to "re-delta-all" but even slower since more logic is involved.seach revision will be added as new content to the internal storage; this will likely drastically slow down execution time, but some extensions might need it)rHr3 optimisationr)r optimizationsrrrfindoptimizations!sd  rcCs4g}|D]&}|j}|dur$||vr$q||q|S)aDetermine upgrade actions that will be performed. Given a list of improvements as returned by ``finddeficiencies`` and ``findoptimizations``, determine the list of upgrade actions that will be performed. The role of this function is to filter improvements if needed, apply recommended optimizations from the improvements list that make sense, etc. Returns a list of action names. N)rYrH)rr~Z sourcereqsZdestreqsZ newactionsdr)rrrdetermineactions|s  rcCsZ|dkrt|jS|dr@|dtd }tj|j|dSt|j|ddSdS)z]Obtain a revlog from a repo path. An instance of the appropriate class is returned. 00changelog.i 00manifest.iN)Ztree)rsvfsendswithlenr manifestrevlogr)rpathZmandirrrr_revlogfrompaths   rc Cst|d|}t||}t|d|}|j}|j}||j}||j}||j} ||j} ||jdWdn1s0Yt|||j|j} | rt| | | ds| ds|j j || r|j j |ddddS)a copy all relevant files for `oldrl` into `destrepo` store Files are copied "as is" without any transformation. The copy is performed without extra checks. Callers are responsible for making sure the copied content is compatible with format of the destination repository. _revlogwNrrr.d) rrZopenerrtZ indexfileZdatafilercopyfileexistsrrr\r() trZdestrepooldrlZ unencodednamenewrlZoldvfsZnewvfsZoldindexZnewindexZolddatanewdataZcopydatarrr _copyrevlogs,         rcCsbd}|j|j}|j|j}tj|vr0dd}n.tj|vrHt||}ntj|vr^t||}|S)NcSs8t|d|}||tj@r*ddiddfSddiddfS)NrTrrF)rflagsrZREVIDX_SIDEDATA)rlrfrrrsidedatacompanions z/getsidedatacompanion..sidedatacompanion)rr"r#r ZgetsidedataadderZgetsidedataremover)srcrepodstrepor removedreqs addedreqsrrrgetsidedatacompanions       rcCs,|drt|vS|dr$t|vSt|vS)zcheck if a revlog is selected for cloning. In other words, are there any updates which need to be done on revlog or it can be blindly copied. The store entry is checked against the passed filterrr)rUPGRADE_CHANGELOGUPGRADE_MANIFESTUPGRADE_FILELOG)Z revlogfilterentryrrr matchrevlogs   rc' sd}d}d} d} d} d} d} d}d}d}d}d}d}d}d}d}d}d}t|j}|D]\}}}|drrqZt||}|jddddd}||dpd7}|dpd}|dpd} ||7}| | 7} t|tjr|t|7}||7}|| 7}qZt|t j r$|d7}|t|7}||7}|| 7}qZt|t j rX| d7} | t|7} | |7} || 7}qZt d qZ|snd S|td || ||f|td t|t| fd fd d}!t||}"t}#|D]f\}}}|drqt||}$t|$tjrrd|#vrr|td||t||f|td|t|t|f|#d|jjtd|dnt|$t j rd|#vr|td| | t|| f|td||t|t|f|#dr|jjtd|dn\d|#vr\|td| | t| t|f|#drH|jjtd| dt||r|tdt|$|ft||}%|$j||%|!|||"dn6td}&||&|t|$ft|||$|t||}%|%jdd}|dpd}| |7} t|%tjr||7}n t|%t j r,||7}n||7}qΈ|td|t||f|td |t| |fd S)!zCopy revlogs between 2 repos.rrT)ZexclusivefilesZrevisionscountZ trackedsize storedsizesrevisionscounts storedsizes trackedsizersunknown revlog typeNsPmigrating %d total revisions (%d in filelogs, %d in manifests, %d in changelog) s'migrating %s in store; %s tracked data cs dSr0)Z increment)rrfZnodeZprogressrroncopiedrevisionPsz'_clonerevlogs..oncopiedrevisioncsQfinished migrating %d manifest revisions across %d manifests; change in size: %s sKmigrating changelog containing %d revisions (%s in store; %s tracked data) schangelog revisions)totalmsOfinished migrating %d filelog revisions across %d filelogs; change in size: %s sNmigrating %d manifests containing %d revisions (%s in store; %s tracked data) smanifest revisionsfsMmigrating %d filelogs containing %d revisions (%s in store; %s tracked data) sfile revisionsscloning %d revisions from %s )Z addrevisioncb deltareuseforcedeltabothparentsrs+blindly copying %s containing %i revisions )rs>finished migrating %d changelog revisions; change in size: %s sFfinished migrating %d total revisions; total change in store size: %s )liststorewalkrrZ storageinfor:rrr rrrZProgrammingErrorstatusrrZ bytecountrr1r(rWZ makeprogressZcompleterZnoteZcloner)'rWrrrrrrevlogsZrevcountZsrcsizeZ srcrawsizeZdstsizeZfcountZ frevcountZfsrcsizeZfrawsizeZfdstsizeZmcountZ mrevcountZmsrcsizeZmrawsizeZmdstsizeZ crevcountZcsrcsizeZcrawsizeZcdstsizeZ alldatafilesZ unencodedZencodedsizerinfoZdatasizeZrawsizerrseenrrmsgrrr _clonerevlogss`                              rcCs:|drdS|drdS|tjkr*dS|dvr6dSdS)aDetermine whether to copy a store file during upgrade. This function is called when migrating store files from ``srcrepo`` to ``dstrepo`` as part of upgrading a repository. Args: srcrepo: repo we are copying from dstrepo: repo we are copying to requirements: set of requirements for ``dstrepo`` path: store file being examined mode: the ``ST_MODE`` file type of ``path`` st: ``stat`` data structure for ``path`` Function should return ``True`` if the file is to be copied. )s.irs.ns.ndFsundo)slockr-T)rrpstatS_IFREG)rrrrmodestrrr_filterstorefiles   rcCsdS)zHook point for extensions to perform additional actions during upgrade. This function is called after revlogs and store files have been copied but before the new store is swapped into the original location. Nr)rWrrrrrr_finishdatamigrationsrc CsB|s J|sJ|tdd|vr8tjj}n>d|vrJtjj}n,d|vr\tjj}nd|vrntjj}ntjj}|d*}t |||||d|v|dWdn1s0Yt |j j j d d d D]^\}} } t||||| | sq|jtd ||j j|} |j j|} tj| | d d qt|||||tdtjd|jd} t | }t|j d|d|tdt||jdhB|td|td| |tdt}t|j|dt|j|jt|}|td||tdt|||d| S)ayDo the low-level work of upgrading a repository. The upgrade is effectively performed as a copy between a source repository and a temporary destination repository. The source repository is unmodified for as long as possible so the upgrade can abort at any time without causing loss of service for readers and without corrupting the source repository. sP(it is safe to interrupt this process any time before data migration completes) rrrrsupgraderNrjT)rs copying %s )Zcopystats,data fully migrated to temporary repository supgradebackup.rrdirsrequiress\marking source repository as being upgraded; clients will be unable to read from repository supgradeinprogresss*starting in-place swap of repository data s'replaced files will be backed up at %s sreplacing store... rsCstore replacement complete; repository was inconsistent for %0.1fs sBfinalizing requirements file and making repository readable again s store/lock) Z currentwlockrrrZDELTAREUSENEVERZDELTAREUSESAMEREVSZDELTAREUSEFULLADDZDELTAREUSEALWAYSZ transactionrsortedrrZreaddirrrWZrawvfsrtrrrr mkdtemprvfsmodrZwritereporequirementsrZtimerrenameZspathunlink)rWrrractionsrrrpkindrsrcZdst backuppathZ backupvfsZtstartelapsedrrr _upgraderepos       $       rFTc' s|dur g}dd|D}tt}d|fd|ff}dd|D} | rtdd | Drt}| D]2\} } | rh| dkr|tqh| dkrh|tqhn4| D].\} } | dkr|tq| dkr|tqtj } | rt t d t d  t| tj @}|r:t t d t d  t|tjtjtj t}|rt t d t d  t|j t}|rt t dt d  t|t}|rt t dt d  t|t}g}|D](}|j|vr||||jq|rdt j t dd t|t ddt}t|j fdd t|Dj }j }|tkrt||B@}|rt d} |d t|t}fddfdd}fdd}fdd}|sng}g}|D]0}|!rV||n|j"r:||q:|sx|r|r#t d|D]} #d| j| j$fq|r#t d|D]} #d| j| j$fqƈ#d n#t d!#t d"|||fd#d|D}!|!rj#t d$|!D] } #t d| j| j$fqHdS%t d%|||d&dD}"#t d'&'#t d(t(j)d)j*d*}#d}$z"#t d+|#j+j}%t,j-|%|#d,d-}&|&&N|&'$t.|&|"|d.}$Wdn1sV0YWdn1sv0Y|s|$dus#t d/|$j/j0|$d,d0d}$W#t d1|#j/j0|#d,d0|$r\j1s\ t d2|$ t d3nR#t d1|#j/j0|#d,d0|$rZj1sZ t d2|$ t d30Wdn1sr0YWdn1s0YdS)4zUpgrade a repository in place.NcSsh|]}t||qSr)legacy_opts_mapgetreorrr rjzupgraderepo..rrcSs g|]\}}|dur||fqSr0rreyxrrr rjzupgraderepo..css|]\}}|VqdSr0rrrrrrirjzupgraderepo..s2cannot upgrade repository; requirement missing: %s, s=cannot upgrade repository; unsupported source requirement: %ss;cannot upgrade repository; requirement would be removed: %ss@cannot upgrade repository; do not support adding requirement: %ssEcannot upgrade repository; do not support destination requirement: %ss)unknown optimization action requested: %ss0run without arguments to see valid optimizations)hintc3s|]}|vr|VqdSr0rrrrrrissAignoring revlogs selection flags, format requirements change: %s cs6d}t|D]$}|sdj||dd}q dS)NTr)labelF)rwrite)lrfirstrrVrr write_labeleds   z"upgraderepo..write_labeledcstdtdj@ddj}jrltd|ddj}|rtd|ddddS) Ns requirements s preserved: z"upgrade-repo.requirement.preserved s removed: z upgrade-repo.requirement.removeds added: zupgrade-repo.requirement.added)rrr)ZremovedZadded)newreqsrrWrrrprintrequirementss"         z&upgraderepo..printrequirementscsRddD}|jddd|rNtddd|Ddd dS) NcSsg|]}|jtkr|qSr)r5rrearrrrrjz;upgraderepo..printoptimisations..cSs|jSr0r)rrrrrjz9upgraderepo..printoptimisations..)keysoptimisations: cSsg|] }|jqSrrrrrrrrjz#upgrade-repo.optimisation.performeds )sortrr)Z optimisations)rrWrrrprintoptimisationss z'upgraderepo..printoptimisationscs$D]}d|j|jfqdS)N %s %s )rr)r7r)rrWrrprintupgradeactionssz(upgraderepo..printupgradeactionssBrepository lacks features recommended by current config options: rs?repository lacks features used by the default config options: rs7(no feature deficiencies found in existing repository) sEperforming an upgrade with "--run" will make the following changes: csg|]}|vr|qSrr)reirrrrWrjsKadditional optimizations are available by specifying "--optimize ": s-upgrade will perform the following actions: cSsg|] }|jqSrrrrrrrjrjsbeginning upgrade... s repository locked and read-only supgrade.rs9creating temporary repository to stage migrated data: %s T)rZcreaters"removing old repository content%s )Zforciblys!removing temporary repository %s s'copy of old repository backed up at %s sqthe old repository will not be deleted; remove it to free up disk space once the upgraded repository is verified )2Z unfilteredr1UPGRADE_ALL_REVLOGSanyr(rrdiscardrrrZAbortrrtrrr rTrWrUupdater2r+r/r.rr)rHrrextendRECLONES_REQUIREMENTSwarnrOrQrr6rZwlocklockr rr __class__r Z repositoryrrZrmtreequiet)'rWrrunoptimizeZbackupr rrZ specentriesZ specifiedrZenabled__Z missingreqsZ blockedreqsZ noremovereqsZ noaddreqsZunsupportedreqsZalloptimizationsrrr~rrZ incompatiblerrrrrOZ onlydefaultrrZunusedoptimizeZupgradeactionsZtmppathrZrepouirr)rrrrWrr upgraderepous                        F   r)FNTNN)CZ __future__rrZi18nrr rrrrr r r r rrrrrrZutilsrr!rrrr+r.r/r2rProbjectr3rGrJrKrSr\r^r_r`rarbrcrdrlrwrrrrrrrrr frozensetrrrrrrrrrrrrs   < ,$&![# b   x