o ưiv_@sddlZddlZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z ddl m Z de edefdd Zdefd d Zdefd d ZGdddZdS)N)datetime)Path)Optional)loggervaluereturncCs|durdS|dvS)NF)true1tyyes)lower)rrQ/home/app/Keep/.python/lib/python3.10/site-packages/litellm_proxy_extras/utils.py str_to_bools rcCs4tj}ttdrd|d<tdd|d<|S)zJGet environment variables for Prisma, handling offline mode if configured.PRISMA_OFFLINE_MODErZNPM_CONFIG_PREFER_OFFLINEZNPM_CONFIG_CACHEz/app/.cache/npm)osenvironcopyrgetenv) prisma_envrrr_get_prisma_envs rcCsvttdr9d}td}|r tj|r td||Stj|r0td||Std|ddS) zHGet the Prisma command to use, bypassing Python wrapper in offline mode.rz;/app/.cache/prisma-python/binaries/node_modules/.bin/prismaZPRISMA_CLI_PATHzUsing custom Prisma CLI at zUsing cached Prisma CLI at zPrisma CLI not found at z8. Falling back to Python wrapper (may attempt downloads)Zprisma)rrrpathexistsrinfowarning)Zdefault_cli_pathZcustom_cli_pathrrr_get_prisma_command!s   rc@seZdZedefddZededefddZededefdd Z ed efd d Z ed efd dZ ededefddZ ededefddZ e ddededefddZeddedefddZdS)ProxyExtrasDBManagerrcCstd}tjt}|rHtj|r@t|D]%}tj||}tj||}tj|r7t j ||ddqt ||q|St |||S|S)z Get the path to the migrations directory Set os.environ["LITELLM_MIGRATION_DIR"] to a custom migrations directory, to support baselining db in read-only fs. ZLITELLM_MIGRATION_DIRT) dirs_exist_ok) rrrdirname__file__rlistdirjoinisdirshutilcopytreecopy2)Zcustom_migrations_dirZpkg_migrations_diritemZsrc_pathZdst_pathrrr_get_prisma_dir=s     z$ProxyExtrasDBManager._get_prisma_dir schema_pathc Cst}t|}|dd}|jdddtd}|s#tddSt}z5t d|d }t j t d d d d |dgt |ddd|dt dt j t d dddgdd|dWdSt jyktdYdSt jy}ztd|d|jd|j|d}~ww)z4Create a baseline migration for an existing database migrationsZ0_initTparentsexist_ok DATABASE_URLDATABASE_URL not setFz Generating baseline migration... migration.sqlmigratediffz --from-emptyz--to-url--scriptw)stdoutchecktimeoutenvz(Marking baseline migration as applied...resolve --applied)r7r8r9z=Migration timed out - the database might be under heavy load.z#Error creating baseline migration: z, N)rr(rmkdirrrrerrorrr subprocessrunropenTimeoutExpiredrCalledProcessErrorstderrr6)r)Z prisma_dirZprisma_dir_pathZinit_dir database_urlrZmigration_fileerrr_create_baseline_migrationXsf       z/ProxyExtrasDBManager._create_baseline_migrationmigrations_dircCs8t|d}tdt|d|dd|DS)zsz=ProxyExtrasDBManager._get_migration_names..)globrrlen)rGZmigration_pathsrrr_get_migration_namessz)ProxyExtrasDBManager._get_migration_namesmigration_namecC*t}tjtddd|gddd|ddS)z(Mark a specific migration as rolled backr1r: --rolled-back<Tr8r7capture_outputr9Nrr>r?rrPrrrr_roll_back_migrations z)ProxyExtrasDBManager._roll_back_migrationcCrQ)z$Mark a specific migration as appliedr1r:r;rSTrTNrVrWrrr_resolve_specific_migrations z0ProxyExtrasDBManager._resolve_specific_migration error_messagecC,gd}|D] }t||tjrdSqdS)aw Check if the error message indicates a database permission error. Permission errors should NOT be marked as applied, as the migration did not actually execute successfully. Args: error_message: The error message from Prisma migrate Returns: bool: True if this is a permission error, False otherwise )zDatabase error code: 42501zmust be owner of tablezpermission denied for schemazpermission denied for tablezmust be owner of schemaTFresearch IGNORECASE)rZZpermission_patternspatternrrr_is_permission_errors z)ProxyExtrasDBManager._is_permission_errorcCr[)a Check if the error message indicates an idempotent operation error. Idempotent errors (like "column already exists") mean the migration has effectively already been applied, so it's safe to mark as applied. Args: error_message: The error message from Prisma migrate Returns: bool: True if this is an idempotent error, False otherwise )zalready existszcolumn .* already existszduplicate key value violateszrelation .* already existszconstraint .* already existszdoes not existz.Can't drop database.* because it doesn't existTFr\)rZZidempotent_patternsr`rrr_is_idempotent_errors  z)ProxyExtrasDBManager._is_idempotent_errorTmark_all_appliedc Cstd}|stddSt|dtdd}z |jdddWn$t yK}zd t |vrEt d |d WYd}~dS|d}~ww|d }z0t d t |d}tjtddd|d|dgdd|tdWdn1szwYWn*tjy}zt d|jWYd}~nd}~wtjyt dYnw|st ddSt d|z+t dtjtdddt |d|gddddtd}t d |jt d!Wn,tjy}zt d"|jWYd}~nd}~wtjyt d#Ynw|sdSt|} t d$t| d%| D]N} z%t d&| tjtdd'd(| gddddtdtd)| Wq-tjy{}zd*|jvrpt d+| d,|jWYd}~q-d}~wwdS)-z 1. Compare the current database state to schema.prisma and generate a migration for the diff. 2. Run prisma migrate deploy to apply any pending migrations. 3. Mark all existing migrations as applied. r.r/Nr*z %Y%m%d%H%M%SZ_baseline_diffTr+zPermission deniedzPermission denied - zt unable to baseline db. Set LITELLM_MIGRATION_DIR environment variable to a writable directory to enable migrations.r0z9Generating migration diff between DB and schema.prisma...r4r1r2z --from-urlz--to-schema-datamodelr3rS)r7r8r6r9z#Failed to generate migration diff: z$Migration diff generation timed out.zMigration diff was not createdzMigration diff created at z8Running prisma db execute to apply the migration diff...dbexecutez--filez--schemar8r7rUtextr9zprisma db execute stdout: u'✅ Migration diff applied successfullyz Failed to apply migration diff: z%Migration diff application timed out.z Resolving z migrationszResolving migration: r:r;zResolved migration: z/is already recorded as applied in the database.zFailed to resolve migration z: )rrrr=rrnowstrftimer< Exceptionstrrrr@r>r?rrrBrCrArr6rrOrNdebug) rGr)rcrDZdiff_dirrEZ diff_sql_pathfresultZmigration_namesrPrrr_resolve_all_migrationss            z,ProxyExtrasDBManager._resolve_all_migrationsF use_migratec Cstd}tdD];}t}t}t|z%z|rtdz;tj t ddgddddt d}td |j td td tj ||d d tdWWWt|dStjy}zYtd|jd|j d|jvrtd|j}|r|d}t|jrtd|dt|t|td|dWYd}~WWt|dStd|dtj t ddd|gddddt dtd|dnd|jvrd|jvrtd t|td!t ||td"WYd}~WWt|dSd#|jvrt|jrytd$|j}|r3|dnd%} td&| d'|j|rpzt| td| d(Wntyo} ztd)| WYd} ~ nd} ~ wwtd*| d+|t|jrtd,td$|j}|r|d} td-| t| td.| d/t| td0n td1|jWYd}~nd}~wwtj t d2d3d4gddd5WWt|dSWnWtjytd6|dd7tt d8d9Yn9tjy9}z+d:|} | d;krd<| d=nd>} td?|d@| tt d8d9WYd}~nd}~wwWt|q t|wd S)Aa} Set up the database using either prisma migrate or prisma db push Uses migrations from litellm-proxy-extras package Args: schema_path (str): Path to the Prisma schema file use_migrate (bool): Whether to use prisma migrate instead of db push Returns: bool: True if setup was successful, False otherwise z/schema.prismazRunning prisma migrate deployr1ZdeployrSTrfzprisma migrate deploy stdout: zprisma migrate deploy completedz&Running post-migration sanity check...F)rcu)✅ Post-migration sanity check completedzprisma db error: z, e: ZP3009z`(\d+_.*)` migrationz Migration zS failed due to idempotent error (e.g., column already exists), resolving as appliedu✅ Migration z resolved.NzFound failed migration: z, marking as rolled backr:rRz" marked as rolled back... retryingZP3005zdatabase schema is not emptyaDatabase schema is not empty, creating baseline migration. In read-only file system, please set an environment variable `LITELLM_MIGRATION_DIR` to a writable directory to enable migrations. Learn more - https://docs.litellm.ai/docs/proxy/prod#read-only-file-systemz4Baseline migration created, resolving all migrationsu✅ All migrations resolved.ZP3018zMigration name: (\d+_.*)unknownu❌ Migration zW failed due to insufficient permissions. Please check database user privileges. Error: z marked as rolled backz)Failed to mark migration as rolled back: z4Migration failed due to permission error. Migration zH was NOT applied. Please grant necessary database permissions and retry.z\Migration failed due to idempotent error (e.g., column already exists), resolving as appliedzRolling back migration zResolving migration z+ that failed due to existing schema objectsu✅ Migration resolved.zYP3018 error encountered but could not classify as permission or idempotent error. Error: rdpushz--accept-data-loss)r8r7zAttempt z timed outrz Retrying... (z attempts left)z(The process failed to execute. Details: .)!rr(rangergetcwdchdirrrr>r?rrr6rorBrCr]r^grouprbrXrYrFrar=rjr RuntimeErrorrAtimesleeprandom randrange) rpr)attemptZ original_dirrGrnrEZmigration_matchZfailed_migrationrPZrollback_errorZ attempts_leftZ retry_msgrrrsetup_databasejsr                     _            z#ProxyExtrasDBManager.setup_databaseN)T)F)__name__ __module__ __qualname__ staticmethodrkr(boolrFlistrOrXrYrarbrorrrrrr<s4?  sr)rMrrr]r$r>rrpathlibrtypingrZlitellm_proxy_extras._loggingrrkrrdictrrrrrrrs