Repository navigation
refactor!: keep downloads, results and runs in one depot - #51
Merged
Merged
Conversation
`[paths] depot` (`--depot`, `NNNOTES_PATHS_DEPOT`) names one directory for everything a configuration reads and computes: - `downloads/`: the game files as downloaded, under their own names (catalogs, decrypted bundles, raw CDN files, files read from the APK, one directory per catalog source); - `cas/`, `ac/`, `inputs/`, `catalogs/`, `runs/` and `costs/`: the results of the stages by content, their task results, input identities, catalog versions and run manifests. The `depot` command group replaces the `store` group and adds `depot gc`, which removes the runs, results and contents that no kept run reaches (`--keep N` latest runs per selection, `--dry-run`). Task inputs locate their bytes with the locator kinds `depot`, `download` (a path in `downloads/`), `file` and `catalog`. The catalog API speaks of downloads: `Catalog(catalog_bytes, download_dir)`, `Catalog.downloaded`, `Catalog.downloaded_raw`, `Catalog.file_name`, `jp.Source.download_dir`, and `jp.open_catalog` takes the downloads directory. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The evaluation script reads and writes a depot (`--base DEPOT`, `--depot D`) like the commands do. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
[paths] depot(--depot,NNNOTES_PATHS_DEPOT) names one directory:downloads/holds the game files as downloaded, under their own names;cas/,ac/,inputs/,catalogs/,runs/andcosts/hold the results of the stages, task results, input identities, catalog versions and run manifests.depotcommand group (plan,run,verify) replaces thestoregroup, anddepot gcremoves the runs, results and contents no kept run reaches (--keep N,--dry-run).depot,download(a path indownloads/),file,catalog.download_dir,downloaded,downloaded_raw,file_name);jp.open_catalogtakes the downloads directory.depot gc), contracts (Depot), JP, README tables;docs/cli.mdregenerated.Test plan
pytest(whole suite, synthetic fixtures)ruff check,ruff format --checkdepot gc: kept runs and their results, contents and layout files stay;--keep,--dry-run, the latest run of a selectionCo-Authored-By: Claude Opus 5.5 noreply@anthropic.com