feat(scripts): curl-installer harvester to close the Linux-install gap#66
Merged
Conversation
240 cli-tool recipes install nothing on a Homebrew-less Linux box — their
only methods are brew/winget, so every guard fails and bootstrap dead-ends
(the ollama bug, registry-wide). This adds the maintainer helper that closes
the mechanical subset, in the same "propose, a human merges" idiom as the
winget harvester.
scripts/curl_candidates.py proposes an official `curl | sh` installer for
each Linux-gapped, curl-less row whose id is in a vetted KNOWN_INSTALLERS
allowlist. Unlike winget there's no authoritative catalog and a wrong
installer runs the WRONG software, so this is deliberately an allowlist (not
a repo-probing guess); each URL was confirmed to serve a real script. Every
proposal is corroborated against the row's `gh`:
high URL served from the tool's own repo (raw.githubusercontent.com/
owner/repo/...) or a domain matching the gh owner/repo
medium a plausible official domain that doesn't corroborate — eyeball it
Only gapped rows lacking a curl key are proposed (idempotent); `--apply`
stages keys into recipe_data.py for git review. Stdlib only.
Also add a `curl_shell` field to the generator (gen_recipes.py) so bash-only
install scripts render `| bash` instead of `| sh` (default stays sh).
Seeded allowlist (10, all HIGH, verified 200 + shebang): deno, chezmoi,
tailscale, pulumi, golangci-lint, trivy (sh) and rclone, k3d, direnv, volta
(bash). Not yet backfilled into recipe_data.py — left for review. Lint green
(520), pytest 3645 passed (25 new).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The gap
240 cli-tool recipes install nothing on a Homebrew-less Linux box — their only methods are
brew/winget, so every guard fails and bootstrap dead-ends. That was theollamabug (#65), registry-wide.What this adds
scripts/curl_candidates.py— the maintainer helper that closes the mechanical subset, in the same propose → review → merge idiom aswinget_candidates.py.For each Linux-gapped, curl-less row whose id is in a vetted
KNOWN_INSTALLERSallowlist, it proposes the official install script. Unlike winget there's no authoritative catalog, and a wrong installer runs the wrong software — so this is deliberately an allowlist, not a repo-probing guess. Every URL was confirmed to serve a real script (HTTP 200 + shebang). Each proposal is corroborated against the row'sgh:raw.githubusercontent.com/<owner>/<repo>/...), or a domain matching the gh owner/repo (e.g.deno.land~denoland/deno).Only gapped rows lacking a
curlkey are proposed (idempotent against prior backfills);--applystages keys intorecipe_data.pyfor git review.Generator
Adds a
curl_shellfield togen_recipes.pyso bash-only scripts render| bashinstead of| sh(default stayssh) — needed because ~40% of official installers require bash.Seeded allowlist (10, all HIGH, verified)
sh: deno, chezmoi, tailscale, pulumi, golangci-lint, trivybash: rclone, k3d, direnv, voltaNot yet backfilled into
recipe_data.py— left for your review (run--apply, thengen_recipes.py --rewrite). The remaining ~230 gapped tools need per-tool decisions (system package managers like apt/dnf, or GitHub-release binaries) that this curl harvester intentionally doesn't guess at.Tests
tests/test_curl_candidates.py— 25 tests pinning the gap filter, the corroboration tiers (the security-relevant surface), idempotency, andapply_proposalsstaging. No network (allowlist is static). Full suite: 3645 passed, lint clean across 520 recipes.🤖 Generated with Claude Code