Skip to content
teddytennantPublic

About

Kubernetes for agents

Resources

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

inlet

inlet

Gastown, reimagined. Kubernetes for AI agents.

curl -fsSL https://raw.githubusercontent.com/teddytennant/inlet/main/install.sh | sh
inlet init
inlet up
inlet add -w pi -g "fix the flaky test" --verify "cargo test"
inlet apply -f sweep.json
inlet get swarms

Say what should be running. inlet keeps it running: a failed task is tried again with the verifier's output in its prompt, a swarm is topped back up to its count, and a daemon killed with kill -9 comes back to the same running workers. Nothing waits on a person. docs/usage.md

{"kind": "swarm", "name": "sweep", "replicas": 4, "completions": 200,
 "template": {"worker": "prover", "goal": "attempt {index}", "verify": "./check"}}
  • one static binary, 3.18MB
  • scheduler, reconciler, ledger, token proxy, board, tui
  • 21,558 lines in src/
  • 2.5MB RSS, empty
  • 179 tests

Workers run in a cell. A spend is a ledger record. Any agent CLI is a worker: the prompt goes in by argument, stdin, or file, and inlet door run gives it the metered proxy as a base URL.

A 10,000-task swarm with one failure in ten and a kill -9 halfway: all done, nothing held, 15MB RSS, 65 tasks a second from first to last. Five hundred Pi agents, sixteen at a time in cells with no network, the daemon killed twice mid-run: 32 taken back, 500 done. Five hundred more on Grok 4.5 through the metered proxy, the daemon killed six times: 500 done, 1.9M tokens charged, nothing held. And five hundred on three replicas of the ledger with the leader killed six times: 500 done, and the leader's count of tokens and the node's the same to the token.

Other machines are nodes: the leader places tasks on them over ssh, and places them again when one goes dark. scripts/chaos.py kills the daemon at random under load and checks the books. Pi, Wizard, Crush, Hermes, and Claude Code all run as workers: docs/harnesses.md.

SPEC.md

one does not simply kill -9 the ledger

About

Kubernetes for agents

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages