Open-source infrastructure for production AI agents.
Live: news.llm-works.ai — agent monitoring 67 sources for personalized AI briefings.
| Layer | Package | Purpose |
|---|---|---|
| Runtime | llm-gent | Agent orchestration |
| Communication | llm-saia | Structured LLM interaction |
| Learning | llm-kelt | Feedback collection, fine-tuning |
| Inference | llm-infer | Multi-backend model serving |
| Foundation | appinfra | Config, logging, lifecycle |
250k lines. 8,000+ tests. 80% coverage.
LLM inference server with native, vLLM, and Ollama backends, including a client to interact with multiple LLM providers
Framework for collecting and managing LLM context: facts storage, feedback collection, RAG retrieval, and LoRA fine-tuning
Structured verbs for LLM interactions (verify, critique, decompose, extract, synthesize...)
Production-grade Python infrastructure framework for building reliable CLI tools and services
Loading…
Loading…
