openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

OpenLLMWiki: Docs of OpenLLMAI. Survey, reproduction and domain/task adaptation of open source chatgpt alternatives/implementations. PiXiu-貔貅 means fortune.

Self-hosted, Docker-first OpenAI-compatible LLM gateway with provider routing, fallbacks, API keys, and usage controls.

OpenLLM Monitor is a plug-and-play, real-time observability dashboard for monitoring and debugging LLM API calls across OpenAI, Ollama, OpenRouter, and more. Tracks tokens, latency, cost, retries, and lets you replay prompts — fully open-source and self-hostable.

Perform RAG (Retrieval-Augmented Generation) from your PDFs using this Colab notebook! Powered by Llama 2

LLM, Fine Tuning, Llama 2, Gemma, Mixtral, vLLM, LangChain, RAG, ChromaDB, FAISS

An offline AI chat application built specifically for Ubuntu Touch, allowing users to run lightweight Large Language Models (LLMs) directly on their mobile device.

NeuroSwift 1.0.0 is the world's most advanced MatMul-Free Hybrid State-Space Model (H-SSM). By integrating Dynamic Depth Scaling (DDS), Selective SSD (Mamba-2), and MLA (DeepSeek), it achieves the intelligence of the world's largest dense models with zero-latency CPU inference.

RAG with LlamaIndex and NVIDIA

Genify is a powerful and versatile API that leverages advanced language models, including Google's Gemini 1.5 Pro, LLAMA 3 and other cutting-edge technologies, to deliver a wide range of natural language processing capabilities

DeepSeek Harness (dsh) bundle: route the harness through OpenLLM (OpenAI-compatible) + register the OpenLLM MCP, with CLI/daemon onboarding.

Build fast neural network training with 100+ steps/sec on CPU using NeuroSwift's ternary and kernel-fused engine

Learn from YOUTUBE lengthy videos with effective Q & A

Selectia - A family of System One-style models fine-tuned from LFM 2.5, designed for one-pass typed decisions with calibrated probabilities. Decision API (Choice, Noul, Score) powered by open LLMs.

Masterclass on GraphRAG for Exploring Heterogeneous Medical Knowledge

Web for Selectia - A family of System One-style models fine-tuned from LFM 2.5, designed for one-pass typed decisions with calibrated probabilities.

ollama llm setup shell script for ubunta

Route LLM requests through a self-hosted, OpenAI-compatible gateway for local projects and team workflows.