AI Observability & Evaluation
Evaluation and Tracking for LLM Experiments and AI Agents
本地监控 + AI 视觉 — LAN-based smartphone-powered AI monitoring framework with structured event output for data acquisition and analysis.
Stop AI agents from doing things you didn't ask for.
React components for visualizing traces from AI agents
g4f-working is a daily-updated list of working no-auth AI providers and models from @xtekky/gpt4free. It helps developers, testers, and AI enthusiasts instantly find which models are currently online and accessible without any API keys, tokens, or cookies.
A comprehensive solution for monitoring your AI models in production
Runtime security monitoring and control for AI agents. Catches malicious tool use, prompt injection, and policy drift in real time, before the agent acts.
A Python client to interact with Arize API
Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.
AI-powered online exam proctoring system that detects suspicious activities using computer vision. Tracks eye movements, face presence, multiple faces, and talking during exams with real-time alerts and dashboard.
Monitor how AI systems perceive and recommend your software across GPT, Claude, Gemini, and more.
Laravel AI Guard 🛡️💰🤖 - Control and optimize AI costs in Laravel AI SDK applications 🚀 Track OpenAI & LLM token usage 📊, estimate AI costs before execution
Autonomous AI infrastructure monitoring using Hermes Agent. Cron-based research ingestion, cost forecasting, and headless systemd deployment.
AI-Powered Zabbix Monitoring with Google Gemini Seamlessly integrate Google Gemini AI into your Zabbix monitoring to get intelligent alert analysis, predictive insights, and automated troubleshooting suggestions
Production-ready Retrieval Augmented Generation (RAG) system with hybrid retrieval, advanced evaluation metrics, and monitoring. Build enterprise LLM applications with reduced hallucinations, better context management, and comprehensive observability.
Automatic Langfuse tracking for Claude Code
A Java client to interact with Arize API
Real-time monitoring dashboard for 33 AI services — uptime, latency, incidents, AIWatch Score reliability ranking.
Free open-source monitoring dashboard for OpenClaw AI agents — token usage, session tracking, 7-day trends, multi-model support
Add a description, image, and links to the ai-monitoring topic page so that developers can more easily learn about it.
To associate your repository with the ai-monitoring topic, visit your repo's landing page and select "manage topics."