latency-benchmarking

Here are 3 public repositories matching this topic...

ShireenMeher / distributed_stock_trading_platform

Fault-tolerant distributed stock trading system in Python — Paxos consensus (Proposer/Acceptor/Learner, Prepare/Promise/Accept/Learn) across 3 replicated order service nodes for consistent transaction ordering under concurrent writes, partial failures, and leader crashes; LRU cache, Docker Compose, AWS load testing

Updated Mar 23, 2026
Python

GurutejaReddy-04 / ragpatrol

Star

Automated evaluation and observability harness for production RAG systems. Gates CI/CD against regressions with precision/recall/F1 scoring, dual-signal faithfulness auditing (embeddings + LLM judge), cold/warm latency profiling, and side-by-side configuration benchmarking.

python3 regression-testing ci-cd-pipeline gemini-api observability-data llm-evaluation-framework rag-pipeline retrieval-augmented-generation-rag faithfulness-metrics hallucination-detection-binary-logic llm-judges latency-benchmarking quality-gating

Updated Sep 8, 2026
Python

KhushiKeswani / vox

Star

CPU-only conversational voice assistant with VAD-based speech segmentation, streaming LLM response generation overlapped with concurrent TTS synthesis via producer-consumer queues. Batch STT (Whisper). Fully instrumented with per-stage latency benchmarking.

text-to-speech speech-to-text voice-assistant gemini-api voice-ai cpu-inference silero-vad whisper-ai piper-tts inference-engineering latency-benchmarking

Updated Sep 13, 2026
Python

Add this topic to your repo

To associate your repository with the latency-benchmarking topic, visit your repo's landing page and select "manage topics."

Learn more