nvidia-triton

OpenAI-compatible gateway for NVIDIA Triton and vLLM with tools, multimodal inputs, embeddings, reranking, and observability.

Web UI for NVIDIA Triton Inference Server on Kubernetes

A repository demonstrating deploying ML models using Triton + FastAPI + Docker

Hub with hands-on resources on building Computer Vision and Deep Learning solutions that process Video/Image data.

Model Deployment Operator is a prototype system designed to automate the deployment and management of Nvidia Triton models on Kubernetes

Benchmarking, optimising and serving the TabFM tabular foundation model online: exact KV cache, torch.compile, FastAPI, Triton, KServe on kind and GKE

CVE-2026-24207 — NVIDIA Triton SageMaker auth bypass to unauth RCE. Detection script, bypass demo, RCE-chain PoC, and IDS rules.

"A practical guide to NLP model optimization and serving with NVIDIA Triton." / "실습으로 익히는 고성능 NLP 모델 최적화 및 NVIDIA Triton 서버 배포."

Camera-only 3D object detection for autonomous driving. Six cameras to a bird's-eye-view map, optimised with TensorRT and served through NVIDIA Triton.

🚀 This repository contains the NVIDIA Triton Inference Server configuration for serving the AgriBERT model (recobo/agriculture-bert-uncased) using the PyTorch LibTorch backend 🧠⚙️, focusing on the config.pbtxt that defines the model’s inputs, outputs, and execution settings required for deployment on Triton 🖥️🔥.

A complete object detection pipeline using NVIDIA Triton Inference Server with YOLOv11 model.

NVIDIA Triton Inference Server control plane — model repository manipulation, VRAM monitoring, and inference over gRPC via FastMCP 3.2

Nvidia Triton server gRPC client for Node

End-to-end ML inference benchmark comparing PyTorch FP32, ONNX FP32, and ONNX INT8 on CIFAR-10, with NVIDIA Triton deployment, latency, throughput, accuracy, and model-size analysis.

Reference architecture for multimodal gaming AI using NVIDIA Triton Inference Server and Kubernetes

A repository for A.I. projects

GPU-accelerated computer vision for semiconductor wafer defect detection using YOLOv8-L, TensorRT, Triton, and MLOps