Pinned Loading

1. Distributed-LLM-Training-Benchmark-Framework Distributed-LLM-Training-Benchmark-Framework Public

   Production-Ready Performance Analysis for PyTorch DDP, FSDP, and DeepSpeed on Oracle Cloud Infrastructure

   Python 2

2. IBM-Fusion-HCI-OpenShift-LLM-Benchmarking-Suite IBM-Fusion-HCI-OpenShift-LLM-Benchmarking-Suite Public

   A comprehensive benchmarking suite for comparing LLM inference performance across vLLM, NVIDIA Triton, and HuggingFace TGI on IBM Fusion HCI OpenShift clusters with NVIDIA A100 GPUs.

   Python

3. LLM-Observability-Stack LLM-Observability-Stack Public

   A comprehensive observability stack for monitoring LLM inference and training workloads on Kubernetes with NVIDIA GPUs. This project provides Prometheus metrics collection, Grafana dashboards, GPU …

   Python 7 4

4. llm-serving-benchmark llm-serving-benchmark Public

   A comprehensive benchmarking suite for evaluating LLM inference frameworks on Kubernetes. Compare NVIDIA NIM (TensorRT-LLM), vLLM (PagedAttention), SGLang (RadixAttention), and HuggingFace TGI (Fla…

   Python

5. LLM-Training-Parallelism-Strategy-Guide-and-NCCL-Communication-Patterns LLM-Training-Parallelism-Strategy-Guide-and-NCCL-Communication-Patterns Public

   A practical guide for selecting the right parallelism strategy for Large Language Model (LLM) training. This project provides hands-on experiments, performance analysis, and decision guidelines to …

   Python 1

6. NVIDIA-cuOpt-on-OCI-EV-Fleet-Optimization-Framework NVIDIA-cuOpt-on-OCI-EV-Fleet-Optimization-Framework Public

   This repository provides a complete framework for deploying and benchmarking **NVIDIA cuOpt** on **Oracle Cloud Infrastructure (OCI)** for Electric Vehicle (EV) fleet optimization, this framework d…

   Python 1