Skip to content

Add SGLang and TRT-LLM configs for GreenNode runners #1

Description

@aistackdev

We only run vLLM today. Add SGLang and TRT-LLM equivalents so we can compare engines.

Hardware

  • 1× H100, 2× H100, 1× RTX 5090

Configs to add (in .github/configs/nvidia-master.yaml)

  • gptoss-fp4-h100-1x-sglang
  • dsr1qwen3-bf16-rtx5090-1x-sglang
  • dsr1qwen3-fp8-rtx5090-1x-sglang
  • TRT-LLM variants (check Blackwell consumer support first for 5090)

Each needs: config block + benchmark script + framework-appropriate image.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions