Skip to content

v1.0.0 Roadmap #321

Description

@jjk-g

P0

  • [Feature] Multi-Modal Inference Benchmarking
  • [Feature] HF OTel trace loading (IBM OSS)
  • [Testing] Identify Testing gaps and create test plan
  • [UX] Image & Helm Chart published in k8s Add inference-perf promoter manifests kubernetes/k8s.io#9267
  • [UX] User Guides & Docs
  • [Metrics] Standard Report Format
  • [Release] 1.0.0 Blog Post
  • [Release] Release Cadence Definition

P1

  • [UX] Provide several agent skills that apply our best practices and common patterns
  • [Process] Added Repo roles for active contributors
  • [UX] Feature parity in llm-d-benchmark

P2

  • [Loadgen] Distributed Loadgen (Inference-perf-engine; Production Scale Loadgen)
  • [Metrics] GPU utilization / other hardware metrics from Prometheus

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions