[AMD][MI355X] Add DSv4 FP4 agentic MTP recipe with DPA tuning - #2254

Open

seungrokj wants to merge 50 commits into

mainfrom

amd/agentx_dsv4_sgl_mtp_0717

Commits on Jul 20, 2026

[AMD][MI355X] Add DSv4 FP4 agentic MTP recipe with DPA tuning

seungrokj
and
claude
committed
fix(changelog): add pr-link for dsv4-fp4-mi355x-sglang-agentic-mtp entry

seungrokj
and
claude
committed
fix(changelog): trim verbose description for agentic-mtp entry

seungrokj
and
claude
committed
fix(config): remove duplicate dsv4-fp4-mi355x-sglang-agentic-hicache entry

seungrokj
and
claude
committed
fix(validation): add run-eval/eval-only fields to agentic matrix entries

seungrokj
and
claude
committed
fix(agentic-mtp): tune DPA memory, prefill chunk, and batch sizing

seungrokj
and
claude
committed
fix(agentic-mtp): revert mem_fraction_static override, narrow sweep to c48

seungrokj
and
claude
committed
fix(agentic-mtp): stop dividing CUDA_GRAPH_MAX_BS by TP for DPA

seungrokj
and
claude
committed
fix(agentic-mtp): restore MAX_RUNNING_REQUESTS to 2*CONC

seungrokj
and
claude
committed
fix(agentic-mtp): reduce chunked prefill back to 8K per scheduler

seungrokj
and
claude
committed
fix(agentic-mtp): restore GPU_MAX_HW_QUEUES=5 for ROCm overlap

seungrokj
and
claude
committed
fix(agentic-mtp): clean up script to match ref, expand sweep concurrencies

seungrokj
and
claude
committed
fix(validation): remove run_eval/eval_only from MultiNodeAgenticMatrixEntry

seungrokj
and
claude
committed
fix(agentic-mtp): add MAX_RUNNING_REQUESTS=2*CONC with comment

seungrokj
and
claude
committed
fix(agentic-mtp): drop c52 from sweep to avoid GPU OOM

seungrokj
and
claude
committed
feat(agentic-mtp): add cache metrics capture and eval-only support

seungrokj
and
claude
committed
fix(agentic-mtp): disable default thinking to avoid context overflow

seungrokj
and
claude
committed
fix(agentic-mtp): also disable reasoning_effort=high

seungrokj
and
claude
committed

Commits on Jul 22, 2026

Commits on Jul 23, 2026

Merge branch 'main' of https://github.com/SemiAnalysisAI/InferenceX into amd/agentx_dsv4_sgl_mtp_0717
seungrokj
committed

Commits on Jul 26, 2026

Merge branch 'main' into amd/agentx_dsv4_sgl_mtp_0717
seungrokj
authored

Commits on Jul 28, 2026

Commits on Jul 29, 2026

[AMD] [AGENTX] dsv4-fp4-mi355x-sglang-agentic-mtp: drop TP8 dp-off conc 1,2 arm

seungrokj
and
claude
committed

Commits on Jul 30, 2026