Skip to content

Profile Example 07 GEMM All-Scatter with IntelliKit Metrix - #92

Draft
JoseSantosAMD with Copilot wants to merge 4 commits into
JoseSantosAMD/intellikitfrom
copilot/sub-pr-24-faa22d09-2466-4e47-86c8-a440a2100c67
Draft

Profile Example 07 GEMM All-Scatter with IntelliKit Metrix#92
JoseSantosAMD with Copilot wants to merge 4 commits into
JoseSantosAMD/intellikitfrom
copilot/sub-pr-24-faa22d09-2466-4e47-86c8-a440a2100c67

Conversation

Copilot AI commented Mar 12, 2026

Copy link
Copy Markdown

Runs the GEMM all-scatter benchmark (Example 07) on 2× MI300X GPUs and captures memory + compute metrics via IntelliKit Metrix.

Results

Throughput (fp16, 2 GPUs):

Shape TFLOPS Latency
4096×2048×4096 146.5 0.469 ms
8192×4608×36864 (default) 611.8 4.549 ms

persistent_gemm_all_scatter kernel metrics (M=4096, N=2048, K=4096, 3-replay avg):

Metric Value
Kernel duration 602.9 µs avg (301–1177 range)
L1 / L2 hit rate 66.7% / 72.0%
HBM arithmetic intensity ~1206 FLOP/byte — compute-bound
Coalescing efficiency 25% — optimization opportunity
LDS bank conflicts 0

Changes

  • profiling/profile_with_metrix.py — reusable script that runs memory + compute Metrix profiles against the benchmark and emits a merged JSON report
  • profiling/metrix_profiling_results.json — captured results from MI300X
  • .gitignore — allow examples/**/profiling/*.json to be tracked

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Copilot AI and others added 3 commits March 12, 2026 21:10
…t profiling

Co-authored-by: JoseSantosAMD <87447437+JoseSantosAMD@users.noreply.github.com>
…mark

Co-authored-by: JoseSantosAMD <87447437+JoseSantosAMD@users.noreply.github.com>
…iling results

Co-authored-by: JoseSantosAMD <87447437+JoseSantosAMD@users.noreply.github.com>
Copilot AI changed the title [WIP] Add intellikit Profile Example 07 GEMM All-Scatter with IntelliKit Metrix Mar 12, 2026
Copilot AI requested a review from JoseSantosAMD March 12, 2026 21:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants