Skip to content

Add IntelliKit Metrix profiling script for Example 7 (GEMM all-scatter) - #91

Draft
JoseSantosAMD with Copilot wants to merge 2 commits into
JoseSantosAMD/intellikitfrom
copilot/sub-pr-24-0e903291-1d9e-40b8-bff4-00e26f9198fd
Draft

Add IntelliKit Metrix profiling script for Example 7 (GEMM all-scatter)#91
JoseSantosAMD with Copilot wants to merge 2 commits into
JoseSantosAMD/intellikitfrom
copilot/sub-pr-24-0e903291-1d9e-40b8-bff4-00e26f9198fd

Conversation

Copilot AI commented Mar 12, 2026

Copy link
Copy Markdown

Adds a standalone IntelliKit Metrix profiling wrapper for the GEMM all-scatter benchmark to collect GPU hardware metrics (HBM bandwidth, cache hit rates, compute throughput, arithmetic intensity).

Changes

  • examples/07_gemm_all_scatter/profile_intellikit.py: New script that runs benchmark.py under IntelliKit Metrix via torchrun, exposes all benchmark parameters plus Metrix-specific options, and prints grouped metric results with min/max/avg statistics

Usage

# All metrics, 2 GPUs
python examples/07_gemm_all_scatter/profile_intellikit.py --num_ranks 2

# Memory preset, filter to GEMM kernels, save to JSON
python examples/07_gemm_all_scatter/profile_intellikit.py --num_ranks 2 \
    --profile memory --kernel gemm --output profile.json

# Custom metrics
python examples/07_gemm_all_scatter/profile_intellikit.py --num_ranks 2 \
    --metrics memory.hbm_bandwidth_utilization,compute.hbm_gflops,memory.l2_hit_rate

# Timing only (no hardware counter overhead)
python examples/07_gemm_all_scatter/profile_intellikit.py --num_ranks 2 --time_only

Output is grouped by metric category (COMPUTE, MEMORY) per kernel, with optional export to JSON, CSV, or plain text.


🔒 GitHub Advanced Security automatically protects Copilot coding agent pull requests. You can protect all pull requests by enabling Advanced Security for your repositories. Learn more about Advanced Security.

… benchmark

Co-authored-by: JoseSantosAMD <87447437+JoseSantosAMD@users.noreply.github.com>
Copilot AI changed the title [WIP] Add IntelliKit Add IntelliKit Metrix profiling script for Example 7 (GEMM all-scatter) Mar 12, 2026
Copilot AI requested a review from JoseSantosAMD March 12, 2026 20:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants