Refresh benchmark comparison against current alloy 1.6/2.0#77
Conversation
The published numbers dated from March against alloy 0.8/0.6. Upgrade the bench harness (alloy-primitives/sol-types/dyn-abi 1.6.0, alloy-consensus/signer/network 2.0.5, alloy-rlp 0.3.15; no source changes needed) and re-run the full comparison on Zig 0.16.0. New honest score: eth-zig 18/26, alloy 5/26, 3 tied (was 23/26 -- alloy improved on mid-size keccak, hex/address parsing, and the uniswapv4 swap path). Biggest verified wins: RLP EIP-1559 encode 24.33x, ABI dynamic decode 8.41x, secp256k1 recovery 4.23x, signing 2.34x, u256 div 3.43x. Updated every public claim: README hero/tables, docs benchmarks, introduction, comparison, faq pages, the SEO description in layout.tsx (still said 19/26), and bench/RESULTS.md (full new table, versions, date, machine; March run kept as a dated historical note).
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
Caution Review failedPull request was closed or merged during review No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Run ID: 📒 Files selected for processing (9)
📝 WalkthroughWalkthroughThis PR refreshes eth.zig's public benchmark positioning by upgrading the benchmark harness to newer Alloy crate versions (1.6/2.0), running a new comparative benchmark, and updating all marketing, documentation, and metadata to reflect the refreshed results and performance claims (18 of 26 benchmarks won). ChangesBenchmark Results Refresh
Estimated code review effort🎯 2 (Simple) | ⏱️ ~12 minutes Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches📝 Generate docstrings
🧪 Generate unit tests (beta)
Warning Review ran into problems🔥 ProblemsGit: Failed to clone repository. Please run the Comment |
What
Re-runs the eth-zig vs alloy comparison against current alloy (primitives/sol-types/dyn-abi 1.6.0, consensus/signer/network 2.0.5) on Zig 0.16.0, and updates every public claim to the new honest numbers.
New score: 18/26 wins, 5 losses, 3 ties (was 23/26 vs March's alloy 0.8/0.6)
Alloy improved on mid-size keccak (256B/1KB now ~tied), hex/address parsing, and uniswapv4 swap. eth-zig's headline wins grew: RLP EIP-1559 encode 24.33x, ABI dynamic decode 8.41x, secp256k1 sign+recover 4.23x, sign 2.34x, u256 div 3.43x.
Changes
bench/alloy-bench/Cargo.toml: major-version bumps (benches compiled with zero source changes)bench/RESULTS.md: full new 26-row table with versions, date (2026-06-10), machine; March run preserved as a dated historical notebenchmarks/introduction/comparison/faqpages, and the SEO description inlayout.tsx(still claimed 19/26) all updated — no stale ratio left outside immutable CHANGELOG historyVerification
compare.sh+compare_u256.shcomplete runs (logs preserved); numbers copied verbatimzig build test(0.16.0) andpnpm -C docs buildpass🤖 Generated with Claude Code
Summary by CodeRabbit
Documentation
Chores