Skip to content

Latest commit

 

History

History
38 lines (27 loc) · 1.21 KB

File metadata and controls

38 lines (27 loc) · 1.21 KB

Example: Code Optimization

Goal: optimize sort.py so sorting 1,000,000 integers runs below 0.5 seconds while preserving correctness.

Field Value
Metric Median runtime in seconds (median_time_s, minimize)
Evaluator python benchmark.py
Baseline 2.117478s
Best result 0.150459s
Iterations logged 8
Visual result results.png

Expected Output

This example demonstrates the standard autoresearch artifact bundle:

Reproduce the Evaluator

From this directory:

python benchmark.py

The evaluator emits the mechanical contract used by the skill:

{"pass": true, "score": -0.150459}

For minimize metrics, score is the negated metric value so higher scores are always better.