feat(benchmark): benchmark suite + register_models export - #36

Open

ParamThakkar123 wants to merge 21 commits into

mainfrom

feature/benchmark-improvements

Commits on Jun 1, 2026

feat(benchmark): add benchmark module and export register_models; add tolerant comparator next
ParamThakkar123
committed
76c57a3
feat(benchmark): add tolerant DataFrame comparator for result comparison
ParamThakkar123
committed
ef0331c
scripts: add run_benchmark_llama.jl to run benchmark with llama model
ParamThakkar123
committed
b17a49b
scripts: accept cached dataset paths and avoid re-download when provided
ParamThakkar123
committed
f2d6659
scripts: remove DrWatson dependency and quickactivate
ParamThakkar123
committed
97c310a
scripts: fix HuggingFaceHub import (no syntax)
ParamThakkar123
committed
6ecd520
feat(progress): add progress callback support in Utils and report progress from benchmark
ParamThakkar123
committed
47b644f
chore: remove unnecessary try/catch uses in Utils and benchmark
ParamThakkar123
committed
98aba86
scripts: register console progress display and optional ProgressMeter integration
ParamThakkar123
committed
a86e3fd
feat(progress): console & ProgressMeter support + expose register_progress!/clear_progress! from HealthLLM; record per-example timings
ParamThakkar123
committed
5217c1d
scripts: require ProgressMeter and enable progress bar by default
ParamThakkar123
committed
d065328
scripts: detect dataset length and set ProgressMeter total exactly
ParamThakkar123
committed
233561e
scripts: remove try/catch when reading JSON array length
ParamThakkar123
committed
058d23d
fix: resolve merge conflicts in Project.toml
ParamThakkar123
committed
1a47f61
fix: resolve merge conflicts in HealthLLM.jl and utils.jl (merge origin/main)
ParamThakkar123
committed
3b04684
fix: relax Dates compat to 1.10 to match runtime
ParamThakkar123
committed
8a2becd

Commits on Jun 4, 2026

Commits on Jun 11, 2026

Added Benchmarking scripts
ParamThakkar123
committed
c91f629

Navigation Menu

Uh oh!

feat(benchmark): benchmark suite + register_models export - #36

feat(benchmark): benchmark suite + register_models export#36
ParamThakkar123 wants to merge 21 commits into
mainfrom
feature/benchmark-improvements

Commits on Jun 1, 2026

feat(benchmark): add benchmark module and export register_models; add tolerant comparator next

feat(benchmark): add tolerant DataFrame comparator for result comparison

scripts: add run_benchmark_llama.jl to run benchmark with llama model

scripts: accept cached dataset paths and avoid re-download when provided

scripts: remove DrWatson dependency and quickactivate

scripts: fix HuggingFaceHub import (no syntax)

feat(progress): add progress callback support in Utils and report progress from benchmark

chore: remove unnecessary try/catch uses in Utils and benchmark

scripts: register console progress display and optional ProgressMeter integration

feat(progress): console & ProgressMeter support + expose register_progress!/clear_progress! from HealthLLM; record per-example timings

scripts: require ProgressMeter and enable progress bar by default

scripts: detect dataset length and set ProgressMeter total exactly

scripts: remove try/catch when reading JSON array length

fix: resolve merge conflicts in Project.toml

fix: resolve merge conflicts in HealthLLM.jl and utils.jl (merge origin/main)

fix: relax Dates compat to 1.10 to match runtime

Commits on Jun 4, 2026

fix(utils): remove duplicate load_huggingface_model to avoid method overwrite during precompilation

docs: include Benchmark module in autodocs to document benchmark functions

Updates

Fixes coverage test

Commits on Jun 11, 2026

Added Benchmarking scripts