chore(adapters): bump eval-hub-sdk to v1.0.2 and fix compat issues - #123
Conversation
Bump eval-hub-sdk[adapter] to 1.0.2 across all 10 adapters and fix breaking changes introduced by the major version jump: - ragas, deepeval: remove auth_headers fallback — ModelCredentials dropped that attribute; api_key is the canonical field - mteb: rename "state" to "status" in test_local_hf.py to match the BenchmarkStatusEvent payload emitted by the SDK - clear: set OPENAI_API_KEY in test_clear_happy_path so _ensure_openai_api_key_for_litellm returns early instead of calling resolve_model_credentials with the placeholder secret_ref Assisted-by: Cursor Signed-off-by: Julian Payne <julpayne@redhat.com> Co-authored-by: Cursor <cursoragent@cursor.com>
|
Warning Review limit reached
Next review available in: 54 minutes Limit details: You’ve used the included review currently available. You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository. How can I continue?Wait for the limit to reset, then comment An organization admin can change what happens after included review limits in Billing. How do review limits work?CodeRabbit enforces per-developer PR review limits within each organization. For paid Pro and Pro+ reviews, CodeRabbit uses a developer's included PR review attempts over the past 7 days to set the current hourly allowance. At typical activity levels, the full plan allowance applies. Higher sustained activity can lower the allowance until earlier attempts leave the 7-day window. Please refer docs for additional details. Review details⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (14)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Summary
eval-hub-sdk[adapter]to v1.0.2 across all 10 adapterscreds.auth_headersfallback —ModelCredentialsdropped that attribute;api_keyis the canonical field"state"to"status"intest_local_hf.pyto match theBenchmarkStatusEventpayload emitted by the SDKOPENAI_API_KEYintest_clear_happy_pathso_ensure_openai_api_key_for_litellmreturns early instead of callingresolve_model_credentialswith the placeholdersecret_refThis is the base PR in a stack. The follow-up PR wires up
configure_telemetry()on top of these changes.Test plan
mainMade with Cursor