Skip to content

Add vivo BlueLM-3.6-35B-A3B-0806 to leaderboard - #1356

Open
liukira459-commits wants to merge 4 commits into
ShishirPatil:mainfrom
liukira459-commits:main
Open

Add vivo BlueLM-3.6-35B-A3B-0806 to leaderboard#1356
liukira459-commits wants to merge 4 commits into
ShishirPatil:mainfrom
liukira459-commits:main

Conversation

@liukira459-commits

Copy link
Copy Markdown

Summary

Add support for vivo's BlueLM-3.6-35B-A3B-0806 model to the Berkeley Function Calling Leaderboard.

Model Details

Field Value
Model Name BlueLM-3.6-35B-A3B-0806
Organization vivo
License Proprietary
Mode Function Calling (FC)
API Endpoint https://api-ai.vivo.com.cn/v1/completions
API Compatibility OpenAI-compatible (/v1/chat/completions)

Changes

  1. bfcl_eval/model_handler/api_inference/vivo.py (new file)

    • Created VivoAPIHandler inheriting from OpenAICompletionsHandler
    • Overrides __init__ to set is_fc_model=True and hardcode the vivo API base URL
    • Overrides _parse_query_response_FC to ensure multi-turn tool_calls format compatibility
    • Reads API key from VIVO_API_KEY environment variable
  2. bfcl_eval/constants/model_config.py

    • Added VivoAPIHandler import
    • Added BlueLM-3.6-35B-A3B-0806 entry in api_inference_model_map
  3. bfcl_eval/constants/supported_models.py

    • Added BlueLM-3.6-35B-A3B-0806 to SUPPORTED_MODELS

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant