Skip to content

feat: add xorazm-text2sql-0.8b model results to benchmark tables - #210

Open
shakha-de wants to merge 1 commit into
bird-bench:mainfrom
shakha-de:main
Open

feat: add xorazm-text2sql-0.8b model results to benchmark tables#210
shakha-de wants to merge 1 commit into
bird-bench:mainfrom
shakha-de:main

Conversation

@shakha-de

Copy link
Copy Markdown

No description provided.

@shakha-de

Copy link
Copy Markdown
Author

Leaderboard Entry

Model Name: xorazm-text2sql-0.8b
Team / Affiliation: Martin Luther University Halle-Wittenberg
Track: Overall/single model
Model Size: 0.8B
Oracle Knowledge: No
Dev EX: 53.91%
Test EX: 59.59%
Test R-VES: 53.43%

Changes

Added our evaluated submission to:

Overall Leaderboard - Execution Accuracy (EX), Reward-based Valid Efficiency Score (R-VES)
Single Model Leaderboard - Execution Accuracy (EX)

The test results were evaluated and confirmed by the BIRD team via email.

According to our mail from the BIRD team, this submission belongs to the Overall Track and single model track, as its only 0.8b model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant