Question about the evaluation code.

[HYeCao]

Could you provide the evaluation python files? like "run.py"

[shamy1997]

same question～

[xingyuanbu]

@HYeCao @shamy1997

Hi,

As we have integrated our MT-Bench-101 benchmark into our forked OpenCompass. The evaluation python code can be found in opencompass/run.py.

You can follow the Installation Section of the README.md.

Thank you.

[HYeCao]

I have follow the instruction. but I meet these errors.

[xingyuanbu]

I have follow the instruction. but I meet these errors.

It seems you encounter some bugs with your Env and OpenCompass. Please refer to the official issue record of OpenCompass.
open-compass/opencompass#1040
open-compass/opencompass#1168

And you can do some searching and debugging by yourself, have a good journey.

Best,

[jsj2024]

I have follow the instruction. but I meet these errors.

Hello，I met the same question, Have you solved this problem now?