Hi, I ran ChartQA-Test evaluation on OPPOer/AndesVL-0_6B-Instruct with provided code with provided package version And
CUDA=13.0
flash_attn=2.8.3
The performance i got is
-------------- -----
test_human 54.8
test_augmented 85.76
Overall **70.28**
-------------- -----
While the number reported in the paper is 78.2.
Is there any special specification to reproduce this result ?
Thx !
Hi, I ran ChartQA-Test evaluation on
OPPOer/AndesVL-0_6B-Instructwith provided code with provided package version AndThe performance i got is
While the number reported in the paper is 78.2.
Is there any special specification to reproduce this result ?
Thx !