Thank you for your impressive work! It has been really helpful for my ongoing research, but I encountered a couple of issues while trying to run the code that I hope you can help with:
- I noticed that the evaluation results for each dataset are stored separately in the
results folder, and I couldn't find a script in the codebase to summarize these results into the format presented in the paper. Could you please provide guidance on how to obtain the summarized results, or is there a script or tool available to generate the summarized results?
- In addition, the current
requirements.txt specifies transformers>=4.37.2. When installing the environment with pip, this installs the latest version of the transformers library, and I found that the latest version caused compatibility issues and prevented the code from running directly. Downgrading to transformers==4.43.0 resolved the issue for me, and I suggest updating the requirements.txt to specify a more stable version.
Thank you again for your time and attention to these issues!
Thank you for your impressive work! It has been really helpful for my ongoing research, but I encountered a couple of issues while trying to run the code that I hope you can help with:
resultsfolder, and I couldn't find a script in the codebase to summarize these results into the format presented in the paper. Could you please provide guidance on how to obtain the summarized results, or is there a script or tool available to generate the summarized results?requirements.txtspecifiestransformers>=4.37.2. When installing the environment with pip, this installs the latest version of the transformers library, and I found that the latest version caused compatibility issues and prevented the code from running directly. Downgrading to transformers==4.43.0 resolved the issue for me, and I suggest updating therequirements.txtto specify a more stable version.Thank you again for your time and attention to these issues!