Reproducibility of model answers

[maluwastaken]

Hi! Thank you for your hard work on this repository!

I am wondering if there is a way of keeping the answers always the same for the same prompt and input video, for reproducibility of results. Do you have any solution for this?

Thanks!

[jpthu17]

Hi, I think the greedy search suits your needs.

To do a greedy search, set "do_sample = False" :

Chat-UniVi/ChatUniVi/demo.py

Line 99 in 910a9f6

do_sample=True,

do_sample=False