Device requirements?

[hedachun321]

Hello, excellent work! I would like to inquire about the device requirements for running this project, or in other words, what kind of graphics card did the authors use?

[pipixin321]

For inference with HolmesVAD-7B, a 24GB 4090 GPU is required.
If your GPU has less than 24GB of VRAM (e.g., 12GB), you can try multi-GPU inference or quantized inference (set load_nbit=True in gradio_demo.py).