How to pass video to an agent

[ssa206]

I am using google gemini 2.0 flash as the model and wanted to know how to pass a video? I know for images I can pass in the images parameter to CodeAgent.run but not sure about video

[gyanu2507]

CodeAgent.run(..., images=...) is images only. There is no video= kwarg.

Gemini 2.0 Flash will take video on Google's API (file upload or a YouTube URI). smolagents' default HfApiModel / image path does not wrap that.

Two workable options:

1. Upload with google.genai (client.files.upload), then put that file object into the model's native contents. You need a model wrapper that forwards Gemini file parts, not just a text prompt.
2. Sample frames with ffmpeg and pass them as images=[...]. That is a slideshow, not audio+motion, but it uses the existing images argument.

If the agent only sees a filesystem path in the prompt, Flash will not magically open the mp4.