To add vision/OCR support, you'd need to modify at minimum:
- BedrockConverseHandler._get_messages() — Support image content blocks alongside text:
Bedrock Converse API expects this for images:
{"image": {"format": "png", "source": {"bytes": <image_bytes>}}}
2. PromptAdapter — Add a way to specify that a template variable should be populated with image data
rather than text.
3. DatasetAdapter — Handle dataset rows where an input column contains image file paths, loading the
bytes at inference time.
4. InferenceAdapter — Thread image data through to the Bedrock call.
To add vision/OCR support, you'd need to modify at minimum:
Bedrock Converse API expects this for images:
{"image": {"format": "png", "source": {"bytes": <image_bytes>}}}
2. PromptAdapter — Add a way to specify that a template variable should be populated with image data
rather than text.
3. DatasetAdapter — Handle dataset rows where an input column contains image file paths, loading the
bytes at inference time.
4. InferenceAdapter — Thread image data through to the Bedrock call.