Skip to content

Add temperature parameter to process_image#21

Merged
Karthik Koralla (karthikreddy-02) merged 2 commits into
mainfrom
add-llm-temperature
May 12, 2026
Merged

Add temperature parameter to process_image#21
Karthik Koralla (karthikreddy-02) merged 2 commits into
mainfrom
add-llm-temperature

Conversation

@karthikreddy-02

@karthikreddy-02 Karthik Koralla (karthikreddy-02) commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Adds an optional temperature: keyword argument (default 0.0) to Client#process_image, forwarded to the Bedrock converse API via inference_config. Includes tests for default and custom temperature values.
Closes #18

Adds an optional `temperature:` keyword argument (default 0.0) to
`Client#process_image`, forwarded to the Bedrock converse API via
`inference_config`. Includes tests for default and custom temperature values.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@ajkiessl

Alex Kiessling (ajkiessl) commented Apr 2, 2026

Copy link
Copy Markdown
Collaborator

Karthik Koralla (@karthikreddy-02) Were you able to test this against any of the LLMs? Do you have the access keys to do that? I would like to confirm that the LLMs we have registered are able to take these inputs. Also, I don't think we should default to 0.0. Unless you've confirmed that this is a typical default, but I would think that is the extreme.

I can get you keys if you don't have them.

@karthikreddy-02

Copy link
Copy Markdown
Contributor Author

Alex Kiessling (@ajkiessl) I don't have the access keys. I believe we can test outputs for different temperatures and see what fits best and change the default temperature based on that.

@ajkiessl

Copy link
Copy Markdown
Collaborator

Karthik Koralla (@karthikreddy-02) That sounds like a good idea. I can get you the keys tomorrow.

@ajkiessl Alex Kiessling (ajkiessl) left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@karthikreddy-02 Karthik Koralla (karthikreddy-02) merged commit dd289e4 into main May 12, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Investigate LLM "temperature"

2 participants