Skip to content

Add completion parameters #15

Description

@luckenco
  • Add temperature parameter
  • Add max_tokens parameter (currently missing entirely)
  • Add top_p
  • Add frequency_penalty
  • Add presence_penalty
  • Add seed parameter for deterministic outputs
  • Add stop sequences support
  • Add n parameter for multiple completions
  • Add user parameter for tracking
  • Add logprobs
  • Add top_logprobs support

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requeston-holdCurrently blocked or on waiting on another feature

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions