Skip to content

Update 16k token limit #37

Description

@stoerr

Follow https://platform.openai.com/docs/models/gpt-3-5 : at dec 13 2023 the gpt 3.5 model will admit 16k tokens. Perhaps find that out with a request instead of using a constant...

Also , there might a conflict between the default value 1000 tokens that's used for the sidebar and the underlying system.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions