-
Notifications
You must be signed in to change notification settings - Fork 17
Issues
is:issue state:open
is:issue state:open
Issue creation is restricted in this repository
Search results
Api server blocked when one request is in-process
bugSomething isn't workingSomething isn't workingStatus: Open.#137 In OpenCSGs/llm-inference;- Status: Open.#123 In OpenCSGs/llm-inference;
- Status: Open.#120 In OpenCSGs/llm-inference;
Add inference SDK for invoke
enhancementNew feature or requestNew feature or requestStatus: Open.#103 In OpenCSGs/llm-inference;Requested tokens (817) exceed context window of 512
bugSomething isn't workingSomething isn't workingStatus: Open.#99 In OpenCSGs/llm-inference;- Status: Open.#98 In OpenCSGs/llm-inference;
Support load Qwen1.5-72B-Chat-GPTQ-Int4 by auto_gptq
enhancementNew feature or requestNew feature or requestStatus: Open.#68 In OpenCSGs/llm-inference;- Status: Open.#59 In OpenCSGs/llm-inference;
- Status: Open.#55 In OpenCSGs/llm-inference;
- Status: Open.#48 In OpenCSGs/llm-inference;
- Status: Open.#37 In OpenCSGs/llm-inference;
- Status: Open.#20 In OpenCSGs/llm-inference;