Skip to content

Add vLLM token-native generate endpoint#1113

Open
biswapanda wants to merge 2 commits into
ai-dynamo:mainfrom
biswapanda:bis/vllm-generate-endpoint
Open

Add vLLM token-native generate endpoint#1113
biswapanda wants to merge 2 commits into
ai-dynamo:mainfrom
biswapanda:bis/vllm-generate-endpoint