Issues

• allenai/olmOCR-2-7B-1025-FP8 not working as a Serverless endpoint

  runpod-workers/worker-vllm#274 · Filter by author erandeutsch opened on Mar 9, 2026
  1

  

• Guided decoding backends not working - both old and new APIs fail

  runpod-workers/worker-vllm#235 · Filter by author endolith opened on Nov 12, 2025
  3

• Does LMFE_STRICT_JSON_FIELD_ORDER not work?

  runpod-workers/worker-vllm#233 · Filter by author endolith opened on Nov 10, 2025
  1

• Issue with Voxtral 3B: "Please install vllm[audio] for audio support"

  runpod-workers/worker-vllm#223 · Filter by author dalager opened on Oct 9, 2025

• Can't run Qwen3-30B-A3B on H100, same config works fine on A100/L40s

  runpod-workers/worker-vllm#213 · Filter by author szulcmaciej opened on Aug 21, 2025
  1

• Worker dies with no apparent reason

  runpod-workers/worker-vllm#199 · Filter by author avacaondata opened on Jul 23, 2025

• Error: chat template not supported

  runpod-workers/worker-vllm#198 · Filter by author ParthKarth opened on Jul 23, 2025
  3

• Issue with Structured Output

  runpod-workers/worker-vllm#194 · Filter by author pabssen1 opened on Jun 30, 2025

• text generation sentences not in order (out of order)

  runpod-workers/worker-vllm#163 · Filter by author auwsom opened on Feb 21, 2025
  4

• Qwen2.5-vl-72B

  runpod-workers/worker-vllm#159 · Filter by author MayurKuchhadiya opened on Feb 10, 2025
  3

• Cannot find any model weights with `/models/huggingface-cache/hub/models--migtissera--Tess-3-Mistral-Large-2-123B/snapshots/8047f7cc9615909650b6a4ae5d13719d3e11594d

  runpod-workers/worker-vllm#156 · Filter by author snbhanja opened on Jan 30, 2025
  2

• Compatibility with deployment on a Pod?

  runpod-workers/worker-vllm#149 · Filter by author jparismorgan opened on Jan 28, 2025
  2

• worker-config.json's QUANTIZATION does not has 'bitsandbytes' option

  runpod-workers/worker-vllm#145 · Filter by author mohamednaji7 opened on Jan 21, 2025

• arg['tensor_parallel_size'] is overrided by GPU's number

  runpod-workers/worker-vllm#144 · Filter by author hyeonu opened on Jan 20, 2025
  

• There's no "seed" option in the text completions (not chat) which is very important

  runpod-workers/worker-vllm#142 · Filter by author varkarrus0 opened on Jan 3, 2025
  3

• Qwen/Qwen2-VL-7B-Instruct

  runpod-workers/worker-vllm#135 · Filter by author kowshik24 opened on Nov 26, 2024
  3

• Custom Model Name Is Not Supported For New Releases

  runpod-workers/worker-vllm#134 · Filter by author vladislavkruglikov opened on Nov 25, 2024

• Chat completion (template) not working with VLLM 0.6.3 + Serverless

  runpod-workers/worker-vllm#129 · Filter by author xingyaoww opened on Nov 12, 2024
  5

• Are visual LLMs supported?

  runpod-workers/worker-vllm#122 · Filter by author iamkhalidbashir opened on Oct 9, 2024
  6

• An error occurred: The checkpoint you are trying to load has model type qwen2_vl but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

  runpod-workers/worker-vllm#114 · Filter by author kicks66 opened on Sep 23, 2024
  1

• Very slow cold starts even with flashboot

  runpod-workers/worker-vllm#111 · Filter by author avacaondata opened on Sep 18, 2024
  8

• Unable to deploy mistralai/Mistral-Nemo-Instruct-2407

  runpod-workers/worker-vllm#88 · Filter by author TheMindExpansionNetwork opened on Jul 30, 2024
  5