v3.x

Issues

• fix(api): support Claude Code Anthropic tool flows with Qwen chat templates

  bug
  Unread
  xorbitsai/inference#5051·ace-xc opened Jun 18, 2026 · Updated Jul 19, 2026
  13

• Draft: parse tool_calls arguments

  Unread
  xorbitsai/inference#4921·la1ty opened May 18, 2026 · Updated Jul 19, 2026
  10

• feat: batch text-only MLX VLM requests

  feature
  Unread
  xorbitsai/inference#4918·qinxuye opened May 16, 2026 · Updated Jul 19, 2026
  8

• ENH: SDNQ Diffusers Quantizer

  enhancementfeature
  xorbitsai/inference#4633 · Filter by author iwr-redmond opened on Feb 27, 2026 · v3.x
  28

• BUG: MLX distributed error with vscode cline

  bug
  Unread
  xorbitsai/inference#4379·OliverBryant opened Dec 17, 2025 · Updated Jul 19, 2026

• BUG: worker dead with xoscar v0.8.0

  bug
  Unread
  xorbitsai/inference#4363·OliverBryant opened Dec 15, 2025 · Updated Jul 19, 2026

• FEAT: mistral-small-3.2-instruct model support

  feature
  Unread
  xorbitsai/inference#3820·llyycchhee opened Jul 21, 2025 · Updated Jul 19, 2026

• FEAT: [UI] implement step-by-step user onboarding.

  feature
  Unread
  xorbitsai/inference#3530·yiboyasss opened May 27, 2025 · Updated Jul 19, 2026
  1

• FEAT: new model mPLUG-Owl3

  feature
  Unread
  xorbitsai/inference#3199·Minamiyama opened Apr 7, 2025 · Updated Jul 19, 2026·Draft

• FEAT: bge vl embedding series

  feature
  Unread
  xorbitsai/inference#3092·Minamiyama opened Mar 19, 2025 · Updated Jul 19, 2026·Draft
  1

• ENH: cosyvoice support pt file

  enhancement
  Unread
  xorbitsai/inference#2431·Minamiyama opened Oct 12, 2024 · Updated Jul 19, 2026
  9

• REF: load model card json

  refactor
  Unread
  xorbitsai/inference#2246·Minamiyama opened Sep 7, 2024 · Updated Jul 19, 2026

• BUG: Fix ChatTTS stream

  bug
  Unread
  xorbitsai/inference#2101·codingl2k1 opened Aug 16, 2024 · Updated Jul 19, 2026·Draft

• FEAT: Initially support OpenVINO

  feature
  Unread
  xorbitsai/inference#1677·qinxuye opened Jun 20, 2024 · Updated Jul 19, 2026

• FEAT: Code completions

  feature
  Unread
  xorbitsai/inference#1476·mikeshi80 opened May 11, 2024 · Updated Jul 19, 2026
  1

• ENH: Added the check for reserved model uid like "instances", "prompts" etc.

  enhancement
  Unread
  xorbitsai/inference#1303·mikeshi80 opened Apr 15, 2024 · Updated Jul 19, 2026

• Fetch from hub

  Unread
  xorbitsai/inference#1160·mikeshi80 opened Mar 19, 2024 · Updated Jul 19, 2026
  4

• FEAT: Support TensorRT-LLM backend

  feature
  Unread
  xorbitsai/inference#646·aresnow1 opened Nov 14, 2023 · Updated Jul 19, 2026·Draft
  1

• ENH: use restful client for generate/chat in in cmdline

  enhancement
  Unread
  xorbitsai/inference#371·jiayini1119 opened Aug 21, 2023 · Updated Jul 19, 2026

• feat: surface real root-cause errors on model launch failure

  featuregpu
  Unread
  xorbitsai/inference#5266·OliverBryant opened Jul 31, 2026 · Updated Aug 3, 2026
  13

  

• FIX: log and retry supervisor connection during worker startup

  buggpu
  Unread
  xorbitsai/inference#5278·OliverBryant opened Aug 4, 2026 · Updated Aug 5, 2026
  2

  

• fix(ocr): preserve nested coordinate structure in extract_text_blocks

  bug
  Unread
  xorbitsai/inference#5349·Ricardo-M-L opened Aug 17, 2026 · Updated Aug 17, 2026
  3

• fix(llm): correctly pass multimodal_projector to LlamaCppModel

  bug
  Unread
  xorbitsai/inference#5350·Ricardo-M-L opened Aug 17, 2026 · Updated Aug 17, 2026
  3

• fix: include user-defined LLM families in _resolve_architectures

  bug
  Unread
  xorbitsai/inference#5351·Ricardo-M-L opened Aug 17, 2026 · Updated Aug 17, 2026
  2

• [Docker CD] Failure on v3.5.0

  gpustale
  xorbitsai/inference#5585 · Filter by author github-actions opened on Sep 25, 2026 · v3.x
  1