Skip to content

Commit 5b5c7e7

Browse files
fix(vllm-cpp): track ABI v21
The updated engine exposes ABI v21 after extending its speech API. The Go backend does not bind that API, so its existing mirrors remain valid. The qwen3.5 warning fix is now present upstream, so the old patch no longer applies. Assisted-by: Codex:gpt-5
1 parent 3f0c1cd commit 5b5c7e7

3 files changed

Lines changed: 4 additions & 30 deletions

File tree

backend/go/vllm-cpp/govllmcpp.go

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
package main
22

3-
// purego bindings for the vllm.cpp stable C ABI (include/vllm.h, ABI v20).
3+
// purego bindings for the vllm.cpp stable C ABI (include/vllm.h, ABI v21).
44
//
55
// The structs below are hand-mirrored PODs of the C declarations, with
66
// explicit padding so the Go layout matches the C layout on linux/darwin
@@ -21,7 +21,7 @@ import (
2121
// the header of the VLLM_CPP_VERSION pinned in the Makefile: the build checks
2222
// the two against each other, because a mismatch is only caught at runtime by
2323
// registerLib, where it takes the backend down on every load (issue #11379).
24-
const abiVersion = 20
24+
const abiVersion = 21
2525

2626
// The ABI's tri-state toggles (enable_prefix_caching ABI v7,
2727
// enable_jump_forward ABI v10) share one encoding: 0 is NOT "off", it is

backend/go/vllm-cpp/patches/0001-fix-qwen35-unused-lambda-capture.patch

Lines changed: 0 additions & 26 deletions
This file was deleted.

backend/go/vllm-cpp/vllmcpp_test.go

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,15 +16,15 @@ func TestVllmCpp(t *testing.T) {
1616
RunSpecs(t, "vllm-cpp suite")
1717
}
1818

19-
// The Go POD mirrors must match the C struct layout of vllm.h (ABI v20)
19+
// The Go POD mirrors must match the C struct layout of vllm.h (ABI v21)
2020
// byte-for-byte: these offsets are the C offsets on LP64 (linux/darwin
2121
// amd64+arm64). A failure here means govllmcpp.go drifted from vllm.h.
2222
var _ = Describe("C ABI struct mirrors", func() {
2323
It("declares the ABI version the pinned engine reports", func() {
2424
// VLLM_ABI_VERSION in the vllm.h of VLLM_CPP_VERSION (Makefile).
2525
// Moving the pin past this without growing the mirrors below ships a
2626
// backend that refuses every load at startup (issue #11379).
27-
Expect(abiVersion).To(Equal(20))
27+
Expect(abiVersion).To(Equal(21))
2828
})
2929

3030
It("cModelParams matches vllm_model_params", func() {

0 commit comments

Comments
 (0)