Skip to content

Commit e9073d2

Browse files
fix(vllm-cpp): align the v21 ABI pin
The new engine pin reports ABI v21, so the v20 handshake rejects every backend build. The pin also contains the Apple Clang fix that LocalAI carried as a patch. Assisted-by: Codex:gpt-5
1 parent aaf9771 commit e9073d2

4 files changed

Lines changed: 5 additions & 31 deletions

File tree

backend/go/vllm-cpp/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ It serves two things: text generation, and MiniMax-H3 joint video+audio
99
generation.
1010

1111
The backend dlopens the engine's stable C ABI (`libvllm`, `include/vllm.h`,
12-
ABI v20) through purego:
12+
ABI v21) through purego:
1313

1414
- `Load` -> `vllm_engine_load`: accepts a `.gguf` file or a HF-style model
1515
directory (`config.json` + safetensors). `context_size` maps to

backend/go/vllm-cpp/govllmcpp.go

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
package main
22

3-
// purego bindings for the vllm.cpp stable C ABI (include/vllm.h, ABI v20).
3+
// purego bindings for the vllm.cpp stable C ABI (include/vllm.h, ABI v21).
44
//
55
// The structs below are hand-mirrored PODs of the C declarations, with
66
// explicit padding so the Go layout matches the C layout on linux/darwin
@@ -21,7 +21,7 @@ import (
2121
// the header of the VLLM_CPP_VERSION pinned in the Makefile: the build checks
2222
// the two against each other, because a mismatch is only caught at runtime by
2323
// registerLib, where it takes the backend down on every load (issue #11379).
24-
const abiVersion = 20
24+
const abiVersion = 21
2525

2626
// The ABI's tri-state toggles (enable_prefix_caching ABI v7,
2727
// enable_jump_forward ABI v10) share one encoding: 0 is NOT "off", it is

backend/go/vllm-cpp/patches/0001-fix-qwen35-unused-lambda-capture.patch

Lines changed: 0 additions & 26 deletions
This file was deleted.

backend/go/vllm-cpp/vllmcpp_test.go

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,15 +16,15 @@ func TestVllmCpp(t *testing.T) {
1616
RunSpecs(t, "vllm-cpp suite")
1717
}
1818

19-
// The Go POD mirrors must match the C struct layout of vllm.h (ABI v20)
19+
// The Go POD mirrors must match the C struct layout of vllm.h (ABI v21)
2020
// byte-for-byte: these offsets are the C offsets on LP64 (linux/darwin
2121
// amd64+arm64). A failure here means govllmcpp.go drifted from vllm.h.
2222
var _ = Describe("C ABI struct mirrors", func() {
2323
It("declares the ABI version the pinned engine reports", func() {
2424
// VLLM_ABI_VERSION in the vllm.h of VLLM_CPP_VERSION (Makefile).
2525
// Moving the pin past this without growing the mirrors below ships a
2626
// backend that refuses every load at startup (issue #11379).
27-
Expect(abiVersion).To(Equal(20))
27+
Expect(abiVersion).To(Equal(21))
2828
})
2929

3030
It("cModelParams matches vllm_model_params", func() {

0 commit comments

Comments
 (0)