Skip to content

chore: ⬆️ Update ggml-org/llama.cpp to 4df29be4f4c3673f428170fda944a5b19f743bb8 - #11508

Open
localai-bot wants to merge 5 commits into
mudler:masterfrom
ci-forks:update/LLAMA_VERSION
Open

chore: ⬆️ Update ggml-org/llama.cpp to 4df29be4f4c3673f428170fda944a5b19f743bb8#11508
localai-bot wants to merge 5 commits into
mudler:masterfrom
ci-forks:update/LLAMA_VERSION

Conversation

@localai-bot

@localai-bot localai-bot commented Aug 13, 2026

Copy link
Copy Markdown
Collaborator

@localai-bot
localai-bot force-pushed the update/LLAMA_VERSION branch from 3ed3ccc to a526e1d Compare August 13, 2026 20:42
@localai-bot
localai-bot force-pushed the update/LLAMA_VERSION branch from 1bdaf5b to 2434b34 Compare August 14, 2026 23:57
@localai-bot localai-bot changed the title chore: ⬆️ Update ggml-org/llama.cpp to a94d563ed801d1da1b8c2432946de07d0231bb3d chore: ⬆️ Update ggml-org/llama.cpp to 9d57ce456c94d241dde672b2db9cf18879766568 Aug 14, 2026
@localai-bot
localai-bot force-pushed the update/LLAMA_VERSION branch from c0a5128 to 516656d Compare August 15, 2026 20:06
@localai-bot localai-bot changed the title chore: ⬆️ Update ggml-org/llama.cpp to 9d57ce456c94d241dde672b2db9cf18879766568 chore: ⬆️ Update ggml-org/llama.cpp to 0d9ceae1e38291035605613ab41a8f5e693d6fcd Aug 15, 2026
@mudler

mudler commented Aug 16, 2026

Copy link
Copy Markdown
Owner

@localai-org-maint-bot pick this up, fix CI

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Pushed the patch-context refresh on current master. The full llama.cpp patch series now applies cleanly to the new pin, and all 14 standalone C++ unit-test files pass. The new bot-assisted commit intentionally has no Signed-off-by; a human must satisfy DCO per the repository policy.

@mudler

mudler commented Aug 16, 2026

Copy link
Copy Markdown
Owner

@localai-org-maint-bot CI fails

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Pushed 972310a53 to fix the remaining patch failure. The previous refresh kept pre-series context around the TTS insertion; after patches 0001 and 0002 changed the same file, GNU patch rejected 0003. The narrowed hunk now matches the post-series insertion point, and the complete four-patch stack applies cleanly against llama.cpp 0d9ceae1. DCO still needs human action; this bot cannot add a human attestation.

@mudler

mudler commented Aug 16, 2026

Copy link
Copy Markdown
Owner

@localai-org-maint-bot another one

@localai-bot
localai-bot force-pushed the update/LLAMA_VERSION branch from 972310a to 6d075bc Compare August 16, 2026 21:36
@localai-bot localai-bot changed the title chore: ⬆️ Update ggml-org/llama.cpp to 0d9ceae1e38291035605613ab41a8f5e693d6fcd chore: ⬆️ Update ggml-org/llama.cpp to 4df29be4f4c3673f428170fda944a5b19f743bb8 Aug 16, 2026
@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Pushed f684a352f. The new pin changed the slot-reset, prompt-batch, and pre_decode() contexts, so GNU patch was fuzz-applying stale hunks before the L4T compile failed. Both server patches now apply exactly against 4df29be4, git diff --check passes, and all 14 standalone C++ unit-test files pass. The full CMake build was unavailable on this host; the new CI run will validate that path. DCO needs human action because this bot cannot add a human attestation.

@mudler

mudler commented Aug 17, 2026

Copy link
Copy Markdown
Owner

@localai-org-maint-bot again

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Pushed a5e7ed1fc. The remaining gRPC failures came from the TTS patch still targeting pre-score-patch line offsets, so GNU patch rejected its pre_decode() hunk. I refreshed the TTS hunk locations against llama.cpp 4df29be4; the complete score + TTS patch stack applies cleanly with git apply, git diff --check passes, and all 14 standalone C++ unit-test files pass. The Go toolchain cache restore error is runner corruption, not a code failure. DCO still needs human action because this bot cannot add a human attestation.

mudler and others added 5 commits August 17, 2026 10:04
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
The new llama.cpp pin changed the slot reset and prompt batch code. GNU patch accepted stale hunks with fuzz, which left the L4T build with invalid source.

Refresh both server patches against the pinned source so each hunk applies at its intended location.

Assisted-by: Codex:gpt-5
The updated llama.cpp groups cumulative counters under server_metrics. Probe the result layout so the shared adapter also compiles against older forks.

Assisted-by: Codex:gpt-5
GNU patch rejects the stale pre-decode hunk after the score patch changes the same file. Anchor the TTS hunks to the pinned llama.cpp source so the full series applies without fuzz.

Assisted-by: Codex:gpt-5.4
The updated llama.cpp creates its batch threadpool during model initialization, before the context-level fallback can replace the -1 sentinel. Resolve that sentinel from the inference thread count so model loading does not overflow the threadpool allocation.\n\nAssisted-by: Codex:gpt-5.4
@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Pushed 1420ad057 after rebasing onto current master. The new llama.cpp pin creates the batch threadpool during common_init_from_params(), but LocalAI left cpuparams_batch.n_threads at the -1 sentinel; that became the CI allocation of exactly 2^64 bytes in both gRPC jobs. The server now resolves the sentinel from the requested inference thread count before model initialization, while preserving an explicit threads_batch override. The focused regression and all 15 standalone C++ unit-test files pass, both patch files apply cleanly to 4df29be4, and git diff --check passes. The pushed run will validate the full container path. DCO still needs human action because this bot cannot add a human attestation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants