アップストリームを取り込み - #3

Open

kyakuno wants to merge 2054 commits into

kyakuno/merge-upstream-b10783

This pull request is big! We're only showing the most recent 250 commits

Commits on Aug 20, 2026

server : fix --docker-repo being treated as router mode (#27416)
AriBandyo
authored
8a832e4
server: (router) lazy-load startup_models after main setup (#27424)
ngxson
authored
9855ad6
CI: Use LLVM's OpenMP over MSVC_DEBUG_non_redist on Windows (#26678)
ORippler
authored
bf0040e
metal : dequant kv cache only for large batches (#27438)
ggerganov
authored
63b64a5
vulkan: FA MMQ should use fp32 for Q quantization calculations (#27413)
jeffbolznv
authored
78ec4c3
model : support DSpark for LFM2 models (#27383)
tdakhran
authored
07822bd
mtmd: add --mmproj-device argument (#23255)

Interpause
and
ngxson
authored
681c29d
ui: Stores split refactor (#27240)
allozaur
authored
521a64c
opencl: fix local size for norm (#27339)
lhez
authored
6b4fa88
opencl: fix q6_K flat mul_mat for Adreno A6x/A7x GPUs with older E031 compilers (#26476)
wanghqc
authored
6503355
metal : clamp K extent in tensor API mat-mat kernel for K not a multiple of 32 (#27450)
ggerganov
authored
a302733
ci: use shell script to check cmake pkg (#27414)
netrunnereve
authored
0e1d918
ggml: support ggml_rope_set_offset on opencl, sycl, wgpu, hexagon (#27345)
ngxson
authored
749f688

Commits on Aug 21, 2026

docs: fix typos in ET.md (#27457)
itsvedantkumar
authored
a298422
TP: enable tensor split for LFM2/LFM2MOE (#26993)
cdanis
authored
b2e5e9b
sycl : fix load model with mlock issue (#27250)
arthw
authored
9e96cf7
sycl: fix multiple warnings in compiling sycl backend (#26713)
icfaust
authored
6602dd3
sycl: Update gate logic for Alchemist GPUs regarding OneDNN features. (#26635)

HumerousGorgon
and
arthw
authored
1cb3f5e
opencl: keep the vocab-scale K-quant lm_head on the CPU for Adreno A7X (compiler issue workaround) (#26440)

wanghqc
and
lhez
authored
cd26896
sycl : Add Q5_K ESIMD kernel (#26376)
malsbat
authored
9e89a19
test : make the FA V-is-view-of-K case a test case parameter (#27394)
ggerganov
authored
5fff128
sycl : add Q2_K reordered MMVQ and ESIMD kernels (#26336)
malsbat
authored
ff14356
kleidiai : add SME2 F32 GEMV kernel support (#26891)
chaxu01
authored
62b2269
ci : release clean-up (#27477)
ggerganov
authored
1719747
ci : add nightly-tag.txt to make-release (#27485)
ggerganov
authored
e467c2f
ui: Settings navigation cleanup (#27241)
allozaur
authored
5b6ddc9
Revert "sycl : add Q2_K reordered MMVQ and ESIMD kernels (#26336)" (#27486)
ggerganov
authored
7a0e42f
ci : remove duplicate flag (#27488)
ggerganov
authored
353b32d
ggml : bump version to 0.21.0 (ggml/1597)
ggerganov
committed
01ff204
sync : ggml
ggerganov
committed
5de25a7
scripts : add release.sh for release preparation (#27497)
ggerganov
authored
c4b0225
llama.cpp : bump version to 0.2.0 (#27498)
ggerganov
authored
bb4caa7
ci : run ccache-clear as the last step of release jobs (#27503)

ggerganov
and
CISC
authored
d7fa69b
model: use ggml_rope_set_offset() (#27382)
ngxson
authored
873e5d8
model: add dots3-note (#27060)
ngxson
authored
5a32f7b
ci : fix empty release_id in make-release upload step (#27516)
ggerganov
authored
a3b9c23
docs: improve Windows build instructions (#27381)
nikwen
authored
9a286ac
opencl: fold the gpt-oss MoE per-expert bias adds into the epilogue (op/kernel fusion) (#26431)
wanghqc
authored
3af988f
mtmd: support webp via ffmpeg (#27520)
ngxson
authored
d775b89

Commits on Aug 22, 2026

readme : update badges (#27531)
ggerganov
authored
2100e59
readme : fix server badge alt (#27533)
CISC
authored
3aeb924
sycl : add Q2_K reordered MMVQ and ESIMD kernels (again) (#27490)
CISC
authored
8672290
common : fix draft-mtp with embeddings (#26352, #27299) (#27400)

aorko01
and
CISC
authored
2c6b141
ggml: optimize concat op by replacing per-element memcpy with row-level memcpy (#24575)

sirohikartik
and
CISC
authored
369e1cd
ci : add older, min and dry-run options to ccache-clear (#27504)
ggerganov
authored
3a653fe
mtmd: support dots3-note vision+audio (#27524)

ngxson
and
CISC
authored
54ee5ee
model : support DSpark for bailingmoe3 (#27508)
btw616
authored
2115b73
ci : Restore ROCm job for Ubuntu (#27399)

authored
e85caa8
arg: remove -no-cnv from cli [no ci] (#27542)
ngxson
authored
9fee29e
fit: also take into account n_streams (#27496)

ngxson
and
ServeurpersoCom
authored
2fb989b
common: add json.h abstraction (#27511)
ngxson
authored
d9f918d
mtmd: use ggml_rope_set_offset (#27521)
ngxson
authored
b21e4de
vulkan : added the PAD_REFLECT_1D operation (#26586)

safiullah3915
and
jeffbolznv
authored
3f545be
common: json.h: fix clang lto (#27575)
ngxson
authored
70adb1b

Commits on Aug 23, 2026

cuda : add POOL_1D support (#27573)
amankarki151
authored
29ea941
vendor : update subprocess.h (#27409)
cabelo
authored
6657ded
ui: Chat Conversation Tabbed navigation (#27263)

allozaur
and
ServeurpersoCom
authored
8144f31
[Tensor parallel] Fix meta tensor split state propagation (#27574)
gaugarg-nv
authored
d337192
DeepseekV4: fix rollback with multi-seq (#26756)

am17an
and
ggerganov
authored
b0539c4
common : skip device_info loop if it's not going to be printed (#26692)
wolfpld
authored
ba8e0ed
server : add LLAMA_SERVER_SLOTS_N_DIFF (#27600)
ggerganov
authored
e8eed45
contrib : recommend waiting for CI before merging (#27603)
nikwen
authored
a278dce
ci : add test-llama-archs tensor split for Metal (#27598)
ggerganov
authored
95b8e33
mtmd: use pillow-accurate algo, correct resize_algo for all models (#27594)
ngxson
authored
56db501
test: move tools/parser to tests (#27548)
ngxson
authored
4a08fa2
test : fix multi-GPU server tests (#27614)
ggerganov
authored
8d9af25
fix: Change chat tabs nav shortcuts (#27609)
allozaur
authored
d05f895
readme : update links (#27617)
ggerganov
authored
ccc8fd2
model : support MTP in GLM-4.5-Air (#26534)
jacekpoplawski
authored
c060ca9

Commits on Aug 24, 2026

Commits on Aug 25, 2026

webgpu : fix handling of infinity values during ARGSORT and TOP_K (#27538)

fairydreaming
and
sszymczy
authored
5ea87dd
sycl : mark tq2_0 as not supported (#27660)
arthw
authored
814d84b
grammar : parse \- in char classes as literal hyphen (#27591)
NIXKnight
authored
eb25b72
ggml : bump version to 0.22.0 (ggml/1607)
ggerganov
committed
9388236
sync : ggml
ggerganov
committed
81191af
llama.cpp : bump version to 0.3.0 (#27696)
ggerganov
authored
c1d0e7a
metal : null-check buffer alloc to fix OOM crash (#25371)

ykhrustalev
and
ggerganov
authored
3737e41
ui: ESLint config updates (#27700)
allozaur
authored
f1357e4
ci : store ccache on HF buckets (test with cuda-ubuntu for now) (#27699)
CISC
authored
790b571
chat : scope qwen3-coder workarounds (#27679)
aldehir
authored
0cc5b14
server : reject prefilled assistant messages with tool calls (#27626)
kyo-zzz
authored
1729ed5
devops: use GGML_NATIVE=OFF for OpenVINO (#27338)

krzsztf
and
CISC
authored
0a5ac49
rpc: support apple RDMA as an RPC transport (#26421)

ryan5rdx
and
Ryan Churaman
authored
b114b47
ci : update OS used for ROCM to Ubuntu 24.04 (#27681)
superm1
authored
eab8ee4
kleidiai: Rework KleidiAI Build System/Integration (#26077)
JonathanC-ARM
authored
d222767

Commits on Aug 26, 2026

Commits on Aug 27, 2026

Commits on Aug 28, 2026

tests : run test-save-load-state across all architectures (#27755)
ggerganov
authored
4e97ac8
metal : add fa-vec tunings for M4 Pro (#27824)
infinitewarp
authored
6d6b697
metal : add fa-vec tunings for M3 Max, M5 and M5 Pro (#27863)
ggerganov
authored
8963a9b
sycl: bind the f16 KV cache in place for the oneDNN SDPA path (#27468)
Titaniumtown
authored
be87620
sycl: use TILE for quantized KV decode on BMG (#26689)
johnkarlhill
authored
d077b4c
convert: prevent ndarray conversion in LazyChunkedTensor (#27869)
ngxson
authored
b19cbe9
OpenVINO: Update OV to 2026.3.1, whisper.cpp support, Qwen3.5 on NPU, and new ops (#27843)

authored
511f9c1
metal : add fa-vec tunings for M4 (#27875)
Strongtut
authored
f5e85d4
context : disable non-fused GDN and LID ops (#27877)
ggerganov
authored
8663224
Vulkan: add hoisting support for row IDs and expert count in shaders (#26686)

ravel7524
and
jeffbolznv
authored
90c26fc
ggml : fix conv_transpose_2d for multiple batches (#26132)

tekinertekin
and
ggerganov
authored
a43c398
vulkan: fix missing view-alias dependencies in ggml_vk_graph_optimize (#27812)

Eric-A-Stalee
and
jeffbolznv
authored
b387ddf
model: qwen4exp: reduce number of graph splits (#27880)
ngxson
authored
6fe7498
bench: add --tensor-read-lazy (#27881)
ngxson
authored
50f068f
snapdragon: python SDK setup (Windows) (#27903)

kurquhar
and
Kristopher Urquhart
authored
d7bd3bf

Commits on Aug 29, 2026

Commits on Aug 30, 2026

Commits on Aug 31, 2026

Commits on Sep 1, 2026

Commits on Sep 2, 2026

hexagon: add missing FARF logs for cpy/get_rows/set_rows/gdn ops (#28217)
trivikram-reddy1
authored
69320fe
opencl: fix out‐of‐bound reads in the Adreno image kernels (#27632)
wanghqc
authored
43d87ff
ggml-cpu : conditionally add SpacemiT IME kernel sources (#27961)
alanhc
authored
2637dfe
vulkan : only request VK_KHR_shader_bfloat16 extension if supported (#28155)
madsmtm
authored
56dd815
vulkan: handle larger batch sizes (>4) efficiently for IQ3_S mat-vec (#27449)

LaurentZuijdwijk
and
Marshall
authored
ba8818c
hexagon: MUL_MAT and MUL_MAT_ID fusion and fixes (#28202)
max-krasnyansky
authored
960dffa
ggml: avoid KleidiAI buffer type init on dispatch (#27891)

ac-mmi
and
Acmmi
authored
b81c99b
mtmd: Fix Qwen3-tts-0.6b (#28231)
ServeurpersoCom
authored
0f3a71b
CUDA + ggml: add sparse-fa for DSV4/GLM (#27970)
am17an
authored
8e93a97
mtmd: support DeepSeek-V4-Flash-Vision-Exp (#28133)
ngxson
authored
7798007
common, server : enable preserve_reasoning kwarg by default, log its effective state (#28174)

ggerganov
and
ngxson
authored
e750b88
ggml-cuda : remove unused vars (#28235)
angt
authored
3d3d7c8
ci : enable hf-jobs on server-cuda (#28258)
CISC
authored
d5fec32
model: correctly support input vision for deepseek4 (#28154)
ngxson
authored
9400c89
Update ROCm to 10.0.0 release (#27803)
superm1
authored
cff1844
ci : check for missing autoreleasepools (#27884)
nikwen
authored
03dbcc5
metal : fix memory query under low-memory conditions (#27701)

authored
8c0b9cd
metal : add fa-vec tunings for M3 (#28236)
init-22
authored
9cc3394
mtmd: add mtmd_tokenize_from_parts() (#28250)
ngxson
authored
7339054
ggml-hexagon: add F16 support for unary ops (#28228)
cqderek
authored
f027c4f
server : accept data: URLs for input_video and input_audio (#27735)
geckguy
authored
9cffdcc
finetune: fix no KV cache (#27199)
ngxson
authored
159b741
mtmd: fix idefics3 preproc (#28273)
ngxson
authored
67a17c1

Commits on Sep 3, 2026

model: add NVIDIA Nemotron-3-Puzzle-75B-A9B (NemotronHPuzzle) support (#25444)
YanissAmz
authored
c61b98b
sycl: reduce redundant work in Q4_K multi-column MMVQ (#27062)

Eurekatic
and
RaulAbejonDelgado
authored
4aa6ffb
misc : prevent RAM peaking at model loading stage (#27483)
tdakhran
authored
5ec4eab
convert : skip bias_vl tensor in DeepSeek-V4 DSpark conversion (#28294)

ggerganov
and
CISC
authored
d646c9d
sycl : enhance the api to support peer-to-peer copy (#27550)
arthw
authored
0df974d
vulkan: fix FA dequant path engagement (#28190)
Nathanw1014
authored
c7bda03
CUDA: Allow concurrent streams per split for multi-GPU (#28198)

tannerbruhn
and
am17an
authored
0ba6499
mtmd : add `const` in various places (#28307)
madsmtm
authored
f45576a
Merge upstream llama.cpp b10783 into patched

kyakuno
and
claude
committed
ef53315