Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
120 commits
Select commit Hold shift + click to select a range
358a420
graph: pad the KV dimension of the no-cache attention to 256 (#30416)
ServeurpersoCom Oct 12, 2026
cbe28bb
model: fix vllm d3 multi seq case (#30408)
ngxson Oct 12, 2026
a49f58d
ci: fix OpenVINO download links (#30401)
Pratyush-gg Oct 13, 2026
8f574b0
ci : build OpenVINO releases with GGML_NATIVE=OFF and CPU backend var…
Pratyush-gg Oct 13, 2026
4413a19
hexagon: extend scalar DMA broadcasting support for binary ops (#30245)
kurquhar Oct 13, 2026
071b553
models : remove redundant ggml_cont calls now supported by all unary …
saady789 Oct 13, 2026
af50f2f
ggml-zdnn : introduce Q8_0 mat mul (#29836)
taronaeo Oct 13, 2026
9880157
graph : avoid reallocations in the "no cache" path (#30439)
ggerganov Oct 13, 2026
ed019cd
llama : skip logits buffer allocation when graph produces no logits (…
animeshsri14 Oct 13, 2026
9d7d504
convert : fix LoRA conversion with --outtype auto (#30433)
teddygood Oct 13, 2026
30f7df1
cuda : warnings cleanup (#30420)
angt Oct 13, 2026
882d671
cuda : fix warnings from dead breaks (#30441)
angt Oct 13, 2026
7f51953
model : allow Qwen3.8 Flash Next to accept image embds for MTP (#30397)
ORippler Oct 13, 2026
296538a
spec : remove tokens assert from dsv4 graph_mtp (#30444)
ORippler Oct 13, 2026
411d548
vulkan : split matmul dispatch when it would exceed maxComputeWorkGro…
losewayy Oct 13, 2026
bfe65e1
cuda : fix compiler warnings in mmq-load-tiles.cuh (#30443)
angt Oct 13, 2026
f851e24
cuda : add GGML_CUDA_GRAPH_DEBUG and read env vars once (#30327)
ggerganov Oct 13, 2026
0a731cc
ggml-cpu : add AVX2 dot product for Q2_0 (#30447)
homeofe Oct 13, 2026
e0bcacc
vulkan: allow multiple devices to access gpu-visible host memory (#29…
0cc4m Oct 13, 2026
b476d9a
llama : fix log message (#30452)
ggerganov Oct 13, 2026
a17e94d
tests : consolidate context state tests into test-llama-context (#30023)
ggerganov Oct 13, 2026
cb55ffe
graph: skip the LM head for pooled embeddings (#30445)
ServeurpersoCom Oct 13, 2026
f441d2d
model: load YaRN beta metadata for laguna models (#30331)
accaldwell Oct 13, 2026
b9f3599
llama : do not map foreign ranges into a backend buffer (#30405)
ggerganov Oct 13, 2026
ace20f6
graph: pad the KQ bias of the no-cache attention (#30446)
ServeurpersoCom Oct 13, 2026
ec0bfac
hexagon: add configurable HTP DCVS/HMX power mode (#30423)
pdhinaka Oct 13, 2026
ecdd29e
meta: recreate all subgraphs when the arena is reallocated (#30453)
Xanewok Oct 13, 2026
77c4540
vulkan: Optimize pool_2d when the pooling window is large (#30119)
jeffbolznv Oct 13, 2026
45451c3
kleidiai: add SME2 Q4_K and Q6_K matmul support (#29219)
chaxu01 Oct 13, 2026
d71e324
docs : update zDNN supported ops (#30472)
taronaeo Oct 13, 2026
1b70350
ggml : simplify backend search path error handling (#28367)
angt Oct 13, 2026
ff026f8
chat: replace output string with parts (#30389)
ngxson Oct 13, 2026
04f7226
server : escape the special tokens without std::regex (#30243)
ykhrustalev Oct 13, 2026
fcac190
webgpu: (Fix CI) fix mul_mat_id with duplicate expert ids (#30451)
yomaytk Oct 13, 2026
091b6a7
Enable OpenSSL in FP32/FP16 SYCL builds to restore HF HTTPS downloads…
raffaeleedidonna Oct 14, 2026
eca5458
convert : export YaRN truncation config (#30288)
tokinasin Oct 14, 2026
10da8c4
unicode : add opt-in NFC normalization for Unigram tokenizers (#30390)
sandrohanea Oct 14, 2026
7ec420b
vulkan: support mulmat bf16 activations (#29069)
0cc4m Oct 14, 2026
d524bb6
vulkan: Define the shader count for Intel Arc Pro B65 + B70 (#30431)
TheBlueMatt Oct 14, 2026
cdce056
vulkan: Add workaround for device free memory > total memory on Intel…
rillomas Oct 14, 2026
e7268bf
llama : build the k-pool selection in the causal mask layout (#30480)
ggerganov Oct 14, 2026
1431019
vulkan: fix compile error (#30495)
0cc4m Oct 14, 2026
4dd6dd4
HIP: use 64-row MMQ tiles for some quant types on RDNA3.5 (#28195)
liangliangchang Oct 14, 2026
9cf967a
models: drop the t_embd expand of the embedding graphs (#30461)
ServeurpersoCom Oct 14, 2026
21a19cd
opencl: fix q8_0 dp4a mul_mat_id and mark PREC_F32 mul_mat_id unsuppo…
lhez Oct 14, 2026
c5a9976
opencl: use buf+offset instead of subbuffer for adreno moe expert sor…
lhez Oct 14, 2026
77390ba
jinja : write floats in tojson as Python does (#30362)
ykhrustalev Oct 14, 2026
62bacfa
cuda : use SIMT implicit GEMM conv2d on AMD without WMMA (#30325)
aisk Oct 14, 2026
af0579c
ggml : improve RPC tensor transfer logs (#30481)
ggerganov Oct 14, 2026
3eb1013
vendor : update cpp-httplib to 0.61.0 (#30494)
angt Oct 14, 2026
df18bee
model: split layers evenly when no device reports free memory (#29677)
ServeurpersoCom Oct 14, 2026
8c2134a
ggml : add note about mul_mat_id + disable mul_mat_id_dup tests (#30501)
ggerganov Oct 14, 2026
318a471
docs : clarify installation recommendation for Intel oneAPI Toolkit (…
alosslessdev Oct 14, 2026
3fb4767
common : add --spec-draft-n-ubatch (#30459)
ggerganov Oct 14, 2026
6868a52
ggml: fix conv_1d result layout for batched input (#28738)
ServeurpersoCom Oct 14, 2026
37d6d65
skill: Update `code-review` skill for UI development (#30509)
allozaur Oct 14, 2026
62df181
cuda, hip: GDN chunked kernel (#29353)
am17an Oct 14, 2026
5cdadfc
ggml-cpu : size set_rows conversion buffer for all threads (#30454)
am17an Oct 14, 2026
c114bd4
docs: update IBM zDNN backend docs (#30527)
taronaeo Oct 14, 2026
685f708
ggml-cpu : keep the FP16->FP32 lookup table on x86 with F16C (#30342)…
Tough-Respawn Oct 14, 2026
529ac89
sycl: IQ3 code reorder (#29107)
anantshri Oct 14, 2026
683bbc0
gguf-py : detect nfc normalization (#30540)
CISC Oct 14, 2026
23deec0
devops: incorrect COPY instruction (#30529)
stormyhs Oct 14, 2026
a0e6dc7
opencl: support CLAMP on non-contiguous views (#30186)
wanghqc Oct 14, 2026
3e390af
vulkan: Use L2-friendly workgroup scheduling for cm2 mulmat (#30215)
0cc4m Oct 15, 2026
843e7dc
spec : add lilicorr support (#30506)
frozenblade1224 Oct 15, 2026
2639a3b
server: save only restorable slot states to the prompt cache (#30498)
ServeurpersoCom Oct 15, 2026
1ddc262
graph: keep the graph non empty without embeddings (#30522)
ServeurpersoCom Oct 15, 2026
e467e5b
kv-cache: honor PARTIAL_ONLY in the plain KV cache (#30514)
ServeurpersoCom Oct 15, 2026
6e66cb5
metal : add BF16 variant of the tensor API flash attention kernel (#3…
ethanhq Oct 15, 2026
5a638ae
cpu: add F16 SWIGLU_OAI reference implementation and validation (#29200)
cqderek Oct 15, 2026
733f57a
vulkan : copy strided f16 KV once on AMD so reads spread across memor…
Nathanw1014 Oct 15, 2026
77c1f39
opencl: apply flash attn softcap before mask (#30546)
lhez Oct 15, 2026
68ac765
llama : split llama_prefetch() into merge and prefetch steps (#30532)
angt Oct 15, 2026
2ce20d2
unicode : reject overlong UTF-8 and out-of-range codepoints (#30485)
simoneiacomino Oct 15, 2026
23f83e0
ggml-cpu : optimize pad_f32 (#30526)
angt Oct 15, 2026
2130ca8
jinja : fix loop body variable scoping (#30533)
Ninja3047 Oct 15, 2026
9166cea
opencl: fix OOB tail access for adreno noshuffle gemv kernels (#30421)
lhez Oct 15, 2026
e36df60
sycl : replace oneAPI package by DLE+oneDNN package (#30131)
arthw Oct 15, 2026
47f5a64
vulkan : fix concurrent first device init (#29766)
losewayy Oct 15, 2026
82e1e2f
jinja : write nan and inf in tojson as json.dumps does (#30483)
ykhrustalev Oct 15, 2026
08698c8
jinja : improve context copy constructor performance (#30562)
Ninja3047 Oct 15, 2026
3e4dfa8
models : add maion-coder (#29778)
mailkv23 Oct 15, 2026
fd55cb9
fix(ui): take the agentic turns default from DEFAULT_AGENTIC_CONFIG (…
allozaur Oct 15, 2026
711780f
ci : bump ty to 0.0.88 (#30587)
CISC Oct 15, 2026
4ed1c85
ggml : bump version to 0.27.0
ggerganov Oct 15, 2026
c0cb53a
sync : ggml
ggerganov Oct 15, 2026
b0d2391
server: prefer empty slots and keep states overwritten by child tasks…
ServeurpersoCom Oct 15, 2026
ea736c1
server: save the draft state in the slot file (#30574)
ServeurpersoCom Oct 15, 2026
a6b91d8
model : Mellum - read MoE gating params from GGUF, unify RoPE (#30578)
Xarbirus Oct 15, 2026
61ad80b
server: fix the off-by-two in the SWA reuse threshold (#30580)
ServeurpersoCom Oct 15, 2026
a11b653
scripts : add ci-status.sh to list active CI runs (#30586)
ggerganov Oct 15, 2026
cd0a5b6
models : add Nemotron Super 3.5 VL and Nemotron Bolt 74B A9B support …
frozenblade1224 Oct 15, 2026
620d222
llama.cpp : bump version to 0.7.0 (#30603)
ggerganov Oct 15, 2026
b76b133
pi : expand AI disclosure with hardware and stats (#30615)
ggerganov Oct 15, 2026
ba3c05f
model: add Muse Spark Open (text, vision and audio) (#30616)
ServeurpersoCom Oct 15, 2026
2f729cf
mtmd: lightonocr does not require longest edge to always be 1540, nat…
staghado Oct 15, 2026
e287bd8
convert : fix regression in mapping of Granite speech tensors (#30628)
mrutkows Oct 15, 2026
59d5fad
convert : fix Granite Switch block_count for MultiSwitch checkpoints …
planetf1 Oct 15, 2026
2851b3b
mtmd: add mtmd_audio_stream + support voxtral-realtime (#30629)
ngxson Oct 15, 2026
43d57fb
[SYCL] Enable ssl in build script and CI (#30456)
arthw Oct 16, 2026
e707790
sycl: support reordered Q8_0 MoE weights (#29337)
newjordan Oct 16, 2026
b6334e3
Limit max CUDA pinned host buffer size to 4 GB (#30449)
gaugarg-nv Oct 16, 2026
6afa9a3
llama : share the k-pool input views between layers (#30613)
am17an Oct 16, 2026
b797b9c
hexagon: tensor repacking rework and support for tiled and flat quant…
max-krasnyansky Oct 16, 2026
5e03a1f
graph : add precision handling for MELLUM architecture (#30584)
Xarbirus Oct 16, 2026
f12aaa3
Fix failing RocM tests (#30611)
mailkv23 Oct 16, 2026
a8d9a7e
vulkan: fix gpu-visible host memory issues (#30468)
0cc4m Oct 16, 2026
88aaf32
tests : catch vanished rows in the fusion baseline (#30618)
ggerganov Oct 16, 2026
13de11e
sycl: wide stores for the q4_K/q5_K weight dequant (#29696)
Titaniumtown Oct 16, 2026
c0083e3
sycl : reduce the build threads to half (#30236)
arthw Oct 16, 2026
c804754
ggml-cpu: refactor s309x repack helper functions (#30588)
taronaeo Oct 16, 2026
3dbcb7f
cpu : reduce AVX2 tiled accumulators together (#30296)
trivalik Oct 16, 2026
0f43762
convert : support text-only checkpoints in pplx-decider (#30575)
final-bench Oct 16, 2026
13b8048
common : read ngram cache parts by reference instead of copying (#30061)
jadidbourbaki Oct 16, 2026
623c163
CUDA: HIP: rms_norm: add variants that load float4 at a time and stor…
IMbackK Oct 16, 2026
495c580
gguf-py : add numpy Q1_0 and Q2_0 de/quantization support (#30630)
SomeNobody21112 Oct 16, 2026
a30fb49
[SYCL]: fix memory errors in mul_mat, split buffer, host pool (#29889)
mctylr-gh Oct 16, 2026
854ce65
model : add dspark GIDD log-SNR conditioning for DFlash draft models
figkcoci-debug Oct 16, 2026
aefba75
gguf-py : add dspark log-SNR tensor constants
figkcoci-debug Oct 16, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
4 changes: 2 additions & 2 deletions .devops/cann.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -145,7 +145,7 @@ ENTRYPOINT ["/app/tools.sh"]
# ==============================================================================
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

ENTRYPOINT [ "/app/llama-cli" ]

Expand All @@ -157,7 +157,7 @@ FROM base AS server
ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

HEALTHCHECK --interval=5m CMD [ "curl", "-f", "http://localhost:8080/health" ]

Expand Down
4 changes: 2 additions & 2 deletions .devops/cpu.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -104,7 +104,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -116,7 +116,7 @@ FROM base AS server
ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
4 changes: 2 additions & 2 deletions .devops/cuda.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -113,7 +113,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -125,7 +125,7 @@ FROM base AS server
ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
15 changes: 10 additions & 5 deletions .devops/intel.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,12 @@ RUN npm ci
COPY tools/ui/ ./
RUN LLAMA_BUILD_NUMBER="$APP_VERSION" npm run build

FROM docker.io/intel/oneapi-toolkit:$ONEAPI_VERSION AS build
FROM docker.io/intel/deep-learning-essentials:$ONEAPI_VERSION AS build

RUN echo "Download oneDNN installation package" && \
wget https://registrationcenter-download.intel.com/akdlm/IRC_NAS/94c3dbac-0852-45be-a57d-21c204cada3e/intel-onednn-2026.0.2.46_offline.sh -O intel-onednn_offline.sh && \
echo "Install oneDNN components" && \
bash intel-onednn_offline.sh -s -a --silent --eula accept

ARG GGML_SYCL_F16=ON
ARG LEVEL_ZERO_VERSION=1.28.2
Expand All @@ -45,7 +50,7 @@ RUN if [ "${GGML_SYCL_F16}" = "ON" ]; then \
fi && \
echo "Building with dynamic libs" && \
cmake -B build -DGGML_NATIVE=OFF -DGGML_SYCL=ON -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx -DGGML_BACKEND_DL=ON -DGGML_CPU_ALL_VARIANTS=ON -DLLAMA_BUILD_TESTS=OFF ${OPT_SYCL_F16} && \
cmake --build build --config Release -j$(nproc)
cmake --build build --config Release -j$((($(nproc)+1)/2))

RUN mkdir -p /app/lib && \
find build -name "*.so*" -exec cp -P {} /app/lib \;
Expand Down Expand Up @@ -102,7 +107,7 @@ RUN mkdir /tmp/neo/ && cd /tmp/neo/ \
&& dpkg --install *.deb

RUN apt-get update \
&& apt-get install -y libgomp1 curl ffmpeg \
&& apt-get install -y libgomp1 curl ffmpeg openssl libssl-dev \
&& apt autoremove -y \
&& apt clean -y \
&& rm -rf /tmp/* /var/tmp/* \
Expand Down Expand Up @@ -141,7 +146,7 @@ ENTRYPOINT ["/app/tools.sh"]
FROM base AS light

COPY --from=build /app/lib/ /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -154,7 +159,7 @@ ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/lib/ /app
COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
4 changes: 2 additions & 2 deletions .devops/musa.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -120,7 +120,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -132,7 +132,7 @@ FROM base AS server
ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
4 changes: 2 additions & 2 deletions .devops/rocm.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -126,7 +126,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -138,7 +138,7 @@ FROM base AS server
ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
4 changes: 2 additions & 2 deletions .devops/vulkan.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -119,7 +119,7 @@ FROM base AS server
ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
4 changes: 2 additions & 2 deletions .devops/zendnn.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -97,7 +97,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -109,7 +109,7 @@ FROM base AS server
ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/build-apple.yml
Original file line number Diff line number Diff line change
Expand Up @@ -105,7 +105,7 @@ jobs:
cd build
# Metal Paravirtual devices are difficult to support -> disable
# ref: https://github.com/ggml-org/llama.cpp/pull/19802#issuecomment-4013704023
ctest -L main -E "test-llama-archs|test-save-load-state|test-recurrent-state-rollback" --verbose --timeout 900
ctest -L main -E "test-llama-archs|test-llama-context" --verbose --timeout 900

macos-latest-x64:
runs-on: macos-15-intel
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/build-cache.yml
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ jobs:
runs-on: ubuntu-24.04

env:
# Sync versions in build-openvino.yml, build-self-hosted.yml, release.yml, build-cache.yml, .devops/openvino.Dockerfile
# Sync versions in build-openvino.yml, ci-self-hosted-openvino.yml, release.yml, release-publish.yml, build-cache.yml, .devops/openvino.Dockerfile, docs/backend/OPENVINO.md
OPENVINO_VERSION_MAJOR: "2026.4.1"
OPENVINO_VERSION_FULL: "2026.4.1.22982.07f9c262b05"

Expand Down Expand Up @@ -72,7 +72,7 @@ jobs:
runs-on: windows-2022

env:
# Sync versions in build.yml, build-self-hosted.yml, release.yml, build-cache.yml, .devops/openvino.Dockerfile
# Sync versions in build-openvino.yml, ci-self-hosted-openvino.yml, release.yml, release-publish.yml, build-cache.yml, .devops/openvino.Dockerfile, docs/backend/OPENVINO.md
OPENVINO_VERSION_MAJOR: "2026.4.1"
OPENVINO_VERSION_FULL: "2026.4.1.22982.07f9c262b05"

Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/build-openvino.yml
Original file line number Diff line number Diff line change
Expand Up @@ -37,14 +37,14 @@ env:
LLAMA_ARG_LOG_PREFIX: 1
LLAMA_ARG_LOG_TIMESTAMPS: 1
# TODO: fix failing tests on OpenVINO backend
CTEST_EXCLUDE: "test-llama-archs|^test-recurrent-state-|test-save-load-state"
CTEST_EXCLUDE: "test-llama-archs|test-llama-context"

jobs:
ubuntu-24-openvino:
runs-on: [self-hosted, Linux, Intel, OpenVINO]

env:
# Sync versions in build-openvino.yml, build-self-hosted.yml, release.yml, build-cache.yml, .devops/openvino.Dockerfile
# Sync versions in build-openvino.yml, ci-self-hosted-openvino.yml, release.yml, release-publish.yml, build-cache.yml, .devops/openvino.Dockerfile, docs/backend/OPENVINO.md
OPENVINO_VERSION_MAJOR: "2026.4.1"
OPENVINO_VERSION_FULL: "2026.4.1.22982.07f9c262b05"

Expand Down Expand Up @@ -104,7 +104,7 @@ jobs:
contents: read

env:
# Sync versions in build-openvino.yml, build-self-hosted.yml, release.yml, build-cache.yml, .devops/openvino.Dockerfile
# Sync versions in build-openvino.yml, ci-self-hosted-openvino.yml, release.yml, release-publish.yml, build-cache.yml, .devops/openvino.Dockerfile, docs/backend/OPENVINO.md
OPENVINO_VERSION_MAJOR: "2026.4.1"
OPENVINO_VERSION_FULL: "2026.4.1.22982.07f9c262b05"

Expand Down
27 changes: 21 additions & 6 deletions .github/workflows/build-sycl.yml
Original file line number Diff line number Diff line change
Expand Up @@ -67,8 +67,15 @@ jobs:
shell: bash
run: |
cd /tmp
wget https://registrationcenter-download.intel.com/akdlm/IRC_NAS/5996e26b-f48a-42b1-8db0-b002ad0bd8d7/intel-oneapi-toolkit-2026.1.1.33_offline.sh -O intel-oneapi-toolkit_offline.sh
sudo bash intel-oneapi-toolkit_offline.sh -s -a --silent --eula accept
echo "Download oneAPI Deep Learning Essentials installation package"
wget https://registrationcenter-download.intel.com/akdlm/IRC_NAS/b5c100a7-8052-4e88-90e2-63d9916a998b/intel-deep-learning-essentials-2026.1.4.17_offline.sh -O intel-deep-learning-essentials_offline.sh
echo "Install oneAPI Deep Learning Essentials components"
sudo bash intel-deep-learning-essentials_offline.sh -s -a --silent --eula accept

echo "Download oneDNN installation package"
wget https://registrationcenter-download.intel.com/akdlm/IRC_NAS/94c3dbac-0852-45be-a57d-21c204cada3e/intel-onednn-2026.0.2.46_offline.sh -O intel-onednn_offline.sh
echo "Install oneDNN components"
sudo bash intel-onednn_offline.sh -s -a --silent --eula accept

- name: Install Level Zero SDK
shell: bash
Expand All @@ -79,6 +86,12 @@ jobs:
wget -q "https://github.com/oneapi-src/level-zero/releases/download/v${LEVEL_ZERO_VERSION}/libze-dev_${LEVEL_ZERO_VERSION}%2B${LEVEL_ZERO_UBUNTU_VERSION}_amd64.deb" -O libze-dev.deb
sudo apt-get install -y ./libze1.deb ./libze-dev.deb

- name: Dependencies
id: depends
run: |
sudo apt-get update
sudo apt-get install -y libssl-dev

- name: ccache
uses: ggml-org/ccache-action@v1.2.24
with:
Expand All @@ -104,7 +117,6 @@ jobs:
-DGGML_SYCL=ON \
-DCMAKE_C_COMPILER=icx \
-DCMAKE_CXX_COMPILER=icpx \
-DLLAMA_OPENSSL=OFF \
-DGGML_NATIVE=OFF \
-DGGML_SYCL_F16=${{ matrix.fp16 }} \
-DGGML_SYCL_SUPPORT_LEVEL_ZERO_API=ON \
Expand Down Expand Up @@ -138,8 +150,10 @@ jobs:
shell: bash

env:
WINDOWS_BASEKIT_URL: https://registrationcenter-download.intel.com/akdlm/IRC_NAS/0cb67a0d-67f6-410b-868b-f4a0a17ff0cf/intel-oneapi-toolkit-2026.1.1.32_offline.exe
WINDOWS_DPCPP_MKL: intel.oneapi.win.cpp-dpcpp-common:intel.oneapi.win.mkl.devel:intel.oneapi.win.dnnl:intel.oneapi.win.tbb.devel
WINDOWS_DLE_URL: https://registrationcenter-download.intel.com/akdlm/IRC_NAS/a51104eb-6f4a-4a0e-9dae-1b81b0c81ae1/intel-deep-learning-essentials-2026.1.4.16_offline.exe
WINDOWS_ONEDNN_URL: https://registrationcenter-download.intel.com/akdlm/IRC_NAS/34e28083-d04b-46a3-826c-8c1d00bf1e1c/intel-onednn-2026.0.2.47_offline.exe
WINDOWS_DPCPP_MKL: intel.oneapi.win.cpp-dpcpp-common:intel.oneapi.win.mkl.devel:intel.oneapi.win.tbb.devel
WINDOWS_DNNL: intel.oneapi.win.dnnl
LEVEL_ZERO_SDK_URL: https://github.com/oneapi-src/level-zero/releases/download/v1.33.1/level-zero-win-sdk-1.33.1.zip
ONEAPI_ROOT: "C:/Program Files (x86)/Intel/oneAPI"
ONEAPI_INSTALLER_VERSION: "2026.1"
Expand All @@ -151,7 +165,8 @@ jobs:
- name: Download & Install oneAPI
shell: bash
run: |
scripts/install-oneapi.bat $WINDOWS_BASEKIT_URL $WINDOWS_DPCPP_MKL
scripts/install-oneapi.bat $WINDOWS_DLE_URL $WINDOWS_DPCPP_MKL
scripts/install-oneapi.bat $WINDOWS_ONEDNN_URL $WINDOWS_DNNL

- name: Install Level Zero SDK
shell: pwsh
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/ci-self-hosted-openvino.yml
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ jobs:
runs-on: [self-hosted, Linux, Intel, OpenVINO]

env:
# Sync versions in build.yml, build-self-hosted.yml, release.yml, build-cache.yml, .devops/openvino.Dockerfile
# Sync versions in build-openvino.yml, ci-self-hosted-openvino.yml, release.yml, release-publish.yml, build-cache.yml, .devops/openvino.Dockerfile, docs/backend/OPENVINO.md
OPENVINO_VERSION_MAJOR: "2026.4.1"
OPENVINO_VERSION_FULL: "2026.4.1.22982.07f9c262b05"

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/python-type-check.yml
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ jobs:
uses: actions/setup-python@v6
with:
python-version: "3.11"
pip-install: -r requirements/requirements-all.txt ty==0.0.84
pip-install: -r requirements/requirements-all.txt ty==0.0.88
# - name: Type-check with Pyright
# uses: jakebailey/pyright-action@v2
# with:
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/release-publish.yml
Original file line number Diff line number Diff line change
Expand Up @@ -178,7 +178,7 @@ jobs:
- [Ubuntu x64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-ubuntu-cuda-13.4-x64.tar.gz) - [CUDA 13.4 libraries](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/cudart-llama-${{ steps.tag.outputs.name }}-bin-ubuntu-cuda-13.4-x64.tar.gz)
- [Ubuntu arm64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-ubuntu-cuda-13.4-arm64.tar.gz) - [CUDA 13.4 libraries](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/cudart-llama-${{ steps.tag.outputs.name }}-bin-ubuntu-cuda-13.4-arm64.tar.gz)
- [Ubuntu x64 (ROCm 10.0)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-ubuntu-rocm-10.0-x64.tar.gz)
- [Ubuntu x64 (OpenVINO)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-ubuntu-openvino-${{ needs.ubuntu-24-openvino.outputs.openvino_version }}-x64.tar.gz)
- [Ubuntu x64 (OpenVINO)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-ubuntu-openvino-2026.4.1-x64.tar.gz)
- [Ubuntu x64 (SYCL FP32)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-ubuntu-sycl-fp32-x64.tar.gz)
- [Ubuntu x64 (SYCL FP16)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-ubuntu-sycl-fp16-x64.tar.gz)
- [Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-linux-arm64-snapdragon.tar.gz) - [setup guide](https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/linux.md)
Expand All @@ -196,7 +196,7 @@ jobs:
- [Windows arm64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-win-cuda-13.4-arm64.zip) - [CUDA 13.4 DLLs](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/cudart-llama-bin-win-cuda-13.4-arm64.zip)
- [Windows x64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-win-vulkan-x64.zip)
- [Windows arm64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-win-vulkan-arm64.zip)
- [Windows x64 (OpenVINO)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-win-openvino-${{ needs.windows-openvino.outputs.openvino_version }}-x64.zip)
- [Windows x64 (OpenVINO)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-win-openvino-2026.4.1-x64.zip)
- [Windows x64 (SYCL)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-win-sycl-x64.zip)
- [Windows x64 (ROCm 10.0)](https://github.com/ggml-org/llama.cpp/releases/download/${{ steps.tag.outputs.name }}/llama-${{ steps.tag.outputs.name }}-bin-win-rocm-10.0-x64.zip)

Expand Down
Loading
Loading