llama.cpp Tool 17 related events

Today
ConfirmedOpen Source2026-08-18 04:15 UTC

llama.cpp b10481: CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark (#26843)

1 source llama.cpp Meta NVIDIA

CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark Signed-off-by: ynankani ynankani@nvidia.com skip moe experts and allow others based on k geometry (allow only small idle tail) Signed-off-by…

GitHub Releases · ggml-org/llama.cpp
Yesterday
Limited sources2026-08-17 18:05 UTC

llama.cpp adaptive MTP PR#27210

1 source llama.cpp Meta

Just wanted to raise some attention to this PR I filed if anyone would like to try it out. This adds an adaptive MTP mode to llama.cpp which employs a fairly simple counting-style state machine to de…

Reddit r/LocalLLaMA
ConfirmedOpen Source2026-08-17 09:08 UTC

llama.cpp reaches the v0.1.0 release milestone

3 sources llama.cpp Meta

llama.cpp is apparently moving to semantic versioning instead of just sequential build numbers (like b10456). The first semantic version tag was created today: https://github.com/ggml-org/llama.cpp/r…

GitHub Releases · ggml-org/llama.cpp · Reddit r/LocalLLaMA · Hacker News Frontpage
ConfirmedOpen Source2026-08-17 17:18 UTC

llama.cpp b10472

1 source llama.cpp Meta

cuda : skip UMA override for HIP builds ( #27083 ) AMD APUs report accurate memory via hipMemGetInfo. Using MemAvailable over-promises on small-carveout systems. fixes #18159 Website: https://llama.a…

GitHub Releases · ggml-org/llama.cpp
Limited sources2026-08-17 14:36 UTC

noctrex/Ling-3.0-tiny-MXFP4_MOE-GGUF · Hugging Face

1 source Hugging Face llama.cpp

u/noctrex 👍 where's flash? 😄 Possibly fastest model(in this model size range). Share t/s stats. submitted by /u/pmttyji [link] [comments]

Reddit r/LocalLLaMA
ConfirmedOpen Source2026-08-17 14:08 UTC

llama.cpp v0.1.1

1 source llama.cpp Meta

Release v0.1.1

GitHub Releases · ggml-org/llama.cpp
ConfirmedOpen Source2026-08-17 14:01 UTC

llama.cpp b10470

1 source llama.cpp Meta

ci : push release tag explicitly in release.yml ( #27261 ) Add a "Create and push git tag" step to the release job, right before the "Create release" step. The tag is created with git tag and pushed…

GitHub Releases · ggml-org/llama.cpp
Limited sourcesAgents & Dev2026-08-17 13:05 UTC

After pushing 1M+ tokens through Qwen 3.8 27B, here is my optimal llama.cpp config for 16GB VRAM (73k Context, Agentic Coding)

1 source llama.cpp Meta Alibaba / Qwen

Following up on my previous post about my budget server setup (Intel N100 + RTX 5060 Ti 16GB), a few of you asked for a deeper dive into my actual inference config and real-world agentic performance.…

Reddit r/LocalLLaMA
Limited sources2026-08-17 08:58 UTC

Ling 3.0 support merged into llama.cpp

1 source llama.cpp Meta

Support for the new ling 3.0 models has been merged into llama.cpp: https://github.com/ggml-org/llama.cpp/pull/26608#event-29549472828 Ling tiny 8b1b - https://huggingface.co/inclusionAI/Ling-3.0-tin…

Reddit r/LocalLLaMA
ConfirmedOpen Source2026-08-17 06:58 UTC

llama.cpp tmp-testing-0

1 source llama.cpp Meta

ci : make release workflows use a deply key

GitHub Releases · ggml-org/llama.cpp
ConfirmedOpen Source2026-08-17 06:31 UTC

llama.cpp b10456

1 source llama.cpp Meta

sycl: fix thread/block count in quantized cpy kernel launches ( #27160 ) Adjusts the thread/block count to be proportional to the size of the quant, reducing under/over subscription. Largest perf imp…

GitHub Releases · ggml-org/llama.cpp
ConfirmedOpen Source2026-08-17 05:49 UTC

llama.cpp b10455

1 source llama.cpp Meta

[SYCL] support OP OPT_STEP_ADAMW, OPT_STEP_SGD ( #25268 ) fix conflict fix conflict of ops.md fix conflict of ops.md update the ops.md Co-authored-by: Neo Zhang Jianyu jianyu.zhang@intel.com Website:…

GitHub Releases · ggml-org/llama.cpp
Aug 16 · Sun
Limited sources2026-08-16 16:33 UTC

Let’s all thank Georgi Gerganov who gave use llama.cpp

1 source llama.cpp Meta

I was looking into the story a bit further earlier. Very interesting. Couldn’t have done it without him submitted by /u/on_line187 [link] [comments]

Reddit r/LocalLLaMA
ConfirmedOpen Source2026-08-16 12:55 UTC

llama.cpp b10453

1 source llama.cpp Meta

model : remove some ggml_concat ( #27176 ) Co-authored-by: Xuan Son Nguyen son@huggingface.co Website: https://llama.app macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI en…

GitHub Releases · ggml-org/llama.cpp
ConfirmedOpen Source2026-08-16 12:53 UTC

llama.cpp b10454: ci : fix dry-run reporting in make-release job [no ci] (#27167)

1 source llama.cpp Meta

This commit fixes the reporting in the make-release CI job when --dry-run is used. It will currently incorrectly report that all checks pass even if there are steps that fail. Refs: #26839 (comment)

GitHub Releases · ggml-org/llama.cpp
ConfirmedOpen Source2026-08-16 11:23 UTC

llama.cpp b10452

1 source llama.cpp Meta

chat: refactor handling supports_string_content / supports_typed_content ( #27130 ) better supports_string_content cap detect test: add "skip" messages_inp_normalizer Website: https://llama.app macOS…

GitHub Releases · ggml-org/llama.cpp
ConfirmedOpen Source2026-08-16 07:26 UTC

llama.cpp b10451

1 source llama.cpp Meta

llama : check LoRA tensor data is within file bounds ( #27056 ) llama : check LoRA tensor data is within file bounds Update src/llama-adapter.cpp Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@hu…

GitHub Releases · ggml-org/llama.cpp

llama.cpp Tool 17 related events

Today

Yesterday

Aug 16 · Sun