dan

Repositories

1

Projects Packages

40

Public activity Starred repositories

llama-cpp-vulkan-mainline-swap (b10241-vulkan-swap)

Published 2026-08-03 19:13:12 +00:00 by dan

Installation

Pull the image from the command line:

docker pull forge.coffee-anon.com/dan/llama-cpp-vulkan-mainline-swap:b10241-vulkan-swap

Digest

sha256:97da40302a44ad4648e117c24f1b5f6165c04fedf674842a32ebeebafbb69577

For more information on the Container registry, see the documentation.

Image layers

KIWI 10.3.0

RUN /bin/sh -c microdnf -y --nodocs --setopt=install_weak_deps=0 install bash ca-certificates libatomic libstdc++ libgcc libibverbs vulkan-loader vulkan-loader-devel vulkaninfo mesa-vulkan-drivers radeontop procps-ng && microdnf clean all && rm -rf /var/cache/dnf/* # buildkit

COPY /usr/ /usr/ # buildkit

COPY /usr/local/ /usr/local/ # buildkit

COPY /opt/llama.cpp/build/bin/ggml-rpc-* /usr/local/bin/ # buildkit

RUN /bin/sh -c echo "/usr/local/lib" > /etc/ld.so.conf.d/local.conf && echo "/usr/local/lib64" >> /etc/ld.so.conf.d/local.conf && ldconfig && cp -n /usr/local/lib/libllama*.so* /usr/lib64/ 2>/dev/null || true && ldconfig # buildkit

COPY gguf-vram-estimator.py /usr/local/bin/gguf-vram-estimator.py # buildkit

RUN /bin/sh -c chmod +x /usr/local/bin/gguf-vram-estimator.py # buildkit

CMD ["/bin/bash"]

ARG LLAMACPP_TAG=b10241

LABEL maintainer=citizendaniel

LABEL description=llama.cpp Vulkan/RADV (official mainline prebuilt) + llama-swap

LABEL backend=vulkan-radv-mainline

LABEL gpu.target=gfx1151

LABEL llamacpp.tag=b10241

LABEL llamacpp.source=https://github.com/ggml-org/llama.cpp/releases

LABEL llamacpp.lightningindexer.pr=https://github.com/ggml-org/llama.cpp/pull/24231

LABEL llamacpp.unfusedfallback.pr=https://github.com/ggml-org/llama.cpp/pull/25407

LABEL llamaswap.version=197

COPY /opt/llamacpp /opt/llamacpp # buildkit

COPY /tmp/llama-swap /usr/bin/llama-swap # buildkit

RUN |1 LLAMACPP_TAG=b10241 /bin/sh -c set -eux; for b in /opt/llamacpp/llama-*; do [ -x "$b" ] && ln -sf "$b" "/usr/bin/$(basename "$b")"; done; echo /opt/llamacpp > /etc/ld.so.conf.d/llamacpp-vulkan.conf; ldconfig # buildkit

ENV LD_LIBRARY_PATH=/opt/llamacpp

RUN |1 LLAMACPP_TAG=b10241 /bin/sh -c set -eu; tag="${LLAMACPP_TAG:-unknown}"; /usr/bin/llama-server --help >/tmp/h.txt 2>&1 || true; test -s /tmp/h.txt || { echo "FATAL: llama-server produced no output — check glibc linkage"; exit 1; }; for flag in draft-mtp draft-dspark ngram-mod; do grep -q "$flag" /tmp/h.txt || { echo "FATAL: --spec-type lacks ${flag} in ${tag}"; exit 1; }; done; test -x /usr/bin/llama-swap; rm -f /tmp/h.txt; echo "OK: draft-mtp + draft-dspark + ngram-mod present in ${tag}" # buildkit

EXPOSE [8080/tcp]

ENTRYPOINT ["/usr/bin/llama-swap"]

CMD ["--config" "/config/llama-swap/config.yaml" "--listen" "0.0.0.0:8080"]

Labels

Key	Value
backend	vulkan-radv-mainline
description	llama.cpp Vulkan/RADV (official mainline prebuilt) + llama-swap
gpu.target	gfx1151
io.buildah.version	1.43.2
license	MIT
llamacpp.lightningindexer.pr	https://github.com/ggml-org/llama.cpp/pull/24231
llamacpp.source	https://github.com/ggml-org/llama.cpp/releases
llamacpp.tag	b10241
llamacpp.unfusedfallback.pr	https://github.com/ggml-org/llama.cpp/pull/25407
llamaswap.version	197
maintainer	citizendaniel
name	fedora-minimal
org.opencontainers.image.license	MIT
org.opencontainers.image.licenses	MIT
org.opencontainers.image.name	fedora-minimal
org.opencontainers.image.title	fedora-minimal
org.opencontainers.image.url	https://fedoraproject.org/
org.opencontainers.image.vendor	Fedora Project
org.opencontainers.image.version	43
vendor	Fedora Project
version	43

Details

Container

2026-08-03 19:13:12 +00:00

2

OCI / Docker

linux/amd64

MIT

Project website

605 MiB

Versions (1) View all

b10241-vulkan-swap 2026-08-03