dan

Repositories

1

Projects Packages

52

Public activity Starred repositories

llama-cpp-qwen38-mtp-converter (pr144-b8e89f2-hfrev1)

Published 2026-08-31 16:53:44 +00:00 by dan

Installation

Pull the image from the command line:

docker pull forge.coffee-anon.com/dan/llama-cpp-qwen38-mtp-converter:pr144-b8e89f2-hfrev1

Digest

sha256:b51b9faec36251850ca073ae34b8e9ae747a31fb0072ac7176a8a454b454c07c

For more information on the Container registry, see the documentation.

Image layers

LABEL maintainer=Clement Verna <cverna@fedoraproject.org>

ENV DISTTAG=f43container FGC=f43 FBR=f43

ADD fedora-20260826.tar / # buildkit

CMD ["/bin/bash"]

RUN /bin/sh -c dnf install -y python3 python3-pip vulkan-loader libcurl libgomp && dnf clean all # buildkit

RUN /bin/sh -c python3 -m venv /opt/converter-venv # buildkit

RUN /bin/sh -c /opt/converter-venv/bin/pip install --no-cache-dir --extra-index-url https://download.pytorch.org/whl/cpu torch==2.11.0 # buildkit

RUN /bin/sh -c /opt/converter-venv/bin/pip install --no-cache-dir 'numpy>=1.26.4,<3.0.0' 'sentencepiece>=0.1.98,<0.3.0' 'transformers==4.57.6' 'protobuf>=4.21.0,<5.0.0' # buildkit

ARG LLAMA_CPP_COMMIT=b8e89f2f365dbe4ec04915ad576a041a4706dffd

ARG REVISION_PATCH_SHA256=d066041daabe0b2ca22f2cbb9a6ba0a554163cfad451ff1c6600904e070cb0b3

LABEL maintainer=citizendaniel

LABEL org.opencontainers.image.revision=b8e89f2f365dbe4ec04915ad576a041a4706dffd

LABEL org.opencontainers.image.source=https://github.com/unslothai/llama.cpp

LABEL llamacpp.pr=https://github.com/unslothai/llama.cpp/pull/144

LABEL converter.revision-patch.sha256=d066041daabe0b2ca22f2cbb9a6ba0a554163cfad451ff1c6600904e070cb0b3

ENV PATH=/opt/converter-venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin

ENV PYTHONPATH=/opt/llama.cpp/gguf-py

COPY /llama.cpp /opt/llama.cpp # buildkit

COPY /staging/usr/bin/llama-quantize /usr/bin/llama-quantize # buildkit

COPY /staging/usr/lib64/ /usr/lib64/ # buildkit

COPY tools/mtp_sidecar.py /usr/bin/mtp-sidecar # buildkit

COPY tests/ /opt/sidecar-tests/ # buildkit

RUN |2 LLAMA_CPP_COMMIT=b8e89f2f365dbe4ec04915ad576a041a4706dffd REVISION_PATCH_SHA256=d066041daabe0b2ca22f2cbb9a6ba0a554163cfad451ff1c6600904e070cb0b3 /bin/sh -c chmod +x /usr/bin/mtp-sidecar && ldconfig && test -x /usr/bin/llama-quantize # buildkit

Labels

Key	Value
converter.revision-patch.sha256	d066041daabe0b2ca22f2cbb9a6ba0a554163cfad451ff1c6600904e070cb0b3
llamacpp.pr	https://github.com/unslothai/llama.cpp/pull/144
maintainer	citizendaniel
org.opencontainers.image.revision	b8e89f2f365dbe4ec04915ad576a041a4706dffd
org.opencontainers.image.source	https://github.com/unslothai/llama.cpp

Details

Container

2026-08-31 16:53:44 +00:00

2

OCI / Docker

linux/amd64

Repository website

564 MiB

Versions (3) View all

pr144-b8e89f2-hfrev1 2026-08-31

debug-venv 2026-08-31

debug-python-base 2026-08-31