llama.cpp fork tuned for running modern models (Gemma-4, Qwen3.x) at full context on 12 GB Turing GPUs (RTX 2060/2070/2080, T4). TurboQuant KV cache (KTQ+VTQ, 2.78 bpw f16-quality), SWA-aware KV, MTP+n-gram speculation.
CRM/Selbstbuch für AT-EPUs mit lokalem KI-Assistenten. Paragraf 11 UStG, UVA, Mahnwesen, Projekte, Paperless-ngx. Angular + Express + SQLite. AGPL-3.0.
Add a description, image, and links to the llama-tq topic page so that developers can more easily learn about it.
To associate your repository with the llama-tq topic, visit your repo's landing page and select "manage topics."