Zypper repo of Cuda for Opensuse points here. Works on Tumbleweed, but may often break due to lacking behind Tumbleweed. But this is the only way to get cuda-toolkit, including things like nvidia-smi to work
Unsloth Dynamic V3.1 (Nov 2026) is our latest quantization algorithm for Qwen3.8-27B, DeepSeek-V4.1-Flash-1017 and Qwen3.8-Flash-Next, resulting in 10-15% increased accuracy and 50% less token usage vs other quants of the same size. We're working on an even better version of Dynamic quants which will be applied to Qwen4 and all future models.
Also A) DeepSeekFlash-4.1-550B-FP16-1TB is better at coding than Qwen-3.8-27B-Q??-S??. B) If using Strata: 1) SSD NVMe PCIe 4.0 2) Faster CPU matters!! C) 17:10 DeepSeek: Typical coding agent step: send/reads ~ 3,000 new tokens (needs 25s) , writes ~ 750 (needs 150s). The rest of tokens, ~120,000 tokens, is already cached. D) NOTE Qwen is 5 times FASTER at the above E) on 2026-10-07, llama.cpp added their own GPU cache for MoE models.
Full-stack local AI, all on one harness/agent (uses Hermess agent) is defined as : 1) LLM with images 2) context 100K tokens 3) image generation 4) embedding - huge memory of AI 5) speech to text to understand speech 6) text to speech for answer as speech
7) video generation is NOT possible on 32GB
GPU price history. RTX should be about CDN $400. 2026-11-11 it is $631. GeForce RTX 3060 12GB price history in Canada: current low $631 CAD, 12-month low $367 CAD, 12-month median $549 CAD.
This is hopefully a simple tutorial on compiling llama.cpp on the DGX Spark, once compiled, it can be used to run GGML-based LLM models directly on the command line, served as an OpenAI compatible API, or accessed via a web browser (which is what we’ll be doing for this tutorial).
For most Spark workloads, f16 is the right default. 128GB unified memory means there's no KV cache memory pressure to solve. The exception is extreme concurrency or 500K+ context, where q8_0 makes sense.
Max is slower than a DGX Spark for diffusion models. Those are compute bound and a Mac has like 60TFlops Fp16 while a Spark had 140.
And it's x2 and x4 for Fp8 and Fp4 on the spark. For Mac it's unsure given that Fp32 and Fp16 go at the same speed.