my-server
← All posts

Tagged “llama-cpp”

The Devil's Advocate Verdict: Does a 122B Model Earn Its Keep on a Homelab APU? Challenged to find a demonstrable reason to keep a 122B MoE model in the fleet, or admit there isn't one. It's genuinely excellent at some things and unreliable at almost everything else — including the things it's good … The Instrument Is Part of the Experiment: How My Benchmark Framed a Quant for a Crime It Didn't Commit Three long-context probes failed against a 122B MoE, and the obvious suspect was quantization damage. A requant didn't fix it. A bigger thinking budget didn't fix it. The actual culprit was a single constant in my own pr… Chasing the qwen3 ROCm Ghost: Six Wrong Turns, a Fair Challenge, and Fixing 3 of 4 Models A two-day chase after a ROCm-only tool-calling corruption bug across the whole qwen3.x lineup: six hypotheses tested and killed, a production crash I caused and fixed, a real bug hiding in my own test harness, a collabor…