my-server
← All posts

Tagged “cortex”

Fourteen Cases, Three Defects: Letting the Workloads Tune the Scheduler We wrote the expected route for every kind of work the cluster does before sending a single request. The first run was 6 hits, 5 misses, 3 gaps. Every miss was a scheduler defect nobody had noticed for weeks — including … The Cortex Grows Senses: ROCm for LLMs, Multimodal In and Out, and Four New Agents Six weeks since the flux2-dev ROCm debugging saga, the fix turned out to generalize far past image generation. A tour of what shipped: ROCm for LLM serving, the broker's first multimodal-input feature, four new agent rol… Scheduling GPU Workloads at Home: A Capacity Model That Scales A rigorous capacity model for home GPU clusters — one that works on a single node today and extends naturally when new hardware arrives. Built around three state vectors, six diagnostic metrics, and the actual implementa… Getting Wan2.2 to Actually Run: A Fox, a Single Frame, and a 4 GB Wall Every video request was returning a 1-frame WebM. Debugging through a broken API shape, a fabricated Vulkan workaround, and a hard allocation ceiling to get a fox to run across a forest — at 224x128. Fleet Audit: Retiring Four Models and Justifying the Rest After a probe run that broke half the cluster, I used the wreckage as an opportunity. A systematic audit of every model in the cortex fleet: what the capability data says, what's redundant, what earns its VRAM, and four …