A month of solo work produces uncensored GGUFs for LongCat-Flash-Lite-Sparse at 1M context, and none of them run on upstream llama.cpp

r/LocalLLaMA·medium signalXBlueskyLinkedInCopy link

A 93-upvote r/LocalLLaMA release covers LongCat-Flash-Lite-Sparse (still 69B-A3B, but sparse attention and 1M context versus dense attention and 256k in the original), Qwen3.8-27B and Qwen3.5-122B-A10B with MTPs, Qwen3-Coder-Next, and Laguna-S2.1 with vision, all in GGUF. Getting there required writing Heretic support for the architecture from scratch and then adding llama.cpp support, and mainline llama.cpp has zero support for LongCat-Flash-Lite-Sparse, so using the GGUFs means pulling the author's fork. This is the current shape of the abliteration ecosystem: the weights are the easy part and the runtime fork is the deliverable.