Every Kimi K3 GGUF on Hugging Face Is Currently Unloadable — llama.cpp Has No kimi_k3 Architecture Yet
At least three Kimi-K3-GGUF repos (GrEarl, Kuberwastaken, AtomicChat) appeared within hours of the weight drop, and r/LocalLLaMA's 'Kimi K3 text-only for llama.cpp' thread is openly waiting for someone who can run the conversion. The llama.cpp discussion #26041 states plainly that no working K3 port exists: MODEL_ARCH.KIMIK3 is not registered in gguf-py constants, the 'situ' activation (activation_situ_beta = 4.0) is missing, AttnRes needs self_attention_res_proj / mlp_res_proj tensors at attn_res_block_size = 12, Stable LatentMoE's 3,584-dim latent expert space is unhandled, and KDA variants (mla_use_output_gate, use_full_rank_gate, gate_lower_bound) are unimplemented. Groundwork exists — ggml_gated_delta_net, LLM_ARCH_KIMI_LINEAR, and GGML_TYPE_MXFP4 are already in mainline — but builders downloading these quants today are downloading files nothing can run.
↳ Follow the thread