Krasis LLM Runtime: 8.9x Prefill, 10.2x Decode vs llama.cpp on Qwen3.5-122B Single RTX 5090
r/LocalLLaMA·medium signal
A new LLM runtime called Krasis claims 8.9x prefill and 10.2x decode speedup over llama.cpp running Qwen3.5-122B on a single RTX 5090 with minimal RAM. The author posted a correction confirming the higher decode figure. If benchmarks hold under third-party validation, this represents a significant local inference efficiency breakthrough for large models on consumer hardware.