CACHE-UK Addresses the 'Quantization Stability Crisis' Blocking Sequential Memory Edits in 4-Bit LLMs

arXiv·low signalXBlueskyLinkedInCopy link

LLMs deployed in finance must track continuously changing market conditions, regulations, and corporate facts, but the 4-bit quantization that makes deployment affordable causes existing sequential memory-editing methods to degrade catastrophically — what the authors name the quantization stability crisis. CACHE-UK is a stability-aware contextual adaptive continual hybrid editor built for sequentially updated quantized models. The general problem generalizes well beyond finance: any team running a quantized model that needs periodic factual updates without full retraining is hitting the same wall.