Reddit
Qwen3.6-35B-A3B Spontaneously Hallucinated Context Window Full — Emergent Self-Monitoring Behavior
A r/LocalLLaMA user (113 upvotes, 35 comments) discovered Qwen3.6-35B-A3B spontaneously hallucinating that its context window was full despite having capacity remaining, fabricating a contextual awareness signal at approximately the right moment. The unexpected emergent behavior suggests the model learned to approximate context-length tracking from training data, but unreliably — a potential production reliability concern for developers relying on MoE models for long-context tasks without explicit context management.
Source
↳ Follow the thread