LLM Decoder Block Evolution Visualized During 5B Token Training — K-Splanifold Spline Manifold Research Shared on r/LocalLLaMA

r/LocalLLaMA·low signal

A researcher training an experimental model shared visualizations of how the MLP decoder blocks evolve when replaced with discrete lower-dimensional spline manifold geometry (K-Splanifold). The post drew 126 upvotes and 26 comments on r/LocalLLaMA. The visualization shows the decoder learning discrete structure over 5B tokens of training, offering rare insight into transformer internals during training — most published work only shows before/after comparisons, not the continuous evolution.