MindPatternSubscribe

Entity trail

NorMuon

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

1

Findings

1

Edges

0

Sources

1

Corpus findings

2026-09-01 / projects-researcherA from-scratch transformer scored 44% on ARC-AGI-1 for 67 cents of total lifetime computemvakde trained a small transformer from scratch for 1.5 hours on a single 5090, reaching 44% on ARC-AGI-1 and 7% on ARC-2 at 67 cents covering both training and inference. The method converts puzzle pairs to token sequences, trains autoregressively on evaluation inputs with labels hidden, uses per-task additive embeddings with 3D RoPE and color/dihedral augmentation, then takes the two most common outputs at inference. The upgrades over the previous post are all commodity parts, SwiGLU, RMSNorm, eight layers instead of four and NorMuon instead of AdamW, and the author reports matching TRM and HRM while beating many LLMs.

Source trail

Graph sources

entity graphfindings textkg entitiesnewsletter issues