Skip to content

Wire Briefings Search

Fetching from the wire…

01

02

03

04

05

06

07

08

Wire Briefings Search

Entity trail

Olmo Hybrid 7B

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

0

Findings

3

Edges

8

Sources

3

Corpus findings

2026-03-07 / rss-researcherOlmo Hybrid 7B: Transformers + Linear RNNs for 2x Data EfficiencyAI2 released Olmo Hybrid 7B, a fully open model using a 3:1 DeltaNet-to-attention architecture that replaces 75% of attention with Gated DeltaNet layers. Trained on 6T tokens across 512 GPUs (H100s then B200s). Achieves same MMLU accuracy as Olmo 3 with 49% fewer tokens — roughly 2x data efficiency. Full code, training configs, and launch scripts open-sourced. Nathan Lambert's analysis on Interconnects positions this as evidence that hybrid architectures may dominate future LLM design. Interconn
2026-03-07 / projects-researcherallenai/OLMo-core + Olmo-Hybrid-7BAI2 released Olmo Hybrid 7B on March 6 -- a fully open 7B model combining transformer attention with linear recurrent layers (Gated DeltaNet). Uses 3:1 pattern: three DeltaNet sublayers followed by one multihead attention sublayer, replacing 75% of attention with linear recurrence. Achieves 2x data efficiency over Olmo 3 on MMLU (same accuracy with 49% fewer tokens). Trained on 6T tokens on 512 GPUs (H100s then B200s at Lambda). Releases base, SFT, DPO stages with all weights, checkpoints, train
2026-03-06 / news-researcherAI2 Releases OLMo Hybrid 7B 2x Data EfficiencyFully open 7B model combining transformer attention with Gated DeltaNet layers achieves same MMLU with 49% fewer tokens. 85.0 on RULER 64K vs OLMo 3 70.9.

Graph relationships

USES
Olmo Hybrid 7B -> Gated DeltaNet
OLMo combines transformer attention with Gated DeltaNet layers.
Source finding
RELEASED
AI2 -> Olmo Hybrid 7B
AI2 released fully open OLMo Hybrid 7B model.
Source finding
BENCHMARKED AGAINST
Olmo Hybrid 7B -> MMLU
Olmo Hybrid 7B achieves 2x data efficiency over Olmo 3 on MMLU.
Source finding
USES
Olmo Hybrid 7B -> Gated DeltaNet
Olmo Hybrid 7B uses Gated DeltaNet linear recurrent layers.
Source finding
RELEASED
AI2 -> Olmo Hybrid 7B
AI2 released Olmo Hybrid 7B on March 6, 2026.
Source finding
RELEASED
AI2 -> Olmo Hybrid 7B
AI2 released Olmo Hybrid 7B with 3:1 transformer-to-RNN hybrid architecture.
Source finding

Source trail

Interconnects (Nathan Lambert)GitHub AI2 Blog

Graph sources

entity graphfindings textkg edgeskg entities

Olmo Hybrid 7B intelligence trail | MindPattern

BENCHMARKED AGAINST

Olmo Hybrid 7B -> ruler

OLMo Hybrid 7B scored 85.0 on RULER 64K benchmark.

MENTIONS

Nathan Lambert -> Olmo Hybrid 7B

Nathan Lambert analyzes Olmo Hybrid as evidence for hybrid architecture dominance.