Fetching from the wire…
01
02
03
04
05
06
07
08
Skills2026-06-28 · source-backed
Set use_dora=True in PEFT's LoRAConfig with the 2026 starting recipe (r=16, target_modules='all-linear'). DoRA decomposes weights into magnitude and direction and applies LoRA only to direction, yielding +3.7% on LLaMA-7B and +1 to 4.4% on larger models with zero added inference cost (Spheron). Free accuracy.
Each link below shares sources, entities, or timing with this story.
DoRA competes with LoRA / Shared entities / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (DoRA competes with LoRA); both cover Llama, LoRA; overlapping topics (cost, inference, lora).
DoRA competes with LoRA / Shared entity: LoRA / Shared topic / What happened next / Tension
Linked by a graph relationship (DoRA competes with LoRA); both cover LoRA; overlapping topics (cost, lora).
Meta released Llama / Shared entity: Llama / What happened next
Linked by a graph relationship (Meta released Llama); both cover Llama; picks up the Llama thread on 2026-07-19.
Meta released Llama / Shared entity: Llama / Earlier coverage
Linked by a graph relationship (Meta released Llama); both cover Llama; earlier Llama coverage from 2026-06-15.
Linked by a graph relationship (Meta released Llama); both cover Llama; earlier Llama coverage from 2026-05-02.
Linked by a graph relationship (Meta released Llama); both cover Llama; earlier Llama coverage from 2026-05-01.
Linked by a graph relationship (Meta released Llama); both cover Llama; earlier Llama coverage from 2026-04-02.
Linked by a graph relationship (Meta released Llama); both cover Llama; earlier Llama coverage from 2026-03-12.