Fetching from the wire…
Public story · 2026-08-29 · source-backed
At Hot Chips 2026 Samsung presented multiply-accumulate units inside the DRAM banks while staying compatible with standard memory controllers. 1.2 TOPS INT8/FP8 per chip, doubling to 2.4 at 4-bit weights, which is exactly where memory-bound local LLM decode would benefit. The software problems are the real story: PIM memory must be marked uncacheable, prefetching breaks, and PIM modes redefine DRAM access commands so you can't mix PIM and normal traffic. Multitasking on this is unsolved. (Chips and Cheese)
Each link below shares sources, entities, or timing with this story.
Simon Willison released LLM / Shared entity: LLM / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-08-16.
LLM uses OpenAI / Shared entity: LLM / Earlier coverage / Tension
Linked by a graph relationship (LLM uses OpenAI); both cover LLM; earlier LLM coverage from 2026-07-27.
Samsung uses ChatGPT / Shared entity: LLM / Earlier coverage / Tension
Linked by a graph relationship (Samsung uses ChatGPT); both cover LLM; earlier LLM coverage from 2026-07-26.
Simon Willison released LLM / Shared entity: LLM / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-19.
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-18.
Samsung competes with SK Hynix / Shared entity: Samsung / Shared topic / Earlier coverage
Linked by a graph relationship (Samsung competes with SK Hynix); both cover Samsung; overlapping topics (memory, samsung).
Simon Willison released LLM / Shared entity: LLM / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-08-27.
Samsung uses ChatGPT / Shared entity: LLM / Earlier coverage
Linked by a graph relationship (Samsung uses ChatGPT); both cover LLM; earlier LLM coverage from 2026-08-21.