Reddit
Apple's A20 Pro widens the iPhone memory bus to 96-bit, putting on-device inference near 115 GB/s
The A20 Pro, announced September 9 and the first 2nm smartphone chip, moves from a 64-bit to a 96-bit LPDDR5X bus for about 115.2 GB/s, a 50% bandwidth jump, alongside 32 Neural Engine cores against the A19 Pro's 16 and a redesigned 7-core GPU. r/LocalLLaMA gave it 438 upvotes and 142 comments precisely because decode speed for local models is memory-bandwidth-bound, not compute-bound, and this is the spec that moves. Buying that width on 2nm silicon is expensive, which is a signal about how seriously Apple is treating on-device model serving.
↳ Follow the thread