AMD releases 16B model, bars it from commercial use

AMD uploaded Instella-MoE-16B-A3B-Think to Hugging Face, a 16 billion parameter mixture-of-experts model trained entirely on its own MI300X and MI325X chips. That's the company's clearest proof yet that a frontier-scale mixture-of-experts model can be trained start to finish without a single Nvidia GPU.

The model runs 64 experts, routing 6 per token plus 2 shared, with 2.8 billion parameters active per token. It uses Gated Multi-head Latent Attention and FarSkip-Collective connectivity, all built on AMD's own Primus training framework.

AMD published the full training recipe alongside the weights: data mixtures, intermediate checkpoints from pretraining through reinforcement learning, and inference code.

The catch, flagged by r/LocalLLaMA: the license is ResearchRAIL, academic and research use only. AMD's earlier Instella-3B shipped under Apache-style terms open to commercial use. This one you can study, not ship.

My read: the strict license is the tell. AMD built this to show MI300X buyers and researchers that the chips can carry a training run this complex, not to hand developers a model they can ship. Whether AMD's next release comes with looser terms is the thing worth watching.