Zyphra ZAYA1-8B: Apache-2.0 sparse-MoE trained from scratch on AMD Instinct

devFlokers·low signal

Zyphra released ZAYA1-8B under Apache 2.0, a sparse-routing mixture-of-experts with 8B total parameters but only ~760M active per token, trained from scratch on AMD Instinct hardware rather than NVIDIA. The AMD-only training run is the notable signal — evidence the open-weight training stack is diversifying off NVIDIA; corroborated by roundups, so verify against the official model card before relying on numbers.