Hierarchos-Native trains 143 Transformer architectures on Rust and Vulkan with no CUDA or PyTorch
An r/LocalLLaMA author released github.com/necat101/Hierarchos-Native, a native Rust plus Vulkan backend for training and inference across 143 canonical Transformer architectures, with Hugging Face model_type aliases bringing the advertised registry to 224 spellings. The stated goal is to test how much of the modern Transformer ecosystem can run on Vulkan compute without assuming CUDA and PyTorch as the execution stack. It started as the training backend for the author's own Hierarchos architecture and the backend is now the more interesting half. Single-source and unbenchmarked against a PyTorch baseline, so treat the architecture count as a claim rather than a result, but a vendor-neutral training path is rare enough to watch.
↳ Follow the thread