Someone Implemented GPT-2 Inference in Pure CMake Script Using Q16.16 Fixed-Point Arithmetic

GitHub / Hacker News·low signalXBlueskyLinkedInCopy link

AlpinDale's gpt2.cmake, at 76 stars and BSD-3-Clause, runs the GPT-2 model entirely inside CMake's scripting language with Q16.16 integer math, shipping both a full model script (gpt2_full.cmake) and a toy variant alongside Python tooling for weight conversion. The repo publishes no tokens-per-second figure, and it is a demonstration of what CMake's interpreter can be coerced into rather than anything to run. It sits in the same lineage as GPT-2 in Excel and in SQL, and it is a reasonable read if you want to understand transformer arithmetic without a framework in the way.