OpenBMB BitCPM-CANN 1.58-Bit Models Successfully Tested on Huawei Ascend 910B

r/LocalLLaMA·medium signal

OpenBMB's BitCPM ternary-quantized models (1.58 bits per parameter, derived from MiniCPM4 via quantization-aware training) have been tested running natively on Huawei's Ascend 910B NPU using the CANN compute framework. This is the first public evidence of competitive 1.58-bit LLMs running on Chinese domestic AI accelerators — a significant development for the non-NVIDIA AI hardware ecosystem (87 upvotes, 21 comments).