Xiaomi Hits 1,000 Tokens Per Second on Trillion-Parameter AI, Claiming 15x Speed Advantage Over ChatGPT and Claude
Xiaomi and TileRT claim a major AI speed breakthrough, hitting over 1,000 tokens per second on a trillion-parameter model using just 8 commodity GPUs — roughly 15 times faster than ChatGPT and Claude — powered by FP4 quantization and speculative decoding, with an open-source model checkpoint already live on Hugging …