Skip to content

Hardware

764 articles found

397-Billion Parameter AI Model Runs on MacBook Pro With 48GB RAM at 4.4 Tokens Per Second Using Custom C/Metal Engine

397-Billion Parameter AI Model Runs on MacBook Pro With 48GB RAM at 4.4 Tokens Per Second Using Custom C/Metal Engine

Mar 23, 2026
GitHub

A custom C/Metal inference engine called Flash-MoE is now running a massive 397-billion parameter AI model on a standard MacBook Pro with 48GB RAM, streaming 209GB directly from SSD at 4.4 tokens per second — with 58 documented experiments revealing that Apple Silicon's unified memory architecture defies conventional optimization wisdom.

Cloudflare Launches Kimi K2.5 on Workers AI, Slashing Inference Costs by 77% While Processing 7 Billion Tokens Daily

Cloudflare Launches Kimi K2.5 on Workers AI, Slashing Inference Costs by 77% While Processing 7 Billion Tokens Daily

Mar 22, 2026
The Cloudflare Blog

Cloudflare launches Kimi K2.5 on Workers AI, achieving a massive 77% cut in inference costs while processing over 7 billion tokens daily, bringing powerful frontier open-source AI capabilities including a 256k context window and vision inputs to its platform alongside new features like prefix caching and a redesigned async API.

Previous
Page 35 of 77
Next
Showing 341 - 350 of 764 articles