Meta Releases Muse Spark Open, 816B Open-Weight Model with 1M Token Context
Meta releases Muse Spark Open, an open-weight mixture-of-experts model with about 816 billion parameters, 42 billion active per token, and a 1 million token context window. It accepts text, images, audio and video and generates text, aimed at agentic coding. Meta calls it the most capable US open-weights model. The BF16 checkpoint is about 1.5 TB.