Meta says a pair of Apple Mac Studios can run its 816B-parameter Muse Spark Open

Meta on Thursday pushed out Muse Spark Open, an 816-billion-parameter open-weight model that it says is the most capable US model of its kind. The model runs on a pair of Apple M5 Ultra Mac Studios at home, the company says. Each M5 Ultra brings up to 512GB of unified memory Meta’s model card says that Muse Spark Open uses a mixture-of-experts design that activates 42 billion of its 816 billion parameters per token. It accepts text, images, video and audio and returns text. It has a context of up to 1 million tokens. Meta aims it at work that involves code and agents. Its goals are long-horizon tasks, software engineering and reasoning in more than one step.

BeCrypto News shows a short excerpt and links to the publisher. The full report belongs to Cryptopolitan.