Jailbroken PS5 Runs Qwen3.8-27B Locally at About 20 Tokens per Second

PS5LM Plus runs Qwen3.8-27B on a jailbroken PlayStation 5 at about 20 tokens per second, turning the console into a local model server that devices on the same network can access. The open-source app is a fork of PS5LM that runs as a native application, with a chat interface and an API. Its GPU access and 11.44 GiB device memory heap let it run larger models than the earlier payload version, which had no GPU access and about 6 GiB of memory. The 27B model reached 20.3 tokens per second in a 9.2 GiB configuration with a 32,000-token context. A 6.8 GiB configuration with a 64,000-token context and a different quantization format reached 20.7 tokens per second. Both use roughly 2-bit quantization.

BeCrypto News shows a short excerpt and links to the publisher. The full report belongs to TokenPost.