Run locally
Garlic LLM Runs Qwen3.5-9B Offline on a Jailbroken PS4 at About 35 Tokens per Second
The open-source Garlic LLM app runs Qwen3.5-9B on the GPU of a jailbroken PlayStation 4 with no PC and no internet. In text chat the model generates 31–39 tokens per second, and…