Saturday, March 21, 2026
Show HN: Can I run a model language on a 26-year-old console? https://ift.tt/wdfu2Gz
Show HN: Can I run a model language on a 26-year-old console? Short answer: yes. The Emotion Engine has 32 MB of RAM total, so the trick is streaming weights from CD-ROM one matrix at a time during the forward pass — only activations, KV cache and embeddings live in RAM. This means models bigger than the RAM can still run, they just read more from disc. Had to build a custom quantized format (PSNT), hack endianness, write a tokenizer pipeline, and most of the PS2 SDK from scratch (releasing that separately). The model itself is also custom — a 10M param Llama-style architecture I trained specifically for this. And it works. On real hardware. https://ift.tt/hoJAOZe March 22, 2026 at 12:57AM
Subscribe to:
Post Comments (Atom)
Show HN: Chrome extension that gives you the TlDR from YouTube without the watch https://ift.tt/MVnN0E3
Show HN: Chrome extension that gives you the TlDR from YouTube without the watch https://addketchup.app/ August 24, 2026 at 11:37PM
-
Show HN: WebApp that blows water out of your phone's speakers https://ift.tt/2VmXkOf March 16, 2021 at 08:22AM
-
Show HN: Music player for big local collections with mpd support mpz is a C++/Qt music player focused on UX, with derectory tree and playlis...
-
Show HN: Stickerbox, a kid-safe, AI-powered voice to sticker printer Bob and Arun here, creators of Stickerbox. If AI were built for kids, w...
No comments:
Post a Comment