Sunday, February 2, 2025
Show HN: Chrome extension to run DeepSeek, LLMs and Whisper locally in browser https://ift.tt/C95usGt
Show HN: Chrome extension to run DeepSeek, LLMs and Whisper locally in browser Hi all, I open sourced my toy project that runs Generative AI models LOCALLY in the side panel of a Chrome extension. The Chrome extension uses Transformers.js to run models in browser under the hood. I've integrated and tested these models so far. \1. LLM: Llama 3, Phi 3.5, Qwen 2.5, SmolLM2 \2. Reasoning: DeepSeek R1 \3. Multimodal LLM: Janus \4. Speech-to-Text: Whisper On an M1 MacBook, DeepSeek R1 1.5B runs at ~30 tokens/sec If you're interested in, you can download the extension from chrome web store or clone my github repository. \1. chrome web store: https://ift.tt/YJCsjXg... \2. github: https://ift.tt/mrIlsn8 \3. demo: https://www.youtube.com/watch?v=MSCDdFG5Lls It's my first react project. Feedback is always welcome! https://ift.tt/mrIlsn8 February 2, 2025 at 11:19PM
Subscribe to:
Post Comments (Atom)
Show HN: A Discord bot running in a 4MiB microVM https://ift.tt/TLKdtwf
Show HN: A Discord bot running in a 4MiB microVM https://ift.tt/Yu37st9 August 8, 2026 at 11:04PM
-
Show HN: WebApp that blows water out of your phone's speakers https://ift.tt/2VmXkOf March 16, 2021 at 08:22AM
-
Show HN: Music player for big local collections with mpd support mpz is a C++/Qt music player focused on UX, with derectory tree and playlis...
-
Show HN: Stickerbox, a kid-safe, AI-powered voice to sticker printer Bob and Arun here, creators of Stickerbox. If AI were built for kids, w...
No comments:
Post a Comment