Sunday, July 6, 2025
Show HN: Simple wrapper for Chrome's built-in local LLM (Gemini Nano) https://ift.tt/oPix0Im
Show HN: Simple wrapper for Chrome's built-in local LLM (Gemini Nano) Chrome now includes a native on-device LLM (Gemini Nano) starting in version 138. I've been building with it since it was in origin trials, it's powerful but the official Prompt API is still a bit awkward: - Enforces sessions even for basic usage - Requires user-triggered downloads - Lacks type safety or structured error handling So I open-sourced a small TypeScript wrapper I originally built for other projects to smooth over the rough edges: github: https://ift.tt/LxwzqUh npm: https://ift.tt/NEtYBIr - Stateless prompt() method inspired by Anthropic's SDK - Built-in error handling and Result-based .Safe.* variants with neverthrow - Token usage checks - Simple initialization that provides a helper to trigger downloads (must be triggered by user action) It’s intentionally minimal for hacking and prototyping. If you need fine-grained control (e.g. streaming, memory control), use the native API directly: https://ift.tt/A0fFsD4 Would love to hear what people build with it or any feedback! https://ift.tt/LxwzqUh July 6, 2025 at 11:24PM
Subscribe to:
Post Comments (Atom)
Show HN: Easily visualize torch, Jax, tf, NumPy, etc. tensors https://ift.tt/anqfwJx
Show HN: Easily visualize torch, Jax, tf, NumPy, etc. tensors hey hn, wrote a python library for myself to visualize tensors. Makes learning...
-
Show HN: An AI logo generator that can also generate SVG logos Hey everyone, I've spent the past 2 weeks building an AI logo generator, ...
-
Show HN: I Made an AI Social Media Manager to Automate Content Creation Hey HN, I am a Solopreneur, and I love building apps to automate bor...
-
RoboPianist, a piano playing robot simulation in the browser https://ift.tt/zywcBo6 March 30, 2023 at 10:52PM
No comments:
Post a Comment