Saturday, June 8, 2024
Show HN: A Small BitNet GPT in MLX https://ift.tt/eVqT80H
Show HN: A Small BitNet GPT in MLX For those of us nerds who like to tinker with language models, I thought of sharing an example ipynb that shows how to build a small gpt (kudos to @karpathy for teaching us minGPT) where you replace the nn.Linear layer with a BitLinear layers as introduced in the paper on 1.58 bit LLMs https://ift.tt/pbfZxkQ https://ift.tt/TjpOnRP June 9, 2024 at 01:38AM
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment