Monday, November 13, 2023

Show HN: Llm.f90 fast, hackable transformer implementation in Fortran https://ift.tt/bYKvTku

Show HN: Llm.f90 fast, hackable transformer implementation in Fortran I submitted an earlier version of this a few months ago (as llama2.f90). At that time it had a lot of steps to run and was just a toy, now it's easy to run and is a competitive option for llm inference. See the motivation section for discussion and the `Performance` issue for an ongoing discussion about performance. https://ift.tt/vjm4lwD November 14, 2023 at 01:17AM

No comments:

Post a Comment

Show HN: Rewriting Scratch 3.0 from scratch in Lua (browser-free native runtime) https://ift.tt/5Af6h7W

Show HN: Rewriting Scratch 3.0 from scratch in Lua (browser-free native runtime) Built a native Scratch 3.0 runtime in Lua that runs .sb3 pr...