[underscoring]

Nice work!

> If it can do this in 13kb, it makes me wonder what it could do with more bytes.

Maybe I misunderstand, but is this not just the first baby steps of an LLM written in JS? "what it could do with more bytes" is surely "GPT2 in javascript"?

[refulgentis]

Author had LLM help them make a tree of words, and the algo choose which node we're at and offers children as completions. It's clever and cute but, not even close to an LLM.

[cchance]

I mean it's not far off from a super low quant LLM with limited params, like a 1bit quant LLM with low params XD