top | item 44211711

(no title)

tomr75 | 8 months ago

presumably their apply model is run on their servers

I wonder how hard it would be to build a local apply model/surely that would be faster on a macbook

discuss

order

bhaktatejas922|8 months ago

Its hard to get a model that does it usefully on your laptop. Theres an open source 1.5B model from QuocDat, and Morph - https://morphllm.com which is a fast apply model as an API (that I run)

notpushkin|8 months ago

It’s possible, but they allow you to specify your own API (that’s how they got the prompts in this article).