top | item 42679798

(no title)

mlepath | 1 year ago

Awesome project! I love the idea of not sending my data to a big company and trust their TOS.

The effectiveness of coding assistant is directly proportional to context length and the open models you can run on your computer are usually much smaller. Would love to see something more quantified around the usefulness on more complex codebases.

discuss

order

fullstackwife|1 year ago

I hope for proliferation of 100% local coding assistants, but for now the recommendation of "Works best on $10K+ GPU" is a show stopper, and we are forced to use the "big company". :(

danw1979|1 year ago

It’s not really that bad. You can run some fairly big models on an Apple Silicon machine costing £2k (M4 Pro Mac Mini with 64GB RAM).