top | item 39535722

(no title)

ggerganov | 2 years ago

> Thanks to the amazing work of @ggerganov on llama.cpp which made this possible. If there is anything that you wish to exist in an ideal local AI app, I'd love to hear about it.

The app looks great! Likewise, if you have any requests or ideas for improving llama.cpp, please don't hesitate to open an issue / discussion in the repo

discuss

order

xyc|2 years ago

Oh wow it's the goat himself, love how your work has democratized AI. Thanks so much for the encouragement. I'm mostly a UI/app engineer, total beginner when it comes to llama.cpp, would love to learn more and help along the way.

titaniumtown|2 years ago

Wow I've been following your work for a while, incredible stuff! Keep up the hard work, I check llama.cpp's commits and PRs very frequently and always see something interesting in the works (the alternative quantization methods and Flash Attention have been interesting).

petargyurov|2 years ago

Did not expect to see the Georgi Gerganov here :) How is GGML going?

Поздрави!

ggerganov|2 years ago

So far is going great! Good community, having fun. Many ideas to explore :-)

duckkg5|2 years ago

Nothing to add except that your work is tremendous