top | item 41817833

(no title)

vietvu | 1 year ago

Another llama.cpp and mistral.rs? If it support vision models then fine, I will try it.

EDIT: Looks like no L3.2 11B yet.

discuss

order

littlestymaar|1 year ago

It supports the PHI 3.5 vision model since yesterday actually.

I think a 11B model would be way too slow in its current shape though.