[himlion]

I overlooked the unified memory on those machines. Can it really run this performantly?

[ukuina]

I run Vicuna quite well with my M1 Pro, 32GB.