[throw_nbvc1234]

Mac Studio Pro's with up to 192GB ram are an alternative here too though still on the M2 Ultra chips if you don't need the portability. Not sure how relevant the generation bump is for running the models.

Might be a good hold-over for X years until the consumer hardware catches up and/or the model optimizations make the same hardware perform up to today's DC hardware.

[jadbox]

I assume the Mac Studio Pro must be getting an M3 Ultra refresh in 2024? I wonder how well linux run on that.