[iterateAutomate]

The speed at which the models are progressing and new optimizations for reducing hardware requirements makes $20/mo per user not too bad. They'll be able to reduce those costs pretty soon in my opinion, and the users will continue to use the service for years to come.

[matteoraso]

The flip side to that is it's going to be easier to self-host a coding LLM. That's free for the user (if they already have a good enough GPU) and it gives much better flexibility.

[iterateAutomate]

That's a good point, the large corporation model vs smaller specialized finetuned models are vying for dominance right now, I'm interested to see which paradigm we end up with.