[samuelknight]

These complaints are about technical limitations that will go away for codebase-sized problems as inference cost continues its collapse and context windows grow.

There are literally hundreds of engineering improvements that we will see along the way like a intelligent replacement to compacting to deal with diff explosion, more raw memory availability and dedicated inference hardware, models that can actually handle >1M context windows without attention loss, and so on.