[mxkopy]

RLHF is one that comes to mind

[tossandthrow]

Well, this is an entirely other category of optimizations - not program performance but model performance.

[lucrbvi]

Yes, in "runtime optimization" the model is just a computation graph so we can use a lot of well known tricks from compilation like dead code elimination and co..