[chaidhat]

Cool! Is there tok/s too? TTFT and tok/s also decreases given a larger context window, maybe a metric of tok/s given # tok in context would also be nice.