Host overhead is killing your inference efficiency

3 points| charles_irl | 3 months ago |modal.com