top | item 38713231

AI proxy middlewares are a hack

14 points| AureliusDreamer | 2 years ago |blog.lastmileai.dev

3 comments

order

TidbitsTornado|2 years ago

I'm glad to see more focus on middlewares. Getting the architecture right is crucial to building effective models, but this has largely been overlooked as shown by the inefficiencies in many models today

AureliusDreamer|2 years ago

Agreed. The author makes the point that middleware is trying to solve valid problems. I think the issue is that there are better ways to address it by “avoiding the middleware all together”. Especially since it introduces other 3rd parties into the mix