top | item 45284410

(no title)

HoyaSaxa | 5 months ago

> We don't directly manage AWS Bedrock deployments today, those are managed by AWS.

That was my understanding before this article. But the article is pretty clear that these were "infrastructure bugs" and the one related to AWS Bedrock specifically says it was because "requests were misrouted to servers". If Anthropic doesn't manage the AWS Bedrock deployments, how could it be impacting the load balancer?

discuss

order

l1n|5 months ago

The load balancer container is provided to Bedrock, since it's part of our overall LLM serving system, but they run it.