[ndr_]

Setting up AWS so you can try it via Amazon Bedrock API is a hassle, so I made a step-by-step guide: https://ndurner.github.io/amazon-nova. It's 14+ steps!

[fumeux_fume]

This appears to be a way to steal and harvest aws credentials. No one should be following any of these steps.

[ndr_]

Do you have any evidence for this accusation?

This is a guide for the casual observer who wants to try things out, given that getting started with other AI platforms is so much more straightforward. It's all open source, with transparent hosting, catering to any remaining concerns someone interested in exactly that may have.

[metzpapa]

You can set up AWS in less than 5 minutes...

[OJFord]

Your 14 steps appear to be 'create an IAM user'..?

[Spivak]

If you're already in the AWS ecosystem or have worked in it, it's no problem. If you're used to "make OpenAI account, add credit card, copy/paste API key" it can be a bit daunting.

[weitendorf]

AWS does not use the exact same authn/authz/identity model or terminology as other providers, and for people familiar with other models, it's pretty non-trivial to adapt to. I recently posted a rant about this to https://www.reddit.com/r/aws/comments/1geczoz/the_aws_iam_id...

Personally I am more familiar with directly using API keys or auth tokens than AWS's IAM users (which are more similar to what I'd call "service accounts").

[scosman]

find to supported region, request model access, wait for model access, create policy, create user, attach policy... it's not comparable

[d4rkp4ttern]

Setting up Azure LLM access is a similar hellish process. I learned after several days that I had to look at the actual endpoint URL to determine how to set the “deployment name” and “version” etc.

[teruakohatu]

Thanks for that. Are there any proxies that can communicate with bedrock and serve it via a OpenAI style api?

[moduspol]

You'd have to deploy it yourself, but there's this:

https://github.com/aws-samples/bedrock-access-gateway

[popinman322]

Try LiteLLM; their core LLM proxy is open source. As an added bonus it also supports other major providers.

[SaggyDoomSr]

Nice! FWIW, The only nova model I see on the HuggingFace user space page is us.amazon.nova-pro-v1:0. I cloned the repo and added the other nova options in my clone, but you might want to add them to yours. (I would do a PR, but... I'm lazy and it's a trivial PR :-)).

[ndr_]

OK! I only add what people are interested in, so noted with thanks - will do! :-)

[tootie]

I'm so confused on the value prop of Bedrock. It's seems like it wants to be guardrails for implementing RAG with popular models but it's not the least but intuitive. Is it actually better than setting up a custom pipeline?

[ndr_]

The value I get is: 1) one platform, largely one API, several models, 2) includes Claude 3.5 "unlimited" pay-as-you-go, 3) part of our corporate infra (SSO, billing, ... corporate discussions are easier to have)

I'm using none to very little of the functionality they have added recently: not interested in RAG, not interested in Guardrails. Just Claude access, basically.

[simonw]

Thank you!