Ask HN: Hosted LLMs to process personal data?

[yboulkaid]

There are some good use cases for LLMs to process personal data (think paperless-ngx document scanning or semantic search for personal photos). However, this data should never be saved for future training as it's highly sensitive.

It's not always convenient to self-host LLMs as you'd need a beefy and costly GPU.

What's the best way to have access to good models with the guarantee that your datw won't be touched? AWS Bedrock? Self-host on an EC2 instance? Huggingface Pro?