[miletus]

This is exactly why a lot of people are running local LLMs or moving toward privacy-first platforms

we recently shipped secure mode on https://www.agentsea.com.

With Secure Mode, all chats run either on open-source models or models hosted on our own servers - so you can chat with AI without worrrying about privacy.

[kbelder]

There is a very strong use case for less-powerful but local LLMs, and there's going to be a big expansion in that area in the next couple years. So big, I'll bet that all the major AI players will do everything they can to cripple them.

[brazukadev]

Not Nvidia, that's their best scenario

[conradkay]

Unfortunately I think you're overestimating how many people care enough about privacy to go through the effort of running LLMs locally and likely buying a GPU

[lawlessone]

tbh i just run local because i can . No real reason too.

edit: there are some instances where i would like to be able to set the same seed repeatedly which isn't always possible online.

[datameta]

Realistically, how useful is local LLM usage? What are your use cases, hardware, and models used?

[jonathanlb]

Given that this is in response to a ChatGPT user who killed his mother and then himself, I'm not sure that positioning your product as being more secure than ChatGPT is wise, because your marketing here suggests either:

1. Profound tone-deafness about appropriate contexts for privacy messaging

2. Intentional targeting of users who want to avoid safety interventions

3. A fundamental misunderstanding of your ethical obligations as an AI provider

None of these interpretations reflect well on AgentSea's judgment or values.

[kbelder]

I disagree. The fact that the crimes done by a mentally ill person are going to be used as a justification for surveillance on the wider population of users is a strong ethical reason to advocate for more security.

[sleazebreeze]

Or maybe I just want to be able to talk to an LLM without worrying about if its going to report me to the authorities.

[exe34]

Are you in America? Do you also support banning guns?