[M4R5H4LL]

+1 - I work in finance, and there's no way we're sending our data and code outside the organization. We have our own H100s.

[filoleg]

Add big law to the list as well. There are at least a few firms here that I am just personally aware of running their models locally. In reality, I bet there are way more.

[atlasunshrugged]

Add government here too (along with all the firms that service government customers)

[LinXitoW]

Possibly stupid question, but does this apply to things like M365 too? Because just like with Inference providers, the only thing keeping them from reading/abusing your data is a pinky promise contract.

Basically, isn't your data as safe/unsafe in a sharepoint folder as it is sending it to a paid inference provider?

[Bombthecat]

Yap, companies are just paranoid, because it's new. Just like the cload back then. Sooner or later everyone will use an ai provider

[Foobar8568]

Look at (private) banks in Switzerland, there are enough press release, and I can confirm most of them.

Managing private clients direct data is still a concern if it can be directly linked to them.

Only JB I believe have on premise infrastructure for these use cases.

[helsinki]

This is not a shared sentiment across the buy side. I’m guessing you work at a bank?

[undefuser]

Does it mean that renting a Bare metal server with H100s is also out of question for your org?

[arkonrad]

Do you have your own platform to run inference?