[jkeisling]

“Open”AI already was an unaccountable big corp. They’ve already refused not only to open their weights but to publish most of their research, to create an insurmountable gap with the rest of the world, and to legislate it in with lobbying. “Openness” merely meant “the API is open to your money”, with opaque “content policies” we had no say in. They had the same unaccountable and opaque power and the same commercial drive, but “for our own good” as they define it unilaterally.

Moving to MSFT merely means they’ll do the same thing, but with a bit more reliability, a bit more fear of liability, and a bit less of the doomerist sanctimony of the original leadership. Better to at least have a bigco with coherent and stable values like money. The bigco “nonprofit” led by the current board has made erratic decisions, has insane longtermist and EA values, and refused to give any meaningful statement about why they did what they did. Inasmuch as they resist commercialization, it’s to have more opacity and more control not less. How can we trust these people with control over AGI? Better to junk the board and deal with straightforward greed rather than hubris.

[machomaster]

I don't understand why you putting the blame on the board, instead of the CEO, who: 1. is way more responsible for the direction the company deviated to 2. was in fight against the board, who did not like his direction 3. will be in the new company leading everything.

So all the bad that you criticize OpenAI for would leave to MS, and yet people are still cheering for it.

I am truly baffled.

[jkeisling]

Yes, the EAs and longtermists on the board probably disliked the commercial focus of “Open”AI or its rapid scaling; I’m not blaming them for Laundry Buddy. But make no mistake: the nonprofit board had even less interest in opening up their research or sharing their code. They and the “superalignment” team believe AGI can end the world and needs to be in safe hands (i.e. their own hands). The EA movement which they are embedded in is one of the leading forces advocating shutting down open AI development through regulation. The board has strong EA and doomerist ties. Within OpenAI, Ilya Sutskever is on record as saying that the world will realize open-sourcing weights is foolish by 2025, and the Atlantic reported he literally burned an effigy of “unaligned” AI at the company retreat. Helen Toner is similarly involved in “AI governance” and not coincidentally took funding early in her career from OpenPhil, one of the key EA slush funds. The new CEO, their appointee, is quite literally a character written into Eliezer Yudkowsky’s rationalist fanfic in a cameo, and believes the probability of AGI killing humanity is 50%.

These people have absolutely no interest in decentralization and accountability, and were more than happy to let OpenAI accumulate power to “protect humanity”—until they pulled the plug for reasons they still refuse to disclose. Let me be clear: this is unacceptable. Not coincidentally, their so-called utilitarianism and altruism merely justifies accumulating all power in their hands, and taking any action (like the backstabbing we saw last week) to make it happen. For all MSFT’s faults, they play by traditional and predictable corporate rules of greed and can be reasoned with. The safety faction are true believers and implacably opposed to openness anywhere, and moreover happily gave the veneer of altruism to the regulatory capture of the commercial faction anyway before they realized they couldn’t control it. I know which one I’d pick.

[nh23423fefe]

I'm an accelerationist. All the safety shit is stupid to me. I'm cheering because doomers are annoying. Just boring old schadenfreude

[gofreddygo]

Is this a sheepskin comment or a genuinely naïve one? I can't tell.

Moving to MSFT means they cannot do anything that goes against MSFT's interests.

Everything they ever did, they ever will do belongs to MSFT.

MSFT brings with it all the bloat and risk aversion it needs as a big org, killing the "cutting egde" move-fast, make-it-work nature of OAI that got it to this point in the first place.

Only thing you can be sure of is this thing will now be "closed" forever, with no hope of others benefiting off the hard work of the real people who make it happen.