top | item 41658546

(no title)

humansareok1 | 1 year ago

Given what Sam has done by clearing out every single person who went against him in the initial coup and completely gutting every safety related team the entire world should be on notice. If you believe what Sam Altman himself and many other researchers are saying, that AGI and ASI may well be within reach inside this decade, then every possible alarm bell should be blaring. Sam cannot be allowed to be in control of the most important technology ever devised.

discuss

order

lolinder|1 year ago

I don't know why anyone would believe anything this guy is saying, though, especially now that we know he's going to receive a 7% stake in the now-for-profit company.

There are two main interpretations of what he's saying:

1) He sincerely believes that AGI is around the corner.

2) He sees that his research team is hitting a plateau of what is possible and is prepping for a very successful exit before the rest of the world notices the plateau.

Given his track record of honesty and the financial incentives involved, I know which interpretation I lean towards.

cowpig|1 year ago

This is a false dichotomy. Clearly getting money and control are the main objectives here, and we're all operating over a distribution of possible outcomes.

mirekrusin|1 year ago

...or he's just Palpatine who wants shitload of money regardless of future speculations, end of story.

meowface|1 year ago

It's interesting because one of the points Sam emphatically stresses over and over on most podcasts he's gone on in the past 4 years is how crucial it is that a single person or a single company or a collection of companies controlling ASI would be absolutely disastrous and that there needs to be public, democratic control of ASI and the policies surrounding it.

Personally I still believe he thinks that way (in contrast to what ~99% of HN believes) and that he does care deeply about potential existential (and other) risks of ASI. I would bet money/Manifoldbux that if he thought powerful AGI/ASI were anywhere near, he'd hit the brakes and initiate a massive safety overhaul.

I don't know why the promises to the safety team weren't kept (thus triggering their mass resignations), but I don't think it's something as silly as him becoming extremely power hungry or no longer believing there were risks or thinking the risks are acceptable. Perhaps he thought it wasn't the most rational and efficient use of capital at that time given current capabilities.

verve_rat|1 year ago

Or maybe he is just a gready lier? From the outside looking in how can you tell the difference?

humansareok1|1 year ago

>I would bet money/Manifoldbux that if he thought powerful AGI/ASI were anywhere near, he'd hit the brakes and initiate a massive safety overhaul.

Not sure how you can believe this given all of his recent actions and the ever growing list of whistleblowers dropping out of OpenAI explicitly saying Safety is not taken seriously.

I mean just generally the ability to actually stop and reorient around working on safety seems incredibly non trivial. To say nothing of the race dynamic he has perpetuated, the other frontier companies are unlikely to do the same.