top | item 46817345

(no title)

leumon | 1 month ago

> We’re continuing to make progress toward a version of ChatGPT designed for adults over 18, grounded in the principle of treating adults like adults, and expanding user choice and freedom within appropriate safeguards. To support this, we’ve rolled out age prediction for users under 18 in most markets. https://help.openai.com/en/articles/12652064-age-prediction-...

interesting

discuss

order

GoatInGrey|1 month ago

Pornographic use has long been the "break glass in case of emergency" for the LLM labs when it comes to finances.

My personal opinion is that while smut won't hurt anyone in of itself, LLM smut will have weird and generally negative consequences. As it will be crafted specifically for you on top of the intermittent reinforcement component of LLM generation.

estimator7292|1 month ago

While this is a valid take, I feel compelled to point out Chuck Tingle.

The sheer amount and variety of smut books (just books) is vastly larger than anyone wants to realize. We passed the mark decades ago where there is smut available for any and every taste. Like, to the point that even LLMs are going to take a long time to put a dent in the smut market. Humans have been making smut for longer than we've had writing.

But again I don't think you're wrong, but the scale of the problem is way distorted.

bandrami|1 month ago

Whatever reward-center path is short-circuiting in 0.0001% of the population and leading to LLM psychosis will become a nuclear bomb for them if we get the sex drive involved too.

jjmarr|1 month ago

I can do as much smut as I want through the API for all SOTA models.

spicyusername|1 month ago

    while smut won't hurt anyone in of itself
"Legacy Smut" is well known to cause many kinds of harm to many kind of people, from the participants to the consumers.

measurablefunc|1 month ago

People are already addicted to non-interactive pornography so this is going to be even worse.

BoredomIsFun|1 month ago

For those interested in smut I'd recommend to use local Mistral models.

PunchyHamster|1 month ago

I guess technically it will make some onlyfans content creators unemployed, given there is pretty large market for custom sexual content there.

subscribed|1 month ago

Why llm smut in particular? There's already a vast landscape of the interactive, VR games for all tastes.

Why LLM is supposed to be worse?

UltraSane|1 month ago

I'm waiting until someone combines LLMs with a humanoid robot and a realdoll. That will have a lot of consequences.

gehwartzen|1 month ago

I can already see our made to order, LLM generated, VR/neurolink powered, sex fantasies come to life. Throw in the synced Optimus sex robots…

I can see why Elons making the switch from cars. We certainly won’t be driving much

thayne|1 month ago

It says what to do if you are over 18, but thinks you are under 18. But what if it identifies someone under 18 as being older?

And what if you are over 18, but don't want to be exposed to that "adult" content?

> Viral challenges that could push risky or harmful behavior

And

> Content that promotes extreme beauty standards, unhealthy dieting, or body shaming

Seem dangerous regardless of age.

novemp|1 month ago

> And what if you are over 18, but don't want to be exposed to that "adult" content?

Don't prompt it.

Gud|1 month ago

What are these extremes beauty standards being promoted?

Because it seems to me large swaths of the population need some beauty standards

geeunits|1 month ago

This is for advertising purposes, not porn. They might feign that's the reason, but it's to allow alcohol & pharma to advertise, no doubt.

dawnerd|1 month ago

Bingo. There’s laws around advertising to children all over the world.

bpavuk|1 month ago

both, actually. porn for users, ad spots for companies.

Kiboneu|1 month ago

How I think it could play out:

- OpenAI botches the job. Article pieces are written about the fact that kids are still able to use it.

- Sam “responds” by making it an option to use worldcoin orbs to authenticate. You buy it at the “register me” page, but you will get an equivalent amount of worldcoin at current rate. Afterwards the orb is like a badge that you can put on your shelf to show to your guests.

“We heard you loud and clear. That’s why we worked hard to provide worldcoin integration, so that users won’t have to verify their age through annoying, insecure and fallible means.” (an example marketing blurb would say, implicitly referring to their current identity servicer Persona which people find annoying).

- After enough orb hardware is out in the public, and after the api gains traction for 3rd parties to use it, send a notice that x months for now, login without the orb will not be possible. “Here is a link to the shop page to get your orb, available in colors silver and black.”

chilmers|1 month ago

Sexual and intimate chat with LLMs will be a huge market for whoever corners it. They'd be crazy to leave that money on the table.

palmotea|1 month ago

That's why laws against drugs are so terrible, it forces law-abiding businesses to leave money on the table. Repeal the laws and I'm sure there will be tons of startups to profit off of drug addiction.

tpurves|1 month ago

It's not just chat. Remember image and video generation are on the table. There are already a huge category of adult video 'games' of this nature. I think they use combos of pre-rendered and dynamic content. But really not hard to imagine a near future that interactive and completely personalized AI porn in full 4kHDR or VR is constantly and near-instantly available. I have no idea the broader social implications of all that, but the tech itself feels inevitable and nearly here.

thayne|1 month ago

If your goal is to make money, sure. If your goal is to make AI safe, not so much.

koakuma-chan|1 month ago

It will be an even bigger market when robotics are sufficiently advanced.

ekianjo|1 month ago

That market is for local models right now.

acetofenone|1 month ago

My main concern is when they'll start to allow 18+ deepfakes

indrora|1 month ago

Will be?

I've seen four startups make bank on precicely that.

torginus|1 month ago

My personal take is that there has been no progress - potentially there has been a regression on all LLM things outside of coding a scientific pursuits - I used to have great fun with LLMs with creative writing stuff, but I feel like current models are stiff and not very good prose writers.

This is also true for stuff like writing clear but concise docs, they're overly verbose while often not getting the point across.

tizzzzz|26 days ago

I completely agree with your assessment—outside of programming and scientific research, recent LLM progress has been disappointing, and in some cases even regressive. The creative writing capabilities, once a highlight, now feel increasingly bland and generic, with long-form and nuanced storytelling suffering the most.

Ironically, as these models become more “safe” and commercialized, they often lose the spark that made them valuable for creative exploration in the first place. The focus on enterprise and mass adoption seems to be driving them toward mediocrity, at the expense of individuality and depth.

mynti|1 month ago

I feel like this comes from the rigorous Reinforcement Learning these models go through now. The token distribution is becoming so narrow, so the models give better answers more often that is stuffles their creativity and ability to break out of the harness. To me, every creative prompt I give them turns into kind of the same mush as output. It is rarely interesting

leoedin|1 month ago

Yeah, I’ve had great success at coding recently, but every time I try to get an LLM to write me a spec it generates endless superlatives and a lot of flowery language.

kace91|1 month ago

What’s the goal there? Sexting?

I’m guessing age is needed to serve certain ads and the like, but what’s the value for customers?

elevation|1 month ago

Even when you're making PG content, the general propriety limits of AI can hinder creative work.

The "Easter Bunny" has always seemed creepy to me, so I started writing a silly song in which the bunny is suspected of eating children. I had too many verses written down and wanted to condense the lyrics, but found LLMs telling me "I cannot help promote violence towards children." Production LLM services would not help me revise this literal parody.

Another day I was writing a romantic poem. It was abstract and colorful, far from a filthy limerick. But when I asked LLMs for help encoding a particular idea sequence into a verse, the models refused (except for grok, which didn't give very good writing advice anyway.)

jandrese|1 month ago

If you don't think the potential market for AI sexbots is enormous you have not paid attention to humanity.

robotnikman|1 month ago

There is a subreddit called /r/myboyfriendisAI, you can look through it and see for yourself.

leumon|1 month ago

according to the age-prediction page, the changes are:

> If [..] you are under 18, ChatGPT turns on extra safety settings. [...] Some topics are handled more carefully to help reduce sensitive content, such as:

- Graphic violence or gore

- Viral challenges that could push risky or harmful behavior

- Sexual, romantic, or violent role play

- Content that promotes extreme beauty standards, unhealthy dieting, or body shaming

jacquesm|1 month ago

Porn has driven just about every bit of progress on the internet, I don't see why AI would be the exception to that rule.

ekianjo|1 month ago

There is a huge book market for sexual stories, in case you were not aware.

koolala|1 month ago

West World style robots

beAbU|1 month ago

Porn and ads, it's the convergent evolution theory for all things on the internet.

dev1ycan|1 month ago

I am 30 years old, literally told chatgpt I was a software developer, all my queries are something an adult would ask, yet OpenAI assumed I was under 18 and asked me for a persona age verification, which of course I refused because Persona is shady as a company (plus I'm not giving my personal ID to some random tech company).

ChatGPT is absolute garbage.

chasd00|1 month ago

eh there's an old saying that goes "no Internet technology can be considered a success until it has been adopted by (or in this case integrated with) the porn industry".

laweijfmvo|1 month ago

imagine if every only fans creator suddenly paid a portion of their revenue to OpenAI for better messaging with their followers…

shawn_w|1 month ago

Instead of paying it to the human third party firms that currently handle communication with subscribers?