[test6554]

I'm worried all that cheap easily accessible LLM capacity will be serving us ads if we're lucky and subtly pushing us to use brands that pay money if we're not.

If AI says don't buy a subaru it's not worth the money, then Subaru pays attention and they are willing to pay money to get a better rec. Same for Univerisites. Students who see phrases like "If the degree is from brown flush it down" (ok hyperbole, but still) are going to pick different schools.

[SR2Z]

I think people have more memetic immunity than you're giving them credit for. We're in the early days, people don't fully understand how to treat ChatGPT's outputs.

Soon enough, asking an LLM a question and blindly trusting the answer will be seen as ridiculous, like getting all your news from Fox News or Jacobin, or reading ads on websites. Human beings can eventually tell when they're being manipulated, and they just... won't be.

We've already seen how this works. Grok gets pushed to insert some wackjob conservative talking point, and then devolves into a mess of contradictions as soon as it has to rationalize it. Maybe it's possible to train an LLM to actually manipulate a person towards a specific outcome, but I do not think it will ever be easy or subtle.

[rkomorn]

You mention Fox News and people knowing when they're manipulated and I struggle to see how that squares with the current reality of Fox News being the most popular news network and rising populism that very much relies on manipulation.

[grafmax]

It’s a tried and true method of Silicon Valley VCs. Produce something as a loss leader. Build a moat. Then extract rent. Not only can you stop having to produce anything of value, you can even degrade your product and people won’t be able to leave thanks to lock-in.

We wonder why the US has lost or losing competitiveness with China in most industries. Their government has focused on public investment and public ownership of natural monopolies, preventing rent extraction and keeping the costs of living lower. That means employers don’t have to pay workers as much so their businesses can be more competitive. Contrast with the US whose working class is parasitized by various forms of rent extraction - land, housing, medicine, subscription models, etc. US employers effectively finance these inefficiencies. It’s almost like the US wants to fall behind.