[hdhdhsjsbdh]

As far as IRB violations go, this seems pretty tame to me. Why get so mad at these researchers—who are acting in full transparency by disclosing the study—when nefarious actors (and indeed the platforms themselves!) are engaged in the same kind of manipulation. If we don’t allow it to be studied because it is creepy, then we will never develop any understanding of the very real manipulation that is constantly, quietly happening.

[krisoft]

> Why get so mad at these researchers—who are acting in full transparency by disclosing the study—when nefarious actors (and indeed the platforms themselves!) are engaged in the same kind of manipulation.

I’m mad at both of them. Both at the nefarious actors and the researchers. If i could I would stop both.

The bad news for the researchers (and their university, and their ethics review board) they cannot publish anonymously. Or at least they can’t get the reputational boost they were hoping for. So they had to come clean. It is not like they had an option where they kept it secret and still publish their research somehow. Thus we can catch them and shame them for their unethical actions. Because this is absolutely that. If the ethics review board doesn’t understand that then their head needs to be adjusted too.

I would love to stop the same the nefarious actors too! Absolutely. Unfortunately they are not so easy to catch. That doesn’t mean that i’m not mad at them.

> If we don’t allow it to be studied because it is creepy

They can absolutely study it. They should get study participants, pay them. Get their agreement to participate in an experiment, but tell them a fake story about what the study is about. Then do their experiment, with a private forum of their own making, and then they should de-brief their participants about what the experiment was about and in what ways were they manipulated. That is the way to do this.

[walleeee]

> If we don’t allow it to be studied because it is creepy, then we will never develop any understanding of the very real manipulation that is constantly, quietly happening.

What exactly do we gain from a study like this? It is beyond obvious that an llm can be persuasive on the internet. If the researchers want to understand how forum participants are convinced of opposing positions, this is not the experimental design for it.

The antidote to manipulation is not a new research program to affirm that manipulation may in fact take place but to take posts on these platforms with a large grain of salt, if not to disengage with them for political conversations and have those with people you know and in whose lives you have a stake instead

[joe_the_user]

"Bad behavior is going happen anyway so we should allow researchers to act badly in order to study it"

I don't have the time to fully explain why this is wrong if someone can't see it. But let just mention that if the public is going to both trust and fund scientific research, they have should expect researchers to be good people. One researcher acting unethically is going sabotage the ability of other researchers to recruit test subjects etc.

[bogtog]

> As far as IRB violations go, this seems pretty tame to me

Making this many people upset would be universally considered very bad and much more severe than any common "IRB violation"...

However, this isn't an IRB violation. The IRB seems to have explicitly given the researchers permission to this, viewing the value of the research to be worth the harm caused by the study. I suspect that the IRB and university may get in more hot water from this than the research team.

Maybe the IRB/university will try to shift responsibility to the team and claim that the team did not properly describe what they were doing, but I figure the IRB/university can't totally wash their hands clean

[fallingknife]

I would not consider anything that only makes people upset anywhere close to the "very bad" category.

[nitwit005]

Unless you happen to be the most evil person on the planet, someone else is always behaving worse. It's meaningless to bring up.

Even the most benign form of this sort of study is wasting people's time. Bots clearly got detected and reported, which presumably means humans are busy expending effort dealing with this study, without agreeing to it or being compensated.

Sure, maybe this was small scale, but the next researchers may not care about other people wasting a few man years of effort dealing with their research. It's better to nip this nonsense in the bud.

[dmvdoug]

“How will we be able to learn anything about the human centipede if we don’t let researchers act in full transparency to study it?”

[hdhdhsjsbdh]

Bit of a motte and bailey. Stitching living people into a human centipede is blatantly, obviously wrong and has no scientific merit. Understanding the effects of AI-driven manipulation is, on the other hand, obviously incredibly relevant and important and doing it with a small scale study in a niche subreddit seems like a reasonable way to do it.