[noiseinvacuum]

Detecting a fake profile is a very hard problem and in a very different domain than LLMs. What makes it so difficult is goal to minimize false positives, ideally you do not want to delete profiles of genuine users.

Meta has said in the past that their ML models observe how users use their platform like FB to detect is they are bots. Another challenge is that most spammers that slip through these AI systems are not always automated bots like you see on Twitter, there are sometimes paid humans behind these accounts.

The sheer scale of this problem is astounding, this stat is from 2019 (https://phys.org/news/2019-05-fake-facebook-accounts-never-e...). Even if 0.01% of these slip through then it becomes very visible.

> Facebook said this week it "disabled" 1.2 billion fake accounts in the last three months of 2018 and 2.19 billion in the first quarter of 2019.