top | item 36332336

(no title)

clmckinley | 2 years ago

I predict that all sites like this which thrive on community generated content will be getting rid of apis and bulk exports. This is because ai companies have used those tools to build their systems on data that prevents the need to the source website. This is an existential threat to sites like StackOverflow and a huge, missed opportunity for reddit.

discuss

order

drchaos|2 years ago

AI companies can just scrape the content, and since the sites don't have an exclusive license to it (it's user-generated, after all) there is little they can do against that.

Actually, I'm not even sure the AI companies don't do this already. If I'd start such a company, I'd invest in a generic crawler once, instead of building countless integrations for all the different, proprietary APIs or dump formats.