top | item 44139257

(no title)

darknoon | 9 months ago

If you were doing a lot of scraping, you could just solve this on a GPU in 1/10 or less of the time it takes a human's phone to do it. Generally you need a decent computer to render a webpage while scraping it these days, so I don't see what this is solving.

discuss

order

tiagorangel|9 months ago

scrapers usually don't render a webpage, else their scraping wouldn't be efficient at all.

hathawsh|9 months ago

Is that still true? There are so many SPAs out there now that if I were to create a web spider today, I would plan to just render a lot of the pages in a browser rather than fight the status quo. Efficiency wouldn't be my top concern.