[corbet]

I think there are a thousand wannabe companies all trying to suck up as much data as they can; not a sustainable situation in any way.

[PaulHoule]

There was a paper about webcrawlers circa 2000 that pointed out that the vast majority of academics who ran webcrawlers never published a paper based on their work.

[morkalork]

Sounds like all the kids who want to make a video-game and start with building a game engine.