Google search is a monopoly not because of crawling. It's because of the all the data it knows about website stats and user behavior. Original Google idea of ranking based on links doesn't work because it's too easily gamed. You have to know what websites are good based on user preferences and that's where you need to have data. It's impossible to build anything similar to Google without access to large amounts of user data.
luckylion|9 months ago
AtlasBarfed|9 months ago
If China can apply it for total information awareness on their population, Google can apply it on page reliability
fc417fc802|9 months ago