top | item 31422977 (no title) frmdstryr | 3 years ago I recently found https://commoncrawl.org/ and started working on my own personal search engine. I'm surprised how easy it is to actually get decent results with just metadata that show up nowhere in Google/DDG. discuss order hn newest closedloop129|3 years ago Heads up to https://news.ycombinator.com/item?id=31410042marginalia_nu, the author of another search engine, is looking for ways to cooperate. guerrilla|3 years ago What's the license for this? It isn't obvious from the website and I got bored of looking. buo|3 years ago Not a license, but there are some terms of use: https://commoncrawl.org/terms-of-use/
closedloop129|3 years ago Heads up to https://news.ycombinator.com/item?id=31410042marginalia_nu, the author of another search engine, is looking for ways to cooperate.
guerrilla|3 years ago What's the license for this? It isn't obvious from the website and I got bored of looking. buo|3 years ago Not a license, but there are some terms of use: https://commoncrawl.org/terms-of-use/
buo|3 years ago Not a license, but there are some terms of use: https://commoncrawl.org/terms-of-use/
closedloop129|3 years ago
marginalia_nu, the author of another search engine, is looking for ways to cooperate.
guerrilla|3 years ago
buo|3 years ago