Ask HN: anyone interested to build a hacker news with tags?

[tucson]

Could anyone help me build a hacker news with tags? I am asking only those who are interested to have it as well because I only have a budget for the hosting for this.

The point is to be able to search through the whole archive using tags/keywords.

example of tags:

'security'

'crm'

'a/b testing'

'optimization'

'http', 'ssl', 'domain name'

'scala', 'c++', 'php', etc

'lua'

'sql'

'marketing'

'website'

'landing page'

=> get all posts that relate to each tag (and combinations of tags) sorted by points of individual posts/comments.

To do list: 1. import all hacker news database 2. insert in database all tags for all posts/comments, using an algorithm similar to the Kaggle Keyword Extraction algo (https://www.kaggle.com/c/facebook-recruiting-iii-keyword-extraction), which will need to be refined. 3. create great user interface to the new database

------- or if no-one has the time, could anyone advise me on how to download the whole hacker news database?

[captn3m0]

1. You can download the dataset using http://hn.algolia.com/api. Mind the rate-limits, though.

2. This has already been done quite a few times by various apps, most prominently here: http://algorithmia.com/demo/hn (http://blog.algorithmia.com/post/86295023534/algorithmic-tag...)

[tucson]

http://hn.algolia.com/api Thanks. How many requests would that require ?

http://algorithmia.com/demo/hn does not work for me.

[stevekemp]

See the new API too:

https://news.ycombinator.com/item?id=8422599

[wanghq]

Can't you just search the keywords? I wonder how useful it would be given that the information (tech articles, such as rails2.1, best features in jQuery1.0,...) will be out-of-date as time goes.

I think what's useful is various tools if they are still alive. That's why I want to build a toolbox which collects all the useful tools.

https://news.ycombinator.com/item?id=8413016

[tucson]

your idea might be better. I could help if you need support.