DAWN: Tools for AI and Data Product Development

[pella]

summary(slides): http://dawn.cs.stanford.edu/assets/dawn-overview.pdf

[hacker_9]

The link to Snorkel [1] is really interesting, labeling data in a low quality programmatic way, which is then fed through a neural network to produce high quality labels is really smart.

[1] https://github.com/HazyResearch/snorkel

[cl42]

This is great. In some ways it reminds me of the recent "Software 2.0" posts around here -- make the code and architecting so easy that we begin teaching machines by creating data rather than writing code.

[cscurmudgeon]

A lot of research has been done in that direction.

http://www.inductive-programming.org

[haZard_OS]

I always thought the Wolfram language was a good step toward "Software 2.0". It's a shame the language isn't open source.

[tuomosipola]

I like many of these ideas, they address real practical problems in the area and new research is always welcome. How this all will be packaged into a working environment is not clear to me but even the individual parts should be useful.

[thisisit]

So anyone using these tools in live/production environment?

[mateiz]

Matei Zaharia (one of the PIs on DAWN) here. Snorkel, MacroBase and ASAP are already being used in production at several companies, and we intend to continue publishing everything as open source. We only started this lab a year ago, so a lot of the projects listed are still new.

[tuomosipola]

Would be interesting to hear any experiences. These researchers have background in Spark etc. so setting up might not be that difficult.

[tabtab]

Seems it has similar goals to the idea behind factor tables: https://github.com/RowColz/AI

[Houshalter]

I'm pretty sure that guy just reinvented nearest neighbor.