[umlaut]

The interesting properties of RNNs aren't in readability. RNNs can learn syntactical states, e.g. "this text is in quotes" that enable some really cool analysis tricks. OpenAI published an article about this recently, where they showed that an RNN, without being trained on it, learned the difference between positive and negative reviews. The fact that an RNN encodes sentiment is an incredibly useful feature.

source: https://blog.openai.com/unsupervised-sentiment-neuron/

[sharanvkaur]

thanks for bringing this up! i saw this article last week and it THRILLED me. so much potential here.