top | item 47210182 (no title) scotty79 | 3 hours ago Transformers look like perfect tech for keeping track of how deep and inside of what we are at the moment. discuss order hn newest thesz|3 hours ago Transformers are able to recognize balanced brackets grammar at 97% success rate: https://openreview.net/pdf?id=kaILSVAspnThis is 3% or infinitely far away from the perfect tech.The perfect tech is the stack. krackers|6 minutes ago This is very interesting since there is another notable paper which shows LLMs can recognize and generate CFGshttps://arxiv.org/abs/2305.13673and of course a^n b^n is also classic CFG, so it's not clear why one paper had positive results while the other hand negative.
thesz|3 hours ago Transformers are able to recognize balanced brackets grammar at 97% success rate: https://openreview.net/pdf?id=kaILSVAspnThis is 3% or infinitely far away from the perfect tech.The perfect tech is the stack. krackers|6 minutes ago This is very interesting since there is another notable paper which shows LLMs can recognize and generate CFGshttps://arxiv.org/abs/2305.13673and of course a^n b^n is also classic CFG, so it's not clear why one paper had positive results while the other hand negative.
krackers|6 minutes ago This is very interesting since there is another notable paper which shows LLMs can recognize and generate CFGshttps://arxiv.org/abs/2305.13673and of course a^n b^n is also classic CFG, so it's not clear why one paper had positive results while the other hand negative.
thesz|3 hours ago
This is 3% or infinitely far away from the perfect tech.
The perfect tech is the stack.
krackers|6 minutes ago
https://arxiv.org/abs/2305.13673
and of course a^n b^n is also classic CFG, so it's not clear why one paper had positive results while the other hand negative.