Backpropagation was probably the most important step, but there was also the issue of workable training methods for many-layer networks. Fukushima did some very important - but rarely mentioned - work about this starting in 1979.
He trained layer by layer, proceeding to the next only when the current stabilized. The main practical issue were the enormous training and execution times with the computers of the day.https://en.wikipedia.org/wiki/Neocognitron
No comments yet.