[bingbingbing777]

It's scary to think that while we have the Transformer and it seems extremely complex, things like this throw it all away and give us a glimpse into what the neural (or even non-neural) networks of the future will be like. Perhaps even just simulating full biological systems as well as a brain-like system.

[jarekd]

While ANNs are rather trained for unidirectional propagation, action potential propagation in biological neurons is symmetric e.g. ”it is not uncommon for axonal propagation of action potentials to happen in both directions” ( https://journals.aps.org/pre/abstract/10.1103/PhysRevE.92.03... ).

Also, while current ANNs use guessed parametrizations, objectively available is joint distribution - biological neuron should be evolutionarily optimized to exploit, and it is relatively simple in approach from this arXiv.

Such joint distribution neurons bring additional training approaches - maybe some of them are used by biological neural networks?