[programd]

My armchair is equally comfy, and I have an actual paper to point to:

Jaxley: Differentiable simulation enables large-scale training of detailed biophysical models of neural dynamics [1]

They basically created sofware to simulate real neurons and ran some realistic models to replicate typical AI learning tasks:

"The model had nine different channels in the apical and basal dendrite, the soma, and the axon [39], with a total of 19 free parameters, including maximal channel conductances and dynamics of the calcium pumps."

So yeah, real neurons are a bit more complex then ReLU or Sigmoid.

[1] https://www.biorxiv.org/content/10.1101/2024.08.21.608979v2....