[toth]

Ditto.

I think that ship has sailed, but I think it's unfortunate that "ReLU(x)" became a popular notation for "max(0,x)". And using the name "rectified linear unit" for basically "positive part" seems like a parody, like insisting on calling water "dihydrogen monoxide".

[BlueTemplar]

It hasn't "sailed" as long as they want to communicate with non-machine-learning people.