[koromak]

EDIT: Of course people are already doing this. D2NN seems to be the keyword, Diffractive Deep Neural Networks

[TeMPOraL]

Yes, by "lens" I meant a possibly large stack of optical elements, each designed to perform a single computational step. Kind of like layers of an NN, but etched on sheets of plastic.

Thanks for finding the proper term for this!