[nephanth]

"And hence invertible" <- does every output embedding combination have an associated input ? Are they able to construct it or is this just an existence result ?

[thaumasiotes]

> Building upon this property, we further provide a practical algorithm, SɪᴘIᴛ, that reconstructs the exact input from hidden activations

[morcus]

I don't think they're claiming surjectivity here. They're just saying the mapping is injective, so for a given output there should be a unique input to construct it.

[RossBencina]

> I don't think they're claiming surjectivity here.

What definition of invertible doesn't include surjectivity?