top | item 38659306

(no title)

wint3rmute | 2 years ago

A recent paper [1] shows that what you're describing is possible to some degree - you can reproduce text from its embeddings. The paper provides the code implementing the reversal process, so you could quickly hack together a prototype :)

I also recommend a video by Yannic Kilcher [2], explaining the paper.

[1] https://arxiv.org/abs/2310.06816

[2] https://www.youtube.com/watch?v=FY5j3P9tCeA

discuss

order

two_in_one|2 years ago

isn't that how translation works in tranformers? encoder produces embedding then decoder generates the sentence. do it again with reverse translation and you get your text back in original language. combining two sentences can be done by using model for summary. making a cross-breed of two sentences is a different problem.