I think this is unsurprising, the point of embeddings is to encode the information from the text. It's not encryption or hashing; it's a compressed representation.

Even if you couldn't recover the original words I would expect to be able to recover equivalent words with the same meaning.