I did exactly this with Cohere language embeddings

https://aws.amazon.com/blogs/machine-learning/use-language-e...

Thanks! Something to dig into.