That's literally not useful for the sort of applications people want to use transformers for.

What you're using is a transformer based database index. An obfuscated one.

Training data is the database. Model is a lossy compressed index.