Sounds like its essentially a generalized zero-shot classifier that takes and option set at runtime and works on unstructured inputs.

you pass in your "prompt" and options (described in natural language) that it can respond with, in addition to your input. it gives back that option set with a probability assigned to each one

yes and can do many of those in parallel