I wonder if some investment firms are already doing this internally at a large scale. (Probably.)

They are - I’ve seen it.

They just use APIs though. There is very little interest within them to do the model engineering and inference in house.