> curious why dont they bake the system prompt in the model itself ?

Probably because if they did, they would need to retrain the model everytime they want to change the system prompt.