How about just not change the harness abruptly in the first place? Make new system prompt changes "experimental" first so you can gather feedback.