I experienced this, too. It is quite annoying. You have to explicitly tell the LLM to leave everything else as-is.