English speakers frequently say “Jesus!” or “thank God” - it would be weird for an LLM.

Would be weird in an email, but not objectionable. The problem is the bias for one religion over the others.