I'm an atheist but saying things like oh my god or calling for Christ or his mother is so ingrained in my mother language that it's just a meaningless jerk reflex sound... Like saying ow, or sneezing...
It's sad that this applies to so many countries. I couldn't say where you are from.