It might be another word...oh dog gone,golly, gee whiz, bang-bang, goo goo tochoo. Or some other meaningless words and phrases that come out of their mouths.
I don't say anything. My fiancee gets quite loud though, but she is a Christian so it doesn't matter if she yells out to god, though usually she just moans and tells me that she loves me.
I wouldn't be surprised if they did scream God. Atheists are hypocritical. The don't believe in God yet they celebrate Christmas. They claim to dislike/disbelieve in all religions, when actually they dislike Christianity the most.