Depends on the person you are saying too or listening.
in America it's considered a swear word, and I'd imagine similar to people of the Christian faith.
Personally, it's not, but I can see why it could be considered a minor one amongst certain people.