Is crap a sware word?

I feel stupid asking this, but is "crap" literally a sware word? Sometimes I hear that it isn't, but I get in trouble if i say it sometimes.