Taking Things Literally

Ever wonder when people are jokingly saying things, if they really mean it?
That concept continues to perplex me. Sometimes they are joking, or are they?

I dunno when to take things literally and when to take it as a joke.