I've always heard it that way so that's the way I think about it. You can chalk it up to ignorance if you want, but that's my line of thinking. You're sarcastically telling someone that you could care less, when in reality, you couldn't. But hey, if you want to belittle, feel free.