Bad Hair Day

This is a phrase I find difficult to comprehend. I understand the words separately, but it seems like nonsense when they are put together. Does this phrase actually mean what it appears to mean? The only meaning I can parse from it is that the state of one's hair (whatever "bad" hair means) determines the state of the day, for the entire day.

Are people really that dumb? Or am I missing something?