Why do people not unionize more often?

I saw a post about someone mentioning a union at Walmart or something. It made me think, why do people not unionize these types of businesses? In my opinion they are one of the worst offenders and I can't see a downside to it.