what’s wrong with fragrances?

My boss doesn't allow us to wear any kind of perfume or cologne, and if you wear body lotion it has to be fragrance free. Is this normal or just a whim of the manager? It's an office job where everyone has their own office and we don't work with public.