Can an Employer Take Away Banked PTO?

I have roughly 40 hours of PTO accrued, but I recently made the decision to go to part time instead of full time. My manager said that if I go to part time, my PTO will be taken away. Is that legal?