I pay taxes for a city i don’t live in

I work 40 minutes away from where I live, and I pay taxes for the town i actually live in and the town I work in. it’s so fucking aggravating. It’s basically like getting taxed to go to work and get taxed more, it’s a never ending cycle.