Was told I was anti-social for preferring to work remotely.

Since the pandemic, I've been doing full-time remote work. Now, that many organizations are returning to the office my work decided they want to do the same. Told my manager that I would resign if I had to work in the office. They said I was being anti-social and should reconsider. I'm not anti-social. It's the anti-social assholes that I'm trying to avoid.