Coworkers treating me different and making racist comments behind my back because of my wife

I(21 white M) put up a picture of my wife(21 black F) in my cubicle like everyone else does. It was fine before I did that. Now all I get are dirty looks and stares like I’m a monster. Is quitting the only option?