“Why should someone who doesn’t work be given a free home when I’ve had to work for mine”

I was talking to my dad today and I mentioned how housing is a human right that everyone should be entitled to and he asked me this question (title). I responded that people do want to work but simply can't afford to live while working most jobs. I feel like I could've said more/something better in response to this question so what would you guys have answered?