Am I screwing myself over if I can’t use my first real job as a reference?

I’m at my wits end here with my job. I constantly get scheduled 75+ hours a week and I am beyond burnt out. Will it ruin my future job prospects if I quit without notice and a new job calls my old manager?