walking off the job?

So at work today our manager and assistant manager and a supervisor went to a jobsite leaving one supervisor at the workshop. I am a welder. early in the day a fight broke out and when we needed a supervisor he wasn't in the workplace he went home so i went home due to workplace not being properly supervised am i in the wrong here