Boss says I left early when I had multiple people saying I could leave

It's really annoying when I'm finished in my area but apparently “we needed help in another area” like they never told me. Doesn't help that 95% of my coworkers don't speak English.