How to deal with boss keeping me late

So when i applied for this job the schedule said 9-5 ok great but almost every day my boss tries to make me stay 5-20minutes later. I know it does not seem like a lot but one of the reasons i accepted the job was the schedule i have things i need to do and cant stay late everyday how can i stop this without getting fired or looked down on