…Your company is fucked.
(Disclaimer: This is about companies who have more than, say 20 employees as you'd probably have less direct contact with the owner)
In my experience, in every company I worked for that was doing well I rarely interacted with the owner. If anything my direct manager would filter things up to them.
But imagine you work in a company with dozens or even hundreds of employees. The owner or person who runs your workplace notices you're late and comments on it. They may even give you a stern talking to.
A lot of business owners and regional managers are shortsighted and pennywise/pound foolish when it comes to running their business. They're in charge of a number of workers, have to work with the finances, make deals to expand business, etc. These are all big picture tasks.
So when they get on you about being 5 minutes late, or leaving 5 minutes early, or arriving back from lunch a minute too late, or having a cluttered desk, etc….What major big picture tasks are they neglecting because they've devoted brain power to such minutiae?