outside hire for management

I was recently hired for a supervisor position at a company. I'll be an outside hire. I'm worried/stressing about how current staff will view me. Do I need to worry about them under putting my authority? Anyone else experienced this from the employee or going in as new sup?