What's important as a leader is not what happens when you are there. It's what happens when you're NOT there.

You only have power over people so long as you don't take everything away from them. But when you've robbed a man of everything, he's no long in your power - he's free again.