It's not worth to get your hands dirty (by taking revenge on him, for example).
He isn't worth the risk/the feeling of guilt/the moral decaying by getting your hands dirty.
And other ways.
An aside note is that "getting your hands dirty" can be also in a positive way, meaning that you are not a hands off people, you set yourself to work. You do things, don't just get in the management role, etc.