You will survive the consequences better than he will. Whatever you may suffer as consequences in the aftermath, you will still have your dignity, intact, and that is what matters. Do you have to do, move on, and survive. And seriously, fuck this guy. You owe him nothing, and he is sucking the life out of you. Cast him away, once and for all.