It sounds like everyone is pretty much telling to dump the douche, but I've had friends who held on to bad relationships worse than yours, so I can kinda understand why you're so terrified of leaving him.
The real problem isn't him, it's you. The only reason people stay in a relationship...