If he can't handle you at your worst then he does not deserve you at your best. Real love means seeing beyond the words spoken out of pain, and instead seeing a person's soul.
The truth is, unless you let go, unless you forgive yourself, unless you forgive the situation, unless you realize that the situation is over, you cannot move forward.
Throughout life people will make you mad, disrespect you and treat you bad. Let God deal with the things they do, cause hate in your heart will consume you too.