Be very careful. By logic, if this is how he feels, he should have left of his own accord. The fact he stayed, is giving you a cold shoulder and gaslighting you about your self-esteem sounds like deliberate manipulation and passive aggressive controlling behaviour. If I were you I’d get out of that relationship asap, even if he begs you to stay, even if it breaks your heart now. You will get over it, but every year spent with that kind of person will make it harder. Like others have said, you deserve warmth, love, loyalty, support, intimacy and you need to be free to accept it from someone more worthy of your time. Don’t let some mole play mind games on you. All the best! xx