My "friends" envy my lifestyle... what should I do?

I have been practicing personal development since I was very young (7 years old), and now I’m 28. I had a tough childhood that caused me anxiety in school, so I was sent to a psychologist. From that moment on, I was "brainwashed" in a good way to believe that I would build a great life for myself. Over the years, I had amazing role models thanks to my psychologists.

For the past few years, my life has been going really well. I keep meeting more people, going out more, my work is increasingly appreciated, I attend parties, wear cool outfits, enjoy gourmet food, stay motivated to learn new things, and now I’m about to start traveling.

The only downside is that now I have a lot of haters—some of them even my friends—whom I have never wronged in any way. Yet, they love to comment that I’m just an "incredibly lucky person", but basically implying that I don’t deserve anything I have and that they are somehow better than me because they haven’t had the same "luck."

They don’t know everything I’ve been through because I don’t like talking about sad things—I don’t want to feel sad. Besides, I don’t think I owe anyone an explanation, especially not for being happy and for not harming anyone.

I’ve been thinking about whether I should distance myself from these friendships and surround myself with people who, for example, are financially free and also love personal development like I do… but I’m not sure if that would be cold or cruel.

I actually had to stop talking to one friend in particular because, in one way or another, he was constantly implying that he hated me and people who has my lifestyle.

What should I do?