Good for you. I am nowhere near the kind of hoarder for clothes that you were, and I'm also at least a decade younger so haven't had the time to build a hoard like this (and I don't think I would) - but while I do buy beautiful and often expensive clothing, I wear them all! Every day! My vice is the brand Camilla from Australia. Silk kaftans and coats? I will wear them to the supermarket or to a Tuesday at work. Because it makes me happy and being a bright bird of paradise expresses my personality. And I guess because I style it with my unique aesthetic and create my headdresses to go with it (think: nature goddess sorceress in the 21st century) people don't see my style as "rich bitch" they see it as "creative artist who has good taste" and so don't dislike me for it.
Also, I don't buy stuff specifically because it's designer or expensive, I buy it because I can see that it will fit my aesthetic and that it will be versatile, and that I will feel like myself when I wear it. Sometimes I find stuff at op shops that do that. But often the most creative and beautiful clothes are more expensive. Not thousands of dollars but over a hundred at least. And tbh that's how it should be, the workers deserve a living wage!
I am planning to learn to sew soon though, so I can design my own clothes! That would be better for the environment and I can fully express my creativity without having to buy new things!