I don’t mean to minimize the problems of correlation of features. I believe I was one of the first to discuss the problem of multicollinearly in the forum (along with Marc Gerstein and pvdb in the following link). At least 10-years ago: : Mis-specification versus multicollinearity
Pvdb’s ideas on OLS were advance machine learning concepts at the time.
The fact that this is being discussed again now, for the most part, is due the recent influx of members familiar with machine learning– like yourself.
It remains a very important and difficult issue, I think. I can document that I have been struggling with it for at least a decade!!! I did not mean to imply there was suddenly one simple solution to the problem. Because there is not one.
But I am thankful for the thoughtful discussions and sharing of ideas in the forum now.