Max_features = "log2" vs the default

Indeed, max_features (mtry in R implementation) is important:

Out of these parameters, mtry is most influential both according to the literature and in our own experiments. The best value of mtry depends on the number of variables that are related to the outcome.

In addition to that, some researchers found that max_features should be supported with a variable selection method to obtain optimal performance only if our dataset contains noisy (irrelevant) features.

1 Like