Study
Machine Learning · Decision trees
How a decision tree chooses splits using Gini impurity, why deep trees overfit, and reading the learned rules.
- A tree greedily picks the split that most reduces impurity, then repeats on each side.
- An unrestricted tree can reach 100% training accuracy, which is a warning sign, not a success.