Study
Machine Learning · Hyperparameter search
Tuning with GridSearchCV and RandomizedSearchCV, nested evaluation on a held-out test set, and why random search often wins.
- Hyperparameters are chosen on validation folds; the test set is still only for the final number.
- Random search explores more values of the parameters that matter for the same budget.