Learning with not Enough Data Part 2: Active Learning

Lilian Weng · 4 years ago

Active learning is a machine learning technique that selects which unlabeled samples to label within a fixed budget to maximize model performance improvement, particularly useful when labeling is costly. Key approaches include uncertainty sampling (using prediction confidence or model ensembles), diversity sampling (selecting representative samples), and expected model change, with MC dropout being an economical method for uncertainty estimation in deep neural networks. The method enables more efficient model training by intelligently choosing which samples to label rather than labeling randomly.