Active Learning for Individual Data via Minimal Stochastic Complexity

Shachar Shayovitz, Meir Feder

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Modern machine learning systems require massive amounts of labeled training data in order to achieve high accuracy rates. Active learning uses feedback to label the most informative data points and significantly reduces the labeling effort. Many heuristics for selecting data points have been developed in recent years which are usually tailored to a specific task and a general unified framework is lacking. In this work, the individual data setting is considered and an active learning criterion is proposed. In this setting the features and labels, both in the training and the test, are specific individual, deterministic quantities. Motivated by connections between source coding and minimax learning, the proposed criterion attempts to find data points which minimize the average Predictive Normalized Maximum Likelihood (pNML) on the unlabeled test set. It is shown using a real data set that the proposed criterion performs better than other active learning criteria.

Original languageEnglish
Title of host publication2022 58th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350399981
DOIs
StatePublished - 2022
Event58th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2022 - Monticello, United States
Duration: 27 Sep 202230 Sep 2022

Publication series

Name2022 58th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2022

Conference

Conference58th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2022
Country/TerritoryUnited States
CityMonticello
Period27/09/2230/09/22

Fingerprint

Dive into the research topics of 'Active Learning for Individual Data via Minimal Stochastic Complexity'. Together they form a unique fingerprint.

Cite this