Bayesian Active Model Selection with an Application to Automated Audiometry
Gardner, Jacob R.
and
Malkomes, Gustavo
and
Garnett, Roman
and
Weinberger, Kilian Q.
and
Barbour, Dennis L.
and
Cunningham, John P.
Neural Information Processing Systems Conference - 2015 via Local Bibsonomy
Keywords:
dblp
The authors introduce a new method for actively selecting the model that best fits a dataset. Contrary to active learning, where the next learning point is chosen to get a better estimate of the model hyperparameters, this methods selects the next point to better distinguish between a set of models. Similar active model selection techniques exist, but they need to retrain each model for each new data point to evaluate. The strength of the author's method is that is only requires to evaluate the predictive distributions of models, without retraining.
They propose to apply this method to detect noise-induced hearing loss. The traditional way of screening for NIHL involves testing a wide range of intensities and frequencies, which is time consuming. The authors show that with their method, the number of tests to be run could be drastically decreased, reducing the cost of large-scale screenings for NIHL.