Cost-Sensitive Information Acquisition for Prediction
Wednesday, April 21, 2010, 12:00pm - Wednesday, April 21, 2010, 13:00pm
Even though the necessary information can be freely available in some cases, gathering the information is costly (time, money, etc) in most of the cases; the users are willing to rate only few items, tag only few emails, and train the speech recognition algorithm with only few examples. It is essential to gather the user and expert feedback for the right examples and not waste their effort. A system that requires a tremendous amount of user input and labeled data, is impracticable, while a system that provides an unacceptable rate of incorrect predictions is useless if not harmful. It is thus imperative to develop systems that can provide correct predictions with the least amount of information and feedback possible.
In this talk, I will mainly talk about two techniques aimed at reducing the amount of information required to provide correct predictions. The techniques that I will present are based on decision theoretic analysis of value of information and predicting which examples the underlying model is most likely to be incorrect about. I'll also briefly talk about various interesting projects that I've been participating, such as information visualization and video analysis.