Classifying dialogue in high-dimensional space

June 2011

Classifying dialogue in high-dimensional space

Authors:

José P. González-Brenes and Jack Mostow

Abstract:

The richness of multimodal dialogue makes the space of possible features required to describe it very large relative to the amount of training data. However, conventional classifier learners require large amounts of data to avoid overfitting, or do not generalize well to unseen examples. To learn dialogue classifiers using a rich feature set and fewer data points than features, we apply a recent technique, ℓ1-regularized logistic regression. We demonstrate this approach empirically on real data from Project LISTEN's Reading Tutor, which displays a story on a computer screen and listens to a child read aloud. We train a classifier to predict task completion (i.e., whether the student will finish reading the story) with 71% accuracy on a balanced, unseen test set. To characterize differences in the behavior of children when they choose the story they read, we likewise train and test a classifier that with 73.6% accuracy infers who chose the story based on the ensuing dialogue. Both classifiers significantly outperform baselines and reveal relevant features of the dialogue.
@article{Gonzalez-Brenes-2011-122076,
author = {José P. González-Brenes And Jack Mostow},
title = {Classifying dialogue in high-dimensional space},
journal = {Proceedings of ACM Transactions on Speech and Language Processing (TSLP)},
year = {2011},
month = {June},
volume = {7},
number = {3},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.