A reinforcement learning agent for personalized information filtering

January 2000

A reinforcement learning agent for personalized information filtering

Authors:

Young-Woo Seo and Byoung-Tak Zhang

Abstract:

This paper describes a method for learning user's interests in the Web-based personalized information filtering system called WAIR. The proposed method analyzes user's reactions to the presented documents and learns from them the profiles for the individual users. Reinforcement learning is used to adapt the term weights in the user profile so that user's preferences are best represented. In contrast to conventional relevance feedback methods which require explicit user feedbacks, our approach learns user preferences implicitly from direct observations of user behaviors during interaction. Field tests have been made which involved 7 users reading a total of 7,700 HTML documents during 4 weeks. The proposed method showed superior performance in personalized information filtering compared to the existing relevance feedback methods.
@conference{Seo-2000-16758,
author = {Young-Woo Seo And Byoung-Tak Zhang},
title = {A reinforcement learning agent for personalized information filtering},
booktitle = {Proceedings of 5th International Conference on Intelligent User Interfaces (IUI '00)},
year = {2000},
month = {January},
pages = {248 - 251},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.