Learning to Construct Knowledge Bases from the World Wide Web

April 2000

Learning to Construct Knowledge Bases from the World Wide Web

Authors:

M. Craven, D. DiPasquo, D. Freitag, A. McCallum, Tom Mitchell, K. Nigam, and S. Slattery

Abstract:

The World Wide Web is a vast source of information accessible to computers, but understandable only to humans. The goal of the research described here is to automatically create a computer understandable knowledge base whose content mirrors that of the World Wide Web. Such a knowledge base would enable much more effective retrieval of Web information, and promote new uses of the Web to support knowledge-based inference and problem solving. Our approach is to develop a trainable information extraction system that takes two inputs. The first is an ontology that defines the classes (e.g., company, person, employee, product) and relations (e.g., employed_by, produced_by) of interest when creating the knowledge base. The second is a set of training data consisting of labeled regions of hypertext that represent instances of these classes and relations. Given these inputs, the system learns to extract information from other pages and hyperlinks on the Web. This article describes our general approach, several machine learning algorithms for this task, and promising initial results with a prototype system that has created a knowledge base describing university people, courses, and research projects.
@article{Craven-2000-16681,
author = {M. Craven And D. DiPasquo And D. Freitag And A. McCallum And Tom Mitchell And K. Nigam And S. Slattery},
title = {Learning to Construct Knowledge Bases from the World Wide Web},
journal = {Proceedings of Artificial Intelligence},
year = {2000},
month = {April},
volume = {118},
number = {1},
pages = {69 - 113},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.