Stochastic Link and Group Detection

July 2002

Stochastic Link and Group Detection

Authors:

Jeremy Martin Kubica, Andrew Moore, Jeff Schneider, and Yiming Yang

Abstract:

Link detection and analysis has long been important in the social sciences and in the government intelligence community. A significant effort is focused on the structural and functional analysis of "known" networks. Similarly, the detection of individual links is important but is usually done with techniques that result in "known" links. More recently the internet and other sources have led to a flood of circumstantial data that provide probabilistic evidence of links. Co-occurrence in news articles and simultaneous travel to the same location are two examples. We propose a probabilistic model of link generation based on membership in groups. The model considers both observed link evidence and demographic information about the entities. The parameters of the model are learned via a maximum likelihood search. In this paper we describe the model and then show several heuristics that make the search tractable. We test our model and optimization methods on synthetic data sets with a known ground truth and a database of news articles.
@conference{Kubica-2002-8520,
author = {Jeremy Martin Kubica And Andrew Moore And Jeff Schneider And Yiming Yang},
title = {Stochastic Link and Group Detection},
booktitle = {Proceedings of 18th National Conference on Artificial Intelligence (AAAI '02)},
year = {2002},
month = {July},
pages = {798 - 804},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.