A PDA-based Sign Translator

October 2002

A PDA-based Sign Translator

Authors:

Jing Zhang, Xilin Chen, Jie Yang, and Alex Waibel

Abstract:

In this paper, we propose an effective approach for a PDA-based sign system, and it presents user the sign translator. Its main functions include 3 parts: detection, recognition and translation. Automatic detection and recognition of text in natural scenes is a prerequisite for automatic sign translator. In order to make the system robust for text detection in various natural scenes, the detection approach efficiently embeds multi-resolution, adaptive search in a hierarchical framework with different emphases at each layer. We also introduce an intensity-based OCR method to recognize character in various fonts and lighting condition, where we employ Gabor transform to obtain local features, and LDA for selection and classification of features. The recognition rate is 92.4% for the testing set got from the natural sign. Sign is different from the normal used sentence. It is brief, with a lot of abbreviations and place nouns. We here only briefly introduce a rule-based place name translation. We have integrated all these functions in a PDA, which can capture sign image, auto segment and recognize the Chinese sign, and translate it into English.
@conference{Zhang-2002-8571,
author = {Jing Zhang And Xilin Chen And Jie Yang And Alex Waibel},
title = {A PDA-based Sign Translator},
booktitle = {Proceedings of 4th IEEE International Conference on Multimodal Interfaces (ICMI '02)},
year = {2002},
month = {October},
pages = {217 - 222},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.