List of Past Events
Video Content Annotation Using Visual Analysis and a Large Semantic
Anthony Hoogs
Monday, September 29, 2003, 02:00pm - 03:00pm
GE Global Research, Niskayana, New York
September 29, 2003 at 2:00 p.m.
Psychology Room 101, Busch Campus
Anthony Hoogs
GE Global Research
Video Content Annotation Using Visual Analysis and a Large Semantic Knowledgebase
We present a novel approach to automatically annotating broadcast
video. To manage the enormous variety of objects, events and scenes
in video problem domains such as news video, we couple generic image
analysis with a semantic database, WordNet, containing huge amounts of
real-world information. Object and event recognition are performed by
searching WordNet for concepts jointly supported by image evidence and
topic context derived from the video transcript. No object- or
event-specific training is required, and only a few object models and
detection algorithms are required to label much of the significant
content of news video. The hierarchical structure of WordNet yields
hierarchical recognition, dynamically tailored to the level of
supporting image evidence. The potential of the approach is
demonstrated by analyzing a wide variety of scenes in news video.
Joint work with Jens Rittscher, Gees Stein, and John Schmiederer
