Lab Meeting August 10th, 2010 (KuoHuel): An Online Approach: Learning-Semantic-Scene-by-Tracking and Tracking-by-Learning-Semantic-Scene (CVPR'10)

Title: An Online Approach: Learning-Semantic-Scene-by-Tracking and

Tracking-by-Learning-Semantic-Scene

Authors: Xuan Song, Xiaowei Shao, Huijing Zhao, Jinshi Cui, Ryosuke Shibasaki and Hongbin Zha

Abstract:

Learning the knowledge of scene structure and tracking

a large number of targets are both active topics of computer

vision in recent years, which plays a crucial role in surveil-

lance, activity analysis, object classification and etc. In

this paper, we propose a novel system which simultaneously

performs the Learning-Semantic-Scene and Tracking, and

makes them supplement each other in one framework. The

trajectories obtained by the tracking are utilized to continu-

ally learn and update the scene knowledge via an online un-

supervised learning. On the other hand, the learned knowl-

edge of scene in turn is utilized to supervise and improve

the tracking results. Therefore, this “adaptive learning-

tracking loop” can not only perform the robust tracking in

high density crowd scene, dynamically update the knowl-

edge of scene structure and output semantic words, but also

ensures that the entire process is completely automatic and

online. We successfully applied the proposed system into the

JR subway station of Tokyo, which can dynamically obtain

the semantic scene structure and robustly track more than

150 targets at the same time.

[pdf]