Visual Analysis of Humans Looking at People

Understanding human activity from video is one of the central problems in the field of computer vision, driven by a wide variety of applications in communications, entertainment, security, commerce, and athletics.

This unique text/reference provides a coherent and comprehensive overview of all aspects of video analysis of humans. Broad in coverage and accessible in style, the text presents original perspectives collected from preeminent researchers gathered from across the world. In addition to presenting state-of-the-art research, the book reviews the historical origins of the different existing methods, and predicts future trends and challenges.

Topics and features: with a Foreword by Professor Larry Davis of the University of Maryland Institute for Advanced Computer Studies, USA; contains contributions from an international selection of leading authorities in the field; includes an extensive glossary; discusses the problems associated with detecting and tracking people through camera networks; examines topics related to determining the time-varying 3D pose of a person from video; investigates the representation and recognition of human and vehicular actions; reviews the most important applications of activity recognition, from biometrics and surveillance, to sports and driver assistance.

With its all-encompassing scope, this essential reference will be of great value not only to graduate students in computer vision, but also to all researchers and professionals interested in systems for the visual analysis of humans.

Part I: Detection and Tracking

Is There Anybody Out There?
Thomas B. Moeslund

Beyond the Static Camera: Issues and Trends in Active Vision
Murad Al Haj, Carles Fernández, Zhanwu Xiong, Ivan Huerta, Jordi Gonzàlez and Xavier Roca

Figure-Ground Segmentation - Pixel-Based
Ahmed Elgammal

Figure-Ground Segmentation – Object Based
Bastian Leibe

Face Detection
Raghuraman Gopalan, William Robson Schwartz, Rama Chellappa, and Ankur Srivastava

Wide Area Tracking in Single and Multiple Views
B. Song, R. J. Sethi and A. K. Roy-Chowdhury

Benchmark Datasets for Detection and Tracking
Anna-Louise Ellis and James Ferryman

Part II: Pose Estimation

Articulated Pose Estimation and Tracking: Introduction
Leonid Sigal

Model-based Pose Estimation
Gerard Pons-Moll and Bodo Rosenhahn

Motion Models for People Tracking
David J. Fleet

Part-based Models for Finding People and Estimating Their Pose
Deva Ramanan

Feature-based Pose Estimation
Cristian Sminchisescu, Liefeng Bo, Catalin Ionescu and Atul Kanaujia

Benchmark Datasets for Pose Estimation and Tracking
Mykhaylo Andriluka, Leonid Sigal and Michael J. Black

Part III: Recognition

On Human Action
Aaron Bobick and Volker Krüger

Motion Pattern Analysis for Modeling and Recognition of Complex Human Activities
Nandita M. Nayak, Ricky J.Sethi, Bi Song, Amit K. Roy-Chowdhury

Action Recognition Using Topic Models
Xiaogang Wang

Learning Action Primitives
Dana Kulic, Danica Kragic and Volker Krüger

Contextual Action Recognition
Hedvig Kjellström

Facial Expression Analysis
Fernando De la Torre and Jeffrey F. Cohn

Benchmarking Datasets for Human Activity Recognition
Haowei Liu, Rogerio Feris and Ming-Ting Sun

Part IV: Applications

Applications for Visual Analysis of People
Adrian Hilton

Image and Video-based Biometrics
Vishal M. Patel, Jaishanker K. Pillai and Rama Chellappa

Security and Surveillance
Shaogang Gong, Chen Change Loy and Tao Xiang

Predicting Pedestrian Trajectories
Stefano Pellegrini, Andreas Ess and Luc Van Gool

Human Computer Interaction
Dennis Lin and Vuong Le and Thomas Huang

Social Signal Processing: The Research Agenda
Maja Pantic, Roderick Cowie, Francesca DErrico, Dirk Heylen, Marc Mehu, Catherine Pelachaud, Isabella Poggi, Marc Schroeder and Alessandro Vinciarelli

Sign Language Recognition
Helen Cooper, Brian Holt and Richard Bowden

Sports TV Applications of Computer Vision
Graham Thomas

Multi-view 4D Reconstruction of Human Action for Entertainment
Oliver Grau

Vision for Driver Assistance: Looking at People in a Vehicle
Cuong Tran and Mohan Manubhai Trivedi