WMSC’07 - IEEE Workshop on Multimodal Sentient Computing:
Sensors, Algorithms, and Systems (In conjunction with CVPR 2007)
Minneapolis, Minnesota, USA, Friday, June 22, 2007
Program and Award Form
Note: Each attendee of WMSC’07 will have the opportunity to "vote" for the three awards of WMSC
2007, each with a $500 cash award: the best paper, the best system paper, and the best student paper.
(1) Attendees who return their votes will have a chance to win a free copy of the 400-page book
"Multimodal Surveillance: Sensors, Algorithms and Systems" (Editors: Zhigang Zhu and Thomas
S. Huang), to be published by Artech House Publisher in July 2007.
(2) Please circle your choice (only one for each category) at the right side of each paper:
P: the best workshop Paper; Y: the best sYstem paper; S: the best Student paper (if a current student
(name in italic) presents the paper; X is marked if none of the authors of the paper is a student)
07:45 -8:30
08:30 - 8:45
Breakfast
Introduction (Tom Huang, Zhigang Zhu, Ying-li Tian)
The Artech book, program, awards, sponsors, etc
08:45 - 10:05
(15+5 min
each)
Session I: Multimodal Biometrics (Chair: Amit Kale)
10:05 - 10:25
10:25 - 11:05
11:10 - 12:30
(15+5 min
each)

Multi-Modal Biometrics Involving the Human Ear, Christopher Middendorff, Kevin
W. Bowyer and Ping Yan (University of Notre Dame)

Fusion of Face and Palmprint for Personal Identification Based on Ordinal Features,
Rufeng Chu, Shengcai Liao, Yufei Han, Zhenan Sun, Stan Z. Li and Tieniu Tan
(Center for Biometrics and Security Research & National Laboratory of Pattern
Recognition, Chinese Academy of Sciences)

Human Identification Using Gait and Face, Amit Kale (Siemens Information Systems
Ltd.), Amit K. Roy-Chowdhury (University of California Riverside), Rama Chellappa
(University of Maryland)
PYX

Multimodal Biometric Systems: Applications and Usage Scenarios, Michael Thieme,
Director of Special Projects (International Biometric Group)
PYX
PYS
PYS
Coffee Break
Capstone I: Biometrics (Dr. P. Jonathon Phillips)
Break
Session II: Multimodal Sentient Computing (Chair: Stephen M. Chu)

Automatic Audio-Visual Speech Recognition, Stephen M. Chu (IBM T.J. Watson
Research Center), and Thomas S. Huang (UIUC)
PYX

Multimodal Tracking for Smart Videoconferencing and Video Surveillance, Dmitry
Zotkin, Vikas Raykar, Ramani Duraiswami and Larry S. Davis (U. Maryland)
PYS

Sensor Fusion and Environmental Modeling for Multimodal Sentient Computing,
Christopher Town (University of Cambridge Computer Laboratory, UK)
PYX

SATware: Middleware for Sentient Spaces, Bijit Hore, Hojjat Jafarpour, Ramesh Jain,
Shengyue Ji, Daniel Massaguer,Sharad Mehrotra, Nalini Venkatasubramanian, Utz
Westermann (University of California at Irvine)
PYS
12:30 - 13:15 Work Lunch and Demos
ObjectVideo (10 min introduction)
13:15 - 14:15
(6 min each)
14:20 - 15:00
15:00 - 15:20
15:20 - 16:40
(15+5 min
each)
17:00 - 18:20
(15+5 min
each)
Panel: Multimodal Sentient Computing (Moderator: Terry Boult)
Panelists:

Terry Boult (University of Colorado at Colorado Spring)

Paul Brewer (ObjectVideo)

Gopal Pingali (IBM T.J. Watson Research Center)

Stan Z. Li (Chinese Academy of Sciences)

Jeff Houser (Army Research Lab)

Arun Abraham Ross (West Virginia University)
Break
Capstone II: Surveillance (Dr. Mubarak Shah)
Coffee Break
Session III: Multimodal Surveillance (Chair: Ying-Li Tian)

An End-to-End eChronicling System for Mobile Human Surveillance, Gopal Pingali,
Ying-Li Tian, Shahram Ebadollahi, Mark Podlaseck, Jason Pelecanos, Harry
Stavropoulos (IBM T.J. Watson Research Center)
PYX

Systems issues in distributed multi-modal surveillance, Li Yu (ObjectVideo Inc.),
Terry Boult (University of Colorado at Colorado Spring)
PYX

A Multimodal Workbench for Automatic Surveillance, Dragos Datcu, Zhenke Yang,
L.J.M. Rothkrantz (Delft University of Technology)
PYS

Automatic 3D Modeling of Cities with Multimodal Air and Ground Sensors, Avideh
Zakhor and Christian Frueh (University of California at Berkeley)
PYX
Break
Session IV: Multimodal Sensors (Chair: Li Yu)

The ARL Multi-Modal Sensor: a research tool for target signature collection,
algorithm validation, and emplacement studies, Jeff Houser, Lei Zong (Army Research
Lab)

Multimodal Image Fusion Systems, Diego Socolinsky (Equinox Corporation)

LDV Sensing and Processing for Remote Hearing in a Multimodal Surveillance
System, Zhigang Zhu, Weihong Li, Edgardo Molina and George Wolberg (CUNY
City College and Graduate Center)
PYS

Sensor and Data Systems, Audio-Assisted Cameras and Acoustic Doppler Sensors,
Paris Smaragdis, Bhiksha Raj and Kaustubh Kalgaonkar (MERL Research Lab)
PYS
18:30 - 19:30
Reception and Demos
ObjectVideo, IBM, others
19:30 - 20:30
Keynote Speech: Dr. Rakesh “Teddy” Kumar
Awards: Best Workshop Paper, Best Student Paper, Best System Paper
Adjourn
20:30 -
PYX
PYX