Multimodal Human-Computer Interaction for Crisis Management Systems
   
Jump to: Complete Reference, Abstract, Download, BibTeX Entry, Links and Notes, Images, Additional Material
 
Complete Reference
  N. Krahnstoever, E. Schapira, S. Kettebekov, R. Sharma, "Multimodal Human-Computer Interaction for Crisis Management Systems", IEEE Workshop on Applications of Computer Vision, The Orlando World Center Marriott Orlando, FL USA, December 3-4, 2002.
 
Abstract
  This paper presents a multimodal crisis management system (XISM). It employs processing of natural gesture and speech commands elicited by a user to efficiently manage complex dynamic emergency scenarios on a large display. The developed prototype system demonstrates the means of incorporating unconstrained free-hand gestures and speech into a real-time interactive interface. This paper provides insights into the design aspects of the XISM system. In particular, it addresses the issues of extraction and fusion of gesture and speech modalities to allow more natural interactive behavior. Performance characteristics of the current prototype and considerations for future work are discussed. A series of studies indicated positive response with respect to ease of interacting with the current system.
 
Download
  Postscript 1.0 Color (17.7MB) | Postscript 2.0 Grayscale (1.3 KB)
PDF Color (462 KB) | PDF Grayscale (278 KB)
 
BibTeX Entry
 
@inproceedings{krahnstoever02multimodal,
author={N. Krahnstoever andE. Schapira and S. Kettebekov and R. Sharma},
booktitle={Proc. of IEEE Workshop on Applications of Computer Vision (WACV 2002), The Orlando World Center Marriott Orlando, FL USA},
month={December},
title={Multimodal Human-Computer Interaction for Crisis Management Systems},
year={2002}
}
 
Links and Notes
  WACV 2002 Conference
 
Images
 
 
Additional Material
 
VIDEOS:

An example interaction session: AVI, Codec: DivX (15.2MB) | MPEG-2 (15.8MB)