Spoken, Multilingual and Multimodal Dialogue Systems: Development and Assessment口语、多语言与多模式对话系统:发展与评估

分类: 图书,进口原版书,科学与技术 Science & Techology ,
作者: Ramon Lopez Cozar Delgado,Masahiro Araki 著
出 版 社:
出版时间: 2005-11-1字数:版次: 1页数: 261印刷时间: 2005/11/01开本: 16开印次: 1纸张: 胶版纸I S B N : 9780470021552包装: 精装编辑推荐
作者简介
Ramón López-Cózar Delgado is Associate Professor in the Department of Languages and Computer Systems, Computer Science Faculty, Granada University, Spain. He has published over 30 papers in international journals and conferences concerned with dialogue systems. He is member of the COST Action 278 “Spoken Language Interaction in Telecommunications”
Masahiro Araki is an Associate Professor at Department of Electronics and Information Science, Kyoto Institute of Technology. His current interests are spoken dialogue processing and artificial intelligence. He is a member of ACL and ISCA.
João P. Neto is Assistant Professor at Instituto Superior Técnico (IST), Technical University of Lisbon in signal theory, discrete signal processing, control systems and neural networks. His research interests focus on spoken, multimodal and multilingual dialogue systems, speech recognition and understanding, dialogue management and speech synthesis.
内容简介
Dialogue systems are a very appealing technology with an extraordinary future. Spoken, Multilingual and Multimodal Dialogues Systems: Development and Assessment addresses the great demand for information about the development of advanced dialogue systems combining speech with other modalities under a multilingual framework. It aims to give a systematic overview of dialogue systems and recent advances in the practical application of spoken dialogue systems.
Spoken Dialogue Systems are computer-based systems developed to provide information and carry out simple tasks using speech as the interaction mode. Examples include travel information and reservation, weather forecast information, directory information and product order. Multimodal Dialogue Systems aim to overcome the limitations of spoken dialogue systems which use speech as the only communication means, while Multilingual Systems allow interaction with users that speak different languages.
Presents a clear snapshot of the structure of a standard dialogue system, by addressing its key components in the context of multilingual and multimodal interaction and the assessment of spoken, multilingual and multimodal systems
In addition to the fundamentals of the technologies employed, the development and evaluation of these systems are described
Highlights recent advances in the practical application of spoken dialogue systems
This comprehensive overview is a must for graduate students and academics in the fields of speech recognition, speech synthesis, speech processing, language, and human–computer interaction technolgy. It will also prove to be a valuable resource to system developers working in these areas.
目录
Preface
1 Introduction to Dialogue Systems
1.1 Human-Computer Interaction and Speech Processing
1.2 Spoken Dialogue Systems
1.2.1 Technological Precedents
1.3 Multimodal Dialogue Systems
1.4 Multilingual Dialogue Systems
1.5 Dialogue Systems Referenced in This Book
1.6 Area Organisation and Research Directions
1.7 Overview of the Book
1.8 Further Reading
2 Technologies Employed to Set Up Dialogue Systems
2.1 Input Interface
2.1.1 Automatic Speech Recognition
2.1.2 Natural Language Processing
2.1.3 Face Localisation and Tracking
2.1.4 Gaze Tracking
2.1.5 Lip-reading Recognition
2.1.6 Gesture Recognition
2.1.7 Handwriting Recognition
2.2 Multimodal Processing
2.2.1 Multimodal Data Fusion
2.2.2 Multimodal Data Storage
2.2.3 Dialogue Management
2.2.4 Task Module
2.2.5 Database Module
2.2.6 Response Generation
2.3 Output Interface
2.3.1 Graphic Generation
2.3.2 Natural Language Generation
2.3.3 Speech Synthesis
2.3.4 Sound Generation
2.3.5 Tactile/Haptic Generation
2.4 Summary
2.5 Further Reading
3 Multimodal Dialogue Systems
3.1 Benefits of Multimodal Interaction
3.1.1 In Terms of System Input
3.1.2 In Terms of System Processing
3.1.3 In Terms of System Output
3.2 Development of Multimodal Dialogue Systems
3.2.1 Development Techniques
3.2.2 Data Fusion
3.2.3 Architectures of Multimodal Systems
3.2.4 Animated Agents
3.2.5 Research Trends,
3.3 Summary
3.4 Further Reading
4 Multilingual Dialogue Systems
4.1 Implications of Multilinguality in the Architecture of Dialogue Systems
4.1.1 Consideration ofAlternatives in Multilingual Dialogue Systems
4.1.2 Interlingua Approach
4.].3 Semantic Frame Conversion Approach
4.1.4 Dialogue-Control Centred Approach
4.2 Multilingual Dialogue Systems Based on Interlingua
4.2.1 MIT Voyager System
4.2,2 MIT Jupiter System
4.2.3 KIT System
4.3 Multilingual Dialogue Systems Based on Web Applications
4.3.1 Requirements, for Practical Multilingual Dialogue Systems
4.3.2 Dialogue Systems Based on Web Applications
4.3,3 Multilingual Dialogue Systems Based on the MVC Framework
4.3.4 Implementation of Multilingual Voice Portals
4.4 Summary
4.5 Further Reading
5 Dialogue Annotation, Modelling and Management
5.1 Dialogue Annotation
5.1.1 Annotation of Spoken Dialogue Corpora
5.1.2 Annotation of Multimodal Dialogue Corpora
5.2 Dialogue Modelling
5.2.1 State-Transition Networks
5.2.2 Plans
5.3 Dialogue Management
5.3.1 Interaction Strategies
5.3.2 Confirmation Strategies
5.4 Implications of Multimodality in the Dialogue Management
5.4.1 Interaction Complexity
5.4.2 Confirmations
5.4.3 Social and Emotional Dialogue
5.4.4 Contextual Information
5.4.5 User References
5.4.6 Response Generation
6 Kevelopment Tools
7 Assessment
Appendix A Basic Tutorial on VoiceXML
Appendix B Multimodal Databases
Appendix C Coding Schemes for Multimodal Resources
Appendix D URLs of Interest
Appendix E List of Abbreviations
References
Index