Advertisement

Cognitively Inspired Audiovisual Speech Filtering

Towards an Intelligent, Fuzzy Based, Multimodal, Two-Stage Speech Enhancement System

  • Andrew Abel
  • Amir Hussain

Part of the SpringerBriefs in Cognitive Computation book series (BRIEFSCC, volume 5)

Table of contents

  1. Front Matter
    Pages i-xviii
  2. Andrew Abel, Amir Hussain
    Pages 1-4
  3. Andrew Abel, Amir Hussain
    Pages 5-12
  4. Andrew Abel, Amir Hussain
    Pages 13-34
  5. Andrew Abel, Amir Hussain
    Pages 35-51
  6. Andrew Abel, Amir Hussain
    Pages 53-73
  7. Andrew Abel, Amir Hussain
    Pages 75-90
  8. Andrew Abel, Amir Hussain
    Pages 91-110
  9. Andrew Abel, Amir Hussain
    Pages 111-114
  10. Back Matter
    Pages 115-121

About this book

Introduction

This book presents a summary of the cognitively inspired basis behind multimodal speech enhancement, covering the relationship between audio and visual modalities in speech, as well as recent research into audiovisual speech correlation. A number of audiovisual speech filtering approaches that make use of this relationship are also discussed. A novel multimodal speech enhancement system, making use of both visual and audio information to filter speech, is presented, and this book explores the extension of this system with the use of fuzzy logic to demonstrate an initial implementation of an autonomous, adaptive, and context aware multimodal system. This work also discusses the challenges presented with regard to testing such a system, the limitations with many current audiovisual speech corpora, and discusses a suitable approach towards development of a corpus designed to test this novel, cognitively inspired, speech filtering system.                                                                                

Keywords

Audiovisual Fuzzy Logic Hearing and listening devices Multimodal processing Speech filtering

Authors and affiliations

  • Andrew Abel
    • 1
  • Amir Hussain
    • 2
  1. 1.Computing Science and MathematicsUniversity of StirlingStirlingEU
  2. 2.Computing Science and MathematicsUniversity of StirlingStirlingEU

Bibliographic information

  • DOI https://doi.org/10.1007/978-3-319-13509-0
  • Copyright Information The Author(s) 2015
  • Publisher Name Springer, Cham
  • eBook Packages Biomedical and Life Sciences
  • Print ISBN 978-3-319-13508-3
  • Online ISBN 978-3-319-13509-0
  • Series Print ISSN 2212-6023
  • Series Online ISSN 2212-6031
  • Buy this book on publisher's site