RESEARCH

Acoustic & Speech

Investigates various Speech signal processing schemes for acoustic modeling so that more robust speech recognition can be achieved. Our aim is to perform the state-of-art research providing effective means for achieving:

Multimodal Automatic Speech Recognition

작성자 관리자 날짜 2021-04-08 21:20:36 조회수 61

Multimodal Automatic Speech Recognition

     Contents

1. Goal

2. Schematic Diagram

3. Lip-reading Process

4. Application Demos

 

1. Goal         

  • Augment automatic speech recognition system by providing visual (lip-reading) information in noisy environment

2. Schemetic Diagram        

  • Merge audio/visual features

     

      

  • Lip detection : Binary image in YCbCr space
  • Lip movement tracking : Active shape modeling

3. Lip-reading Process         

  

4. Application Demos         

 

 

 

댓글 (0)

등록된 댓글이 없습니다.
작성 권한이 없습니다.