We are hosting a new competition in 2022, for more details, please refer to mispchallenge 2022
MISP Challenge 2021 has been accepted as a Signal Processing Grand Challenge (SPGC) of ICASSP 2022!Please refer to https://2022.ieeeicassp.org/call_for_grandchallenges.php for more details of ICASSP 2022 SPGC. There are four challenge papers were accepted by ICASSP 2022, for more detail, please refer to https://2022.ieeeicassp.org/view_paper.php?PaperNum=9350.
The challenge considers the problem of audio-visual distant multi-microphone conversational wake-up and speech recognition in everyday home environments. Both audio and video data are collected in a home TV scenario, where several people are chatting while watching TV in the living room, and they can interact with a smart speaker/TV.
Challenge introduction paper: The First Multimodal Information Based Speech Processing (MISP) Challenge: Data, Tasks, Baselines and Results Please cite the following paper: @INPROCEEDINGS{chen2022misp, author={Chen, Hang and Zhou, Hengshun and Du, Jun and Lee, Chin-Hui and Chen, Jingdong and Watanabe, Shinji and Siniscalchi, Sabato Marco and Scharenborg, Odette and Liu, Di-Yuan and Yin, Bao-Cai and Pan, Jia and Gao, Jian-Qing and Liu, Cong}, booktitle={Proc. ICASSP 2022}, title={The First Multimodal Information Based Speech Processing (MISP) Challenge: Data, Tasks, Baselines and Results}, year={2022}}
Data release papers: Task1: Audio-Visual Wake Word Spotting in MISP2021 Challenge: Dataset Release and Deep Analysis Please cite the following paper: @INPROCEEDINGS{2022misptask1, author={Zhou, Hengshun and Du, Jun and Zou, Gongzhen and Nian, Zhaoxu and Lee, Chin-Hui and Siniscalchi, Sabato Marco and Watanabe, Shinji and Scharenborg, Odette and Chen, Jingdong and Xiong, Shifu and Gao, Jian-Qing}, booktitle={Proc. INTERSPEECH 2022}, title={Audio-Visual Wake Word Spotting in MISP2021 Challenge: Dataset Release and Deep Analysis}, year={2022}} Task2: Audio-Visual Speech Recognition in MISP2021 Challenge: Dataset Release and Deep Analysi Please cite the following paper: @INPROCEEDINGS{2022misptask2, author={Chen, Hang and Du, Jun and Dai, Yusheng and Lee, Chin-Hui and Siniscalchi, Sabato Marco and Watanabe, Shinji and Scharenborg, Odette and Chen, Jingdong and Yin, Bao-Cai and Pan, jia}, booktitle={Proc. INTERSPEECH 2022}, title={Audio-Visual Speech Recognition in MISP2021 Challenge: Dataset Release and Deep Analysis}, year={2022}}
MISP Challenge 2021 features two tasks:
Participants are able to submit to either one track or both.
On this web site you will find everything you need to get started, including,
For additional information, please email us at mispchallenge@gmail.com.
Also, welcome to join our Google group .