MISP Challenge 2021
MISP Challenge 2021 has been accepted as a Signal Processing Grand Challenge (SPGC) of ICASSP 2022！Please refer to https://2022.ieeeicassp.org/call_for_grandchallenges.php for more details of ICASSP 2022 SPGC. There are four challenge papers were accepted by ICASSP 2022, for more detail, please refer to https://2022.ieeeicassp.org/view_paper.php?PaperNum=9350.
The challenge considers the problem of audio-visual distant multi-microphone conversational wake-up and speech recognition in everyday home environments. Both audio and video data are collected in a home TV scenario, where several people are chatting while watching TV in the living room, and they can interact with a smart speaker/TV.
Challenge introduction paper: The First Multimodal Information Based Speech Processing (MISP) Challenge: Data, Tasks, Baselines and Results Please cite the following paper: @INPROCEEDINGS{chen2022misp, author={Chen, Hang and Zhou, Hengshun and Du, Jun and Lee, Chin-Hui and Chen, Jingdong and Watanabe, Shinji and Siniscalchi, Sabato Marco and Scharenborg, Odette and Liu, Di-Yuan and Yin, Bao-Cai and Pan, Jia and Gao, Jian-Qing and Liu, Cong}, booktitle={Proc. ICASSP 2022}, title={The First Multimodal Information Based Speech Processing (MISP) Challenge: Data, Tasks, Baselines and Results}, year={2022}}
Data release papers: Task1: Audio-Visual Wake Word Spotting in MISP2021 Challenge: Dataset Release and Deep Analysis Please cite the following paper: @INPROCEEDINGS{2022misptask1, author={Zhou, Hengshun and Du, Jun and Zou, Gongzhen and Nian, Zhaoxu and Lee, Chin-Hui and Siniscalchi, Sabato Marco and Watanabe, Shinji and Scharenborg, Odette and Chen, Jingdong and Xiong, Shifu and Gao, Jian-Qing}, booktitle={Proc. INTERSPEECH 2022}, title={Audio-Visual Wake Word Spotting in MISP2021 Challenge: Dataset Release and Deep Analysis}, year={2022}} Task2: Audio-Visual Speech Recognition in MISP2021 Challenge: Dataset Release and Deep Analysi Please cite the following paper: @INPROCEEDINGS{2022misptask2, author={Chen, Hang and Du, Jun and Dai, Yusheng and Lee, Chin-Hui and Siniscalchi, Sabato Marco and Watanabe, Shinji and Scharenborg, Odette and Chen, Jingdong and Yin, Bao-Cai and Pan, jia}, booktitle={Proc. INTERSPEECH 2022}, title={Audio-Visual Speech Recognition in MISP2021 Challenge: Dataset Release and Deep Analysis}, year={2022}}
Introduction
MISP Challenge 2021 features two tasks:
- Audio-Visual Wake Word Spotting
- Audio-Visual Speech Recognition with Oracle Speaker Diarization
Participants are able to submit to either one track or both.
On this web site you will find everything you need to get started, including,
- A task overview providing details of the motivation and recording set up
- For both Task 1 and Task 2
- A description of the training, development and evaluation datasets
- Baseline recognition and evaluation tools
- A detailed description of the challenge rules
- Instructions on how to submit your results
- A download center with links to all tools and data packages.
Planned Schedule(AOE Time)
- October 20th, 2021 : Registration opens
- October 25th, 2021 : Training and development set release
- November 8th, 2021 : Baseline system releases
- December 1st, 2021 : Leaderboard update for development set
- January 1st, 2022 : Evaluation set release and leaderboard update for evaluation set
- January 23th, 2022 : Leaderboard freeze for evaluation set
- January 31th, 2022 : ICASSP 2022 SPGC paper submission
- February 10th, 2022 : ICASSP 2022 SPGC paper acceptance
- February 17rd, 2022 : ICASSP 2022 SPGC camera-ready papers due and challenge report submission
- May 22th - May 27th, 2022 : ICASSP 2022 SPGC session
Organizers
Contact Us
For additional information, please email us at mispchallenge@gmail.com.
Also, welcome to join our Google group .