Task 2 Leaderboard
| Rank | Team | cpCER(%) | Technical Report |
|---|---|---|---|
| 1 | NIO | 29.58 | [paper] |
| 2 | Chongqing Jiaotong University | 30.01 | [paper] |
| 3 | Northwestern Polytechnical University | 31.21 | [paper] |
| 4 | Xiamen University | 31.88 | [paper] |
| 5 | Duke Kunshan University | 38.44 | / |
| 6 | Toshiba China Ltd | 41.70 | / |
| 7 | China FAW Group | 63.41 | / |
| 8 | Baseline | 63.94 | / |
Submission
Note:
Now Evaluation Set Phase: 2023.01.15 — 2023.02.05 (AOE)
1.Due to the
limits of codalab, you have to participate in a new competition on codalab
for the evaluation phase leaderboard.
2.Follow the steps mentioned below, make sure to use the same e-mail address on misp2022 to register on codalab, and then send applications to participate.
3.Follow the steps mentioned below, set your teamname on codalab，and make sure it's the same as the one that you use to register in the misp2022.
- STEP 1: Register on codalab
Note: make sure to use the same e-mail address and teamname in the misp2022 and codalab, or you may not be allowed to submit the results in the competition. If you'd like to change e-mail address, please contact with organizers.
- STEP 2: Apply to join the competition and wait for the approval. Here are Evaluation Phase Leaderboard Entrance (the final Leaderboard )
Tips: just check the box ( you don't need to download the term as you have signed it when you register on misp2022 competition ), and we'll permit access that night.
- STEP 3: Submit your result and check the scores
Make sure your submitted zip file as following directory structure:
|summission.zip
||--R10_S186187188_C11_I1.txt
||--*.txt
Make sure that all text files named after session are included in the submitted zip package.
Make sure each row of the transcript in the following format, which is a key-word separated by a space character:
segment_id 文字文字文字 （only Chinese characters included in the text part without any punctuation）
the segment id is named as follows:
< Speakers ID >_< Room ID >_< Speakers IDs >_< Configuration ID >_>< Index >
Here are the submission example and the whole segment_id list for the evaluation set. Notice: you can use your own Speakers ID to replace our global Speakers ID.
When the "Status" in the submission table turns to "Finished", you can refresh the page the check the score below. You can also click the button named “View scoring output log” to check if you miss any segments in your submission, for example:
cpCER: 71.11
- Other information
Make sure a. your submitted zip package, includes all sessions in the evaluation set. b. your submission files are in required format, or the submission will fail.
For each submitted score, it will be directly on the leader board if it's your best score so far.
During the evaluation set phase, every group is allowed to 5 times per day.
If you meet any problems during submission, please contact with misp2022_task2 administrators by e-mail at mispchallenge@gmail.com.