CoVoST 2 English - Chinese (China)

Description

This dataset contains 320495 audio clips totalling 436:04:23 of audio in English with the corresponding translations in Chinese (China).

Background

End-to-end speech-to-text translation (ST) has recently witnessed an increased interest given its system simplicity, lower inference latency and less compounding errors compared to cascaded ST (i.e. speech recognition + machine translation). End-to-end ST model training, however, is often hampered by the lack of parallel data. Thus, we created CoVoST, a large-scale multilingual ST corpus based on Common Voice, to foster ST research with the largest ever open dataset. Its latest version covers translations from English into 15 languages---Arabic, Catalan, Welsh, German, Estonian, Persian, Indonesian, Japanese, Latvian, Mongolian, Slovenian, Swedish, Tamil, Turkish, Chinese---and from 21 languages into English, including the 15 target languages as well as Spanish, French, Italian, Dutch, Portuguese, Russian. It has total 2,880 hours of speech and is diversified with 78K speakers.

Fields

• path: Filename of the audio file

• sentence: The sentence in the source language

• translation: The sentence in the target language

• client_id: The ID of the speaker of the source language, used for maintaining hygiene in the splits.

Example

['path\tsentence\ttranslation\tclient_id\n', 'common_voice_en_19664034.mp3\t"These data components in turn serve as the ""building blocks"" of data exchanges."\t这些数据组件又充当数据交换的“构建块”。\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664035.mp3\tThe church is unrelated to the Jewish political movement of Zionism.\t教会与犹太复国主义的犹太政治运动无关。\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664037.mp3\tThe following represents architectures which have been utilized at one point or another.\t以下表示某些时候所使用的体系结构。\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664038.mp3\tAdditionally, the pulse output can be directed through one of three resonator banks.\t另外，脉冲输出可以通过三个谐振器组中的一个来引导。\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n']

Splits

Citation

If you use this dataset in your work please cite

@misc{wang2020covost,
    title={CoVoST 2: A Massively Multilingual Speech-to-Text Translation Corpus},
    author={Changhan Wang and Anne Wu and Juan Pino},
    year={2020},
    eprint={2007.10310},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}