CoVoST 2 English - German

Description

This dataset contains 320495 audio clips totalling 436:04:23 of audio in English with the corresponding translations in German.

Background

End-to-end speech-to-text translation (ST) has recently witnessed an increased interest given its system simplicity, lower inference latency and less compounding errors compared to cascaded ST (i.e. speech recognition + machine translation). End-to-end ST model training, however, is often hampered by the lack of parallel data. Thus, we created CoVoST, a large-scale multilingual ST corpus based on Common Voice, to foster ST research with the largest ever open dataset. Its latest version covers translations from English into 15 languages---Arabic, Catalan, Welsh, German, Estonian, Persian, Indonesian, Japanese, Latvian, Mongolian, Slovenian, Swedish, Tamil, Turkish, Chinese---and from 21 languages into English, including the 15 target languages as well as Spanish, French, Italian, Dutch, Portuguese, Russian. It has total 2,880 hours of speech and is diversified with 78K speakers.

Fields

• path: Filename of the audio file

• sentence: The sentence in the source language

• translation: The sentence in the target language

• client_id: The ID of the speaker of the source language, used for maintaining hygiene in the splits.

Example

['path\tsentence\ttranslation\tclient_id\n', 'common_voice_en_19664034.mp3\t"These data components in turn serve as the ""building blocks"" of data exchanges."\tDiese Datenkomponenten wiederum dienen als die „Grundbausteine“ zum Datenaustausch.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664035.mp3\tThe church is unrelated to the Jewish political movement of Zionism.\tDie Kirche ist nicht mit der jüdischen politischen Bewegung des Zionismus verbunden.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664037.mp3\tThe following represents architectures which have been utilized at one point or another.\tDie folgenden Architekturen sind stellvertretend für solche, die zum ein oder anderen Punkt verwendet wurden.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664038.mp3\tAdditionally, the pulse output can be directed through one of three resonator banks.\tAußerdem kann die Impulsausgabe durch eine von drei Resonatorbänken gesteuert werden.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n']

Splits

Citation

If you use this dataset in your work please cite

@misc{wang2020covost,
    title={CoVoST 2: A Massively Multilingual Speech-to-Text Translation Corpus},
    author={Changhan Wang and Anne Wu and Juan Pino},
    year={2020},
    eprint={2007.10310},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}