CoVoST 2 English - Indonesian

Description

This dataset contains 320495 audio clips totalling 436:04:23 of audio in English with the corresponding translations in Indonesian.

Background

End-to-end speech-to-text translation (ST) has recently witnessed an increased interest given its system simplicity, lower inference latency and less compounding errors compared to cascaded ST (i.e. speech recognition + machine translation). End-to-end ST model training, however, is often hampered by the lack of parallel data. Thus, we created CoVoST, a large-scale multilingual ST corpus based on Common Voice, to foster ST research with the largest ever open dataset. Its latest version covers translations from English into 15 languages---Arabic, Catalan, Welsh, German, Estonian, Persian, Indonesian, Japanese, Latvian, Mongolian, Slovenian, Swedish, Tamil, Turkish, Chinese---and from 21 languages into English, including the 15 target languages as well as Spanish, French, Italian, Dutch, Portuguese, Russian. It has total 2,880 hours of speech and is diversified with 78K speakers.

Fields

• path: Filename of the audio file

• sentence: The sentence in the source language

• translation: The sentence in the target language

• client_id: The ID of the speaker of the source language, used for maintaining hygiene in the splits.

Example

['path\tsentence\ttranslation\tclient_id\n', 'common_voice_en_19664034.mp3\t"These data components in turn serve as the ""building blocks"" of data exchanges."\tKomponen data ini berfungsi sebagai "blok bangunan" dari pertukaran data.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664035.mp3\tThe church is unrelated to the Jewish political movement of Zionism.\tGereja tidak berhubungan dengan gerakan politik Yahudi Zionisme.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664037.mp3\tThe following represents architectures which have been utilized at one point or another.\tBerikut ini merupakan arsitektur yang telah digunakan pada satu titik atau yang lain.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664038.mp3\tAdditionally, the pulse output can be directed through one of three resonator banks.\tSelain itu, output pulsa dapat diarahkan melalui salah satu dari tiga bank resonator.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n']

Splits

Citation

If you use this dataset in your work please cite

@misc{wang2020covost,
    title={CoVoST 2: A Massively Multilingual Speech-to-Text Translation Corpus},
    author={Changhan Wang and Anne Wu and Juan Pino},
    year={2020},
    eprint={2007.10310},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}