CoVoST 2 English - Estonian

Description

This dataset contains 320495 audio clips totalling 436:04:23 of audio in English with the corresponding translations in Estonian.

Background

End-to-end speech-to-text translation (ST) has recently witnessed an increased interest given its system simplicity, lower inference latency and less compounding errors compared to cascaded ST (i.e. speech recognition + machine translation). End-to-end ST model training, however, is often hampered by the lack of parallel data. Thus, we created CoVoST, a large-scale multilingual ST corpus based on Common Voice, to foster ST research with the largest ever open dataset. Its latest version covers translations from English into 15 languages---Arabic, Catalan, Welsh, German, Estonian, Persian, Indonesian, Japanese, Latvian, Mongolian, Slovenian, Swedish, Tamil, Turkish, Chinese---and from 21 languages into English, including the 15 target languages as well as Spanish, French, Italian, Dutch, Portuguese, Russian. It has total 2,880 hours of speech and is diversified with 78K speakers.

Fields

• path: Filename of the audio file

• sentence: The sentence in the source language

• translation: The sentence in the target language

• client_id: The ID of the speaker of the source language, used for maintaining hygiene in the splits.

Example

['path\tsentence\ttranslation\tclient_id\n', 'common_voice_en_19664034.mp3\t"These data components in turn serve as the ""building blocks"" of data exchanges."\tNeed andmekomponendid on omakorda andmevahetuse „ehitusplokkideks“.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664035.mp3\tThe church is unrelated to the Jewish political movement of Zionism.\tKirik ei ole seotud juutide poliitilise liikumise sionismiga.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664037.mp3\tThe following represents architectures which have been utilized at one point or another.\tJärgnev esindab arhitektuure, mis on ühel või teisel hetkel ära kasutatud.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664038.mp3\tAdditionally, the pulse output can be directed through one of three resonator banks.\tLisaks saab impulsi väljundi suunata läbi ühe kolmest resonaatoripangast.\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n']

Splits

Citation

If you use this dataset in your work please cite

@misc{wang2020covost,
    title={CoVoST 2: A Massively Multilingual Speech-to-Text Translation Corpus},
    author={Changhan Wang and Anne Wu and Juan Pino},
    year={2020},
    eprint={2007.10310},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}