Datasets | Mozilla Data Collective

Content X LabsCompensated

🚧 English Scripted Narrative // Rights-Cleared · 50 Hours 🚧

50 hours of premium, rights-cleared English-language scripted film content, with English subtitles and accompanying metadata, available for AI training

License: CXL-DLA-1.0

Locale: EN

Task: N/A

Format: MP4, SRT, CSV

Size: 79.13 GB

Habib University

Burushaski-English Speech Translation Corpus

A linguistically informed Burushaski speech - English text corpus containing 14,970 short audio recordings paired with corresponding English text translations.

License: CC-BY-NC-SA-4.0

Locale: bsk

Task: MT

Format: WAV, TXT

Size: 921.47 MB

Content X LabsCompensated

🚧 English Documentary // Rights-Cleared · 100 Hours 🚧

100 hours of rights-cleared English-language documentary content, with English subtitles and a structured metadata sheet

License: CXL-DLA-1.0

Locale: EN

Task: N/A

Format: MP4, SRT, CSV

Size: 639.71 GB

Content X LabsCompensated

🚧 English Scripted Narrative // Rights-Cleared · 20 Hours 🚧

20 hours of premium, rights-cleared English-language scripted film content, with English subtitles and accompanying metadata, available for AI training

License: CXL-DLA-1.0

Locale: EN

Task: N/A

Format: MP4, SRT, CSV

Size: 102.15 GB

Content X LabsCompensated

🚧 English Scripted Narrative // Rights-Cleared · 100 Hours 🚧

100 hours of premium, rights-cleared English-language scripted film content, with English subtitles and accompanying metadata, available for AI training

License: CXL-DLA-1.0

Locale: EN

Task: N/A

Format: MP4, SRT, CSV

Size: 533.73 GB

Habib University

Burushaski-English Speech Translation Corpus

A linguistically informed Burushaski speech - English text corpus containing 14,970 short audio recordings paired with corresponding English text translations.

License: CC-BY-NC-SA-4.0

Locale: bsk

Task: MT

Format: WAV, TXT

Size: 921.47 MB

Content X LabsCompensated

🚧English Animation // Rights-Cleared · 50 Hours 🚧

50 hours of rights-cleared English-language animation content, with English subtitles and a full metadata sheet included

License: CXL-DLA-1.0

Locale: EN

Task: N/A

Format: MP4, SRT, CSV

Size: 331.43 GB

MDC DatasetsCompensated

🚧 Hazargi-English Parallel Text Corpus 🚧

A Hazargi-English parallel corpus derived from transcribed and translated video recordings

License: MDC DLA-1.0

Locale: haz, en

Task: MT

Format: TSV

Size: 434.04 KB

MirasAICompensated

English 10 Hours Medical Speech Evaluation Dataset (Synthetic)

A 10-hour English medical speech dataset designed for evaluating and improving speech recognition systems in healthcare-related scenarios.

License: MirasAI Data License

Locale: eng

Task: TTS

Format: PARQUET, CSV, JSON, SQL, MD

Size: 922.38 MB

Kaleem Art Press

Saraiki-English Parallel Corpus

English–Saraiki parallel corpus: 51,447 aligned sentence pairs (~0.89M words), translated by Kaleem Art Press for MT and Saraiki NLP research.

License: CC-BY-NC-4.0

Locale: mul

Task: MT

Format: CSV

Size: 1.92 MB

Community

Sindhi to English Parallel Corpus

A Sindhi–English parallel corpus in JSONL format, designed for machine translation and cross-lingual NLP tasks across diverse real-world domains.

License: CC-BY-NC-4.0

Locale: snd, eng

Task: MT

Format: JSONL

Size: 2.50 MB

MDC Curators

Common Voice Scripted Speech 26.0 - Irish English

A closed-form Irish-English-accent subset of Mozilla Common Voice Scripted Speech 26.0 (validated, Northern Irish English excluded). MP3 audio + TSV metadata.

License: CC0-1.0

Locale: en-IE

Task: ASR

Format: TSV, MP3

Size: 330.28 MB

MirasAI

Associated Press Pakistan 78.1 Million English Corpus

The Associated Press of Pakistan 78.1 Million English Corpus is a large-scale English text released for non-commercial research with APP's permission.

License: CC-BY-NC-SA-4.0

Locale: eng

Task: NLP

Format: TXT

Size: 178.01 MB

CLEAR Global

TWB Parallel Sentence kits - Kanuri (5k)

5,000 English–Kanuri parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: kau

Task: MT

Format: TSV

Size: 358.46 KB

Community

Indonesian-Learner-English

A corpus of English read speech by Indonesian learners.

License: CC-BY-NC-SA-4.0

Locale: en

Task: CALL

Format: WAV, WEBM, TSV

Size: 1.12 GB

MirasAICompensated

English Medical Speech Dataset (Synthetic)

English medical speech dataset of 11,563 audio-text pairs covering clinical terminology and medical education content.

License: MirasAI Data License

Locale: eng

Task: ASR

Format: PARQUET

Size: 5.69 GB

MDC Curators

Common Voice Scripted Speech 26.0 - American English (Female)

A closed-form United-States-English-accent, female-gender subset of Mozilla Common Voice Scripted Speech 26.0 (English, validated). MP3 audio + TSV metadata.

License: CC0-1.0

Locale: en-US

Task: ASR

Format: TSV, MP3

Size: 4.00 GB

CLEAR Global

TWB Parallel Sentence kits - Rohingya (5k)

5,000 English–Rohingya parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: rhg

Task: MT

Format: TSV

Size: 358.88 KB

CLEAR Global

TWB Parallel Sentence kits - Swahili (5k)

5,000 English–Swahili parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: swa

Task: MT

Format: TSV

Size: 347.61 KB

LocaleNLP

English Hausa Parallel Corpus

An English–Hausa dataset with 5,000 sentence pairs useful for machine translation and basic language processing tasks.

License: CC-BY-NC-4.0

Locale: eng, hau

Task: MT

Format: csv

Size: 164.32 KB

Community

Heroes English-Spanish Dubbed Movie Speech Corpus

7000 single speaker speech segments from the original and Spanish dubbed version of 21 episodes of TV series Heroes

License: CC-BY-SA-4.0

Locale: eng, spa

Task: NLP

Format: wav, csv, txt

Size: 1.68 GB

CLEAR Global

TWB Parallel Sentence kits - Tigrinya (5k)

5,000 English–Tigrinya parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: tig

Task: MT

Format: TSV

Size: 404.75 KB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - English

A collection of spontaneous responses to questions in English.

License: CC0-1.0

Locale: en

Task: ASR

Format: MP3

Size: 519.05 MB

Rohingya Language

Rohingya Hanifi–Rohingyalish–English Lexicon

15,926 English–Rohingya lexical pairs in Rohingyalish and generated Hanifi script for transliteration, education, and NLP research.

License: CC-BY-4.0

Locale: rhg, en

Task: NLP

Format: JSONL, CSV, MD

Size: 333.79 KB

All Datasets

🚧 English Scripted Narrative // Rights-Cleared · 50 Hours 🚧

Burushaski-English Speech Translation Corpus

🚧 English Documentary // Rights-Cleared · 100 Hours 🚧

🚧 English Scripted Narrative // Rights-Cleared · 20 Hours 🚧

🚧 English Scripted Narrative // Rights-Cleared · 100 Hours 🚧

Burushaski-English Speech Translation Corpus

Weekly dataset digest

🚧English Animation // Rights-Cleared · 50 Hours 🚧

🚧 Hazargi-English Parallel Text Corpus 🚧

English 10 Hours Medical Speech Evaluation Dataset (Synthetic)

Saraiki-English Parallel Corpus

Sindhi to English Parallel Corpus

Common Voice Scripted Speech 26.0 - Irish English

Associated Press Pakistan 78.1 Million English Corpus

TWB Parallel Sentence kits - Kanuri (5k)

Indonesian-Learner-English

English Medical Speech Dataset (Synthetic)

Common Voice Scripted Speech 26.0 - American English (Female)

TWB Parallel Sentence kits - Rohingya (5k)

TWB Parallel Sentence kits - Swahili (5k)

English Hausa Parallel Corpus

Heroes English-Spanish Dubbed Movie Speech Corpus

TWB Parallel Sentence kits - Tigrinya (5k)

Common Voice Spontaneous Speech 5.0 - English

Rohingya Hanifi–Rohingyalish–English Lexicon