Datasets | Mozilla Data Collective

Multimodal dataset for Batanga : lexical datasheet, audio recordings, and an audio alignment file for Banoho. Bapuku, forthcoming.

Batanga-ALCAM-MultimodalDataset

License: NOODL-1.0

Locale: bnm

Task: NLP

Format: MP3, TSV

Size: 18.70 MB

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part2

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Somali language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 8.07 GB

Audio Speech Language Processing lab(ASLP NPU)

UrduSpeech

A 156-hour, multi-domain speech corpus with 12 paralinguistic labels for standard Urdu, code-switched Urdu-English, and Pakistani-accented English.

License: CC-BY-NC-4.0

Locale: ur, en

Task: NLP

Format: .wav, .jsonl

Size: 71.87 GB

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part3

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Somali language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 1.33 GB

Weekly dataset digest

Receive a brief weekly digest of new datasets similar to the ones you’ve downloaded.

Yes, notify me

Pashto AI

Pashto Audio-Visual Speech Corpus

Pashto audio-visual corpus with 9,421 recordings (12.67 hours), pairing speech, mouth-region video and text for lip reading, ASR and multimodal AI.

License: CC0-1.0

Locale: ps

Task: ASR

Format: WEBM, TSV, JSON, JSONL, MD, TXT

Size: 1.33 GB

This dataset consists of segmented Hausa speech audio clips paired with text, totalling 5h 25m and 38s.

Hausa-TTS-Dataset

License: NOODL-1.0

Locale: hau

Task: TTS

Format: MP3, TSV

Size: 276.90 MB

MDC DatasetsCompensated

🚧 Khowar-English Parallel Corpus 🚧

A parallel corpus of over 10,000 sentences of Khowar and English. The sentences are derived from a multimodal corpus consisting of 152 transcribed and translated Khowar language videos.

License: MDC-DLA-1.0

Locale: khw, en

Task: MT

Format: TSV

Size: 407.57 KB

Community

JAV-Culture: Gresik–Surabaya Multimodal Corpus

A corpus of annotated photographs of cultural objects described in the Gresik dialect of Javanese language.

License: CC-BY-NC-SA-4.0

Locale: jav

Task: CV

Format: JPEG, WEBM, JSON

Size: 713.73 MB

A collection of read speech recordings in Azerbaijani.

Common Voice Scripted Speech 27.0 - Azerbaijani

License: CC0-1.0

Locale: az

Task: ASR

Format: MP3

Size: 37.48 MB

A collection of read speech recordings in Kurmanji Kurdish.

Common Voice Scripted Speech 27.0 - Kurmanji Kurdish

License: CC0-1.0

Locale: kmr

Task: ASR

Format: MP3

Size: 1.99 GB

The dataset includes audio files in Persian and their translations in English.

CoVoST 2 Persian - English

License: CC-BY-NC-4.0

Locale: fa, en

Task: MT

Format: MP3, TSV

Size: 1.52 GB

Multimodal dataset for ɣɔmáláʔ (Ghomala, Bandjoun variety): IPA-annotated ritual corpus, 369 audio clips (≈17 min), and a Ghomala–French parallel corpus.

Ghomala-MultimodalDataset

License: NOODL-1.0

Locale: bbj

Task: NLP

Format: TSV, MP3

Size: 18.67 MB

Taruen

Chuvash TTS

A ~5-hour speech dataset for Chuvash Text-to-Speech (TTS) research, featuring a single female speaker reading news and digits at a rapid tempo.

License: CC-BY-SA-4.0

Locale: cv

Task: TTS

Format: PARQUET

Size: 854.02 MB

The dataset includes audio files in English and their translations in Persian.

CoVoST 2 English - Persian

License: CC-BY-NC-4.0

Locale: en, fa

Task: MT

Format: MP3, TSV

Size: 12.56 GB

A collection of read speech recordings in Zaza.

Common Voice Scripted Speech 27.0 - Zaza

License: CC0-1.0

Locale: zza

Task: ASR

Format: MP3

Size: 54.88 MB

Tupuri (tui) scripted speech: 2,085 clips (≈2h46min) from different speakers across two dialect subsets — Bango and Banwere.

Tupuri-ASR-Dataset

License: NOODL-1.0

Locale: tui

Task: ASR

Format: MP3,, TSV

Size: 97.82 MB

The dataset includes audio files in Turkish and their translations in English.

CoVoST 2 Turkish - English

License: CC-BY-NC-4.0

Locale: tr, en

Task: MT

Format: MP3, TSV

Size: 207.40 MB

The dataset includes audio files in English and their translations in Turkish.

CoVoST 2 English - Turkish

License: CC-BY-NC-4.0

Locale: en, tr

Task: MT

Format: MP3, TSV

Size: 12.56 GB

Kaleem Art Press

Saraiki-English Parallel Corpus

English–Saraiki parallel corpus: 51,447 aligned sentence pairs (~0.89M words), translated by Kaleem Art Press for MT and Saraiki NLP research.

License: CC-BY-NC-4.0

Locale: mul

Task: MT

Format: CSV

Size: 1.92 MB

MDC DatasetsCompensated

🚧 Moroccan Arabic ASR dataset (180h) 🚧

180 hours of fully segmented and transcribed Moroccan Arabic speech.

License: MDC-DLA-1.0

Locale: ary

Task: ASR

Format: MP3, TSV

Size: 214 B

A collection of read speech recordings in Uyghur.

Common Voice Scripted Speech 27.0 - Uyghur

License: CC0-1.0

Locale: ug

Task: ASR

Format: MP3

Size: 9.70 GB