Datasets | Mozilla Data Collective

Keblagh e Azergi

Elkhani Hazargi Literature Corpus

Hazargi literary corpus (~0.5M tokens) of poetry, folklore, and prose texts representing Hazara linguistic and cultural heritage.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 2.46 MB

MDC DatasetsCompensated

🚧 Hazargi Corpus for Speech Recognition 🚧

A Hazargi ASR dataset with approximately 10 hours of audio with transcriptions.

License: MDC DLA-1.0

Locale: haz

Task: ASR

Format: MP3, TSV

Size: 511.56 MB

Keblagh e Azergi

Keblagh-e-Azergi Hazargi literature corpus

This corpus is a collection of more than one hundred thousand tokens of Hazargi language. The corpus contains work of literature, poems, folk and short stories and dramas. The data is being shared with the approval of the authors. It claims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 193.28 KB

MDC DatasetsCompensated

🚧 Hazargi Multimodal Dataset 🚧

A Hazargi multimodal dataset with 10 hours of synchronized video, audio, transcriptions, speech segmentation, and ELAN annotations.

License: MDC DLA-1.0

Locale: haz

Task: NLP

Format: MP4, EAF

Size: 44.00 GB

MDC DatasetsCompensated

🚧 Hazargi-English Parallel Text Corpus 🚧

A Hazargi-English parallel corpus derived from transcribed and translated video recordings

License: MDC DLA-1.0

Locale: haz, en

Task: MT

Format: TSV

Size: 434.04 KB

MDC DatasetsCompensated

🚧 Hazargi-English Speech Translation Corpus 🚧

A Hazargi speech translation dataset with approximately 10 hours of Hazargi audio with English text translations.

License: MDC DLA-1.0

Locale: haz, en

Task: MT

Format: MP3, TSV

Size: 511.58 MB

The University of Melbourne

Hawrami Kurdish TTS dataset 1.0

This dataset contains high-quality single-speaker audio recordings in Hawrami Kurdish (Hewrami, ISO 639-3:hac), also known as the Gorani language, intended for building Text-to-Speech (TTS) and Automatic Speech recognition (ASR) systems. The dataset comprises 5 hours and 15 minutes of aligned audio and text data. Hawrami is classified as Definitely Endangered by UNESCO.

License: CC-BY-4.0

Locale: hac

Task: TTS

Format: WAV

Size: 706.11 MB

Common Voice

Common Voice Scripted Speech 26.0 - Hazargi

A collection of read speech recordings in Hazargi.

License: CC0-1.0

Locale: haz

Task: ASR

Format: MP3

Size: 175.19 MB

RFE/RL

RFE/RL Tatar-Bashkir News Text Corpus

This dataset is longitudinal news corpus for the Tatar and Bashkir languages, sourced from Azatliq Radiosi, from 2001 to 2025, it contains over 105,000 articles (30M tokens).

License: CC-BY-NC-SA-4.0

Locale: tt,ba,ru

Task: NLP

Format: TXT

Size: 102.44 MB

Institute of African Digital Humanities

Hausa-TTS-Dataset

This dataset consists of segmented Hausa speech audio clips paired with text, totalling 5h 25m and 38s.

License: NOODL-1.0

Locale: hau

Task: TTS

Format: MP3, TSV

Size: 276.90 MB

Community

Awal Tamazight Dataset

A compilation of monolingual and parallel Tamazight language datasets created by CIEMEN as part of the Awal community language technology project.

License: CC-BY-4.0

Locale: zgh

Task: LM

Format: TSV, JSON, TXT

Size: 11.57 MB

Tamazight NLP

Tamazight Open Speech Dataset

This dataset provides a parsed, formatted, and ready-to-use Amazigh Voice Dataset. It contains voice recordings and corresponding text transcripts in Standard Moroccan Amazigh (ⵜⴰⵎⴰⵣⵉⵖⵜ ⵜⴰⵏⴰⵡⴰⵢⵜ ⵜⴰⵎⵓⵔⴰⴽⵓⵛⵜ) intended for training Automatic Speech Recognition (ASR) and Text-to-Speech (TTS) models.

License: Apache-2.0

Locale: zgh

Task: ASR

Format: WAV, JSONL

Size: 459.09 MB

LocaleNLP

English Hausa Parallel Corpus

An English–Hausa dataset with 5,000 sentence pairs useful for machine translation and basic language processing tasks.

License: CC-BY-NC-4.0

Locale: eng, hau

Task: MT

Format: csv

Size: 164.32 KB

THA_ATLAS

StackOverflow Vector Dataset - Haskell

Language-specific StackOverflow vector dataset for Haskell.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 1.34 GB

The University of Melbourne

Central Kurdish TTS dataset 1.0

This dataset contains high-quality single-speaker audio recordings in Central Kurdish (ckb), intended for building Text-to-Speech (TTS) and Automatic Speech recognition (ASR) systems. The dataset comprises 2 hours and 18 minutes of aligned audio and text data.

License: CC-BY-4.0

Locale: ckb

Task: TTS

Format: wav

Size: 293.45 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Dolgan Speech Corpus

A 13-hour supervised Speech-to-Text dataset for Dolgan, an endangered Turkic language. Features sentence-level audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: dlg

Task: ASR

Format: TSV, MP3

Size: 583.34 MB

Kaleem Art Press

Kaleem Art Press Saraiki Literature Corpus

This corpus contains approximately one million tokens of Saraiki text curated over the past ten years by Kaleem Art Press. It features a wide range of literary genres, including stories, short stories, novels, fiction, non-fiction, travelogues, poetry, biographies, and historical writings. All content is shared with full author approval. The dataset is intended to support linguistic research, Saraiki language technology development, and the preservation of cultural and literary heritage.

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 1.84 MB

Kaleem Art Press

Saraiki-English Parallel Corpus

English–Saraiki parallel corpus: 51,447 aligned sentence pairs (~0.89M words), translated by Kaleem Art Press for MT and Saraiki NLP research.

License: CC-BY-NC-4.0

Locale: mul

Task: MT

Format: CSV

Size: 1.92 MB

Taruen

Chuvash TTS

A ~5-hour speech dataset for Chuvash Text-to-Speech (TTS) research, featuring a single female speaker reading news and digits at a rapid tempo.

License: CC-BY-SA-4.0

Locale: cv

Task: TTS

Format: PARQUET

Size: 854.02 MB

MDC DatasetsCompensated

🚧 Khowar Corpus for Speech Recognition 🚧

A Khowar ASR dataset with approximately 10 hours of audio with transcriptions.

License: MDC DLA-1.0

Locale: khw

Task: ASR

Format: MP3, TSV

Size: 245.00 MB

Rerooted Archive

Rerooted: Speech Corpus of Testimonials from Armenian Refugees and Immigrants

Rerooted is an open-access online YouTube corpus of interviews with Armenian refugees and immigrants. As of now, the online corpus has over 80hrs of recordings on YouTube, alongside subtitles in Western Armenian. The current dataset is 20 hours from the corpus that we have curated with corrected and finely-annotated transcripts. The dataset is for use in NLP research, and we hope to continuously update the dataset with more curated transcripts.

License: GPL-3.0

Locale: hy; hyw

Task: ASR

Format: WAV, TEXTGRID

Size: 6.21 GB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Hausa) 🚧

100k native-reviewed colloquial sentences translated from US English into Hausa for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: en-US, ha-NG

Task: MT

Format: TSV

Size: 4.49 MB

Institute of African Digital Humanities

Bati-MultiDialectalASR-Dataset

This dataset contains paired audio and text resources for three Bati dialects (Kelleng, Mbougue, and Nyambat), which belong to the Yambasa group of Bantu languages found in Cameroon. It contains 13,344 audio clips totalling 6 hours, 8 minutes and 12.286 seconds and 44 audio/text mapping files totalling 13,346 lines. Due to its cross-dialectal nature, the dataset is suitable for multilingual automatic speech recognition tasks.

License: NOODL-1.0

Locale: btc

Task: ASR

Format: WAV, TSV

Size: 3.27 GB

THA_ATLAS

StackOverflow Vector Dataset - Bash

Language-specific StackOverflow vector dataset for Bash.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 4.40 GB

All Datasets

Not sure where to start?

Elkhani Hazargi Literature Corpus

🚧 Hazargi Corpus for Speech Recognition 🚧

Keblagh-e-Azergi Hazargi literature corpus

🚧 Hazargi Multimodal Dataset 🚧

🚧 Hazargi-English Parallel Text Corpus 🚧

🚧 Hazargi-English Speech Translation Corpus 🚧

Hawrami Kurdish TTS dataset 1.0

Common Voice Scripted Speech 26.0 - Hazargi

RFE/RL Tatar-Bashkir News Text Corpus

Hausa-TTS-Dataset

Awal Tamazight Dataset

Tamazight Open Speech Dataset

English Hausa Parallel Corpus

StackOverflow Vector Dataset - Haskell

Central Kurdish TTS dataset 1.0

INEL Dolgan Speech Corpus

Kaleem Art Press Saraiki Literature Corpus

Saraiki-English Parallel Corpus

Chuvash TTS

🚧 Khowar Corpus for Speech Recognition 🚧

Rerooted: Speech Corpus of Testimonials from Armenian Refugees and Immigrants

🚧 Colloquial Parallel Text (English - Hausa) 🚧

Bati-MultiDialectalASR-Dataset

StackOverflow Vector Dataset - Bash