Datasets | Mozilla Data Collective

Community

Awal Tamazight Dataset

A compilation of monolingual and parallel Tamazight language datasets created by CIEMEN as part of the Awal community language technology project.

License: CC-BY-4.0

Locale: zgh

Task: LM

Format: TSV, JSON, TXT

Size: 11.57 MB

Tamazight NLP

AmaWar

Amawal Warayni - ⴰⵎⴰⵡⴰⵍ ⴰⵙⵏⵎⴰⵍⴰⵢ ⵏ ⵉⵏⵓⵎⴰⴽ ⵏ ⵡⴰⵙⵙⴰⵖⵏ ⴷ ⵉⵎⵢⴰⴳⵏ ⵏ ⵜⵎⴰⵣⵉⵖⵜ ⵏ ⴰⵢⵜ ⵡⴰⵔⴰⵢⵏ

License: Apache-2.0

Locale: rif

Task: MT

Format: TSV

Size: 84.07 KB

Tamazight NLP

Tamazight Open Speech Dataset

This dataset provides a parsed, formatted, and ready-to-use Amazigh Voice Dataset. It contains voice recordings and corresponding text transcripts in Standard Moroccan Amazigh (ⵜⴰⵎⴰⵣⵉⵖⵜ ⵜⴰⵏⴰⵡⴰⵢⵜ ⵜⴰⵎⵓⵔⴰⴽⵓⵛⵜ) intended for training Automatic Speech Recognition (ASR) and Text-to-Speech (TTS) models.

License: Apache-2.0

Locale: zgh

Task: ASR

Format: WAV, JSONL

Size: 459.09 MB

Common Voice

Common Voice Scripted Speech 25.0 - Tamazight

A collection of read speech recordings in Tamazight.

License: CC0-1.0

Locale: zgh

Task: ASR

Format: MP3

Size: 41.07 MB

Community

TODa: Tamazight Open Dataset

Welcome to the Tamazight Open Dataset (TODa), a groundbreaking open-source project dedicated to preserving and advancing the Tamazight language. With its extensive collection of linguistic data, TODa stands as a pioneering collaborative project for Tamazight <=> Englis translation, specifically designed for Natural Language Processing applications. TODa's unique approach combines both semantic and syntactic categorization methods, offering a rich representation of words in their various contexts and forms. The dataset encompasses a comprehensive collection of linguistic elements, including detailed verb conjugations across different tenses, noun variations, and an extensive compilation of translated expressions that capture the language's nuances. What sets TODa apart is its inclusive approach to Tamazight's writing systems. The dataset thoughtfully incorporates Latin alphabets, acknowledging and preserving the diverse writing traditions practiced across Amazigh communities. This dual-script approach ensures broader accessibility and cultural authenticity. Our vision is to establish TODa as the cornerstone resource for Tamazight Natural Language Processing. Through this meticulously curated dataset, we strive to empower developers and researchers to create innovative NLP solutions that authentically serve the Amazigh-speaking community. We take pride in our current progress, yet acknowledge that language documentation is an evolving journey. We actively encourage participation from the Amazigh technology community to contribute their expertise in expanding and refining the dataset. Through collaborative effort, we can create a robust foundation for technological innovations that honor and advance Amazigh linguistic heritage.

License: CC-BY-4.0

Locale: zgh

Task: NLP

Format: CSV

Size: 3.27 MB

Keblagh e Azergi

Elkhani Hazargi Literature Corpus

Hazargi literary corpus (~0.5M tokens) of poetry, folklore, and prose texts representing Hazara linguistic and cultural heritage.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 2.46 MB

Keblagh e Azergi

Keblagh-e-Azergi Hazargi literature corpus

This corpus is a collection of more than one hundred thousand tokens of Hazargi language. The corpus contains work of literature, poems, folk and short stories and dramas. The data is being shared with the approval of the authors. It claims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 193.28 KB

The University of Melbourne

Central Kurdish TTS dataset 1.0

This dataset contains high-quality single-speaker audio recordings in Central Kurdish (ckb), intended for building Text-to-Speech (TTS) and Automatic Speech recognition (ASR) systems. The dataset comprises 2 hours and 18 minutes of aligned audio and text data.

License: CC-BY-4.0

Locale: ckb

Task: TTS

Format: wav

Size: 293.45 MB

The University of Melbourne

Hawrami Kurdish TTS dataset 1.0

This dataset contains high-quality single-speaker audio recordings in Hawrami Kurdish (Hewrami, ISO 639-3:hac), also known as the Gorani language, intended for building Text-to-Speech (TTS) and Automatic Speech recognition (ASR) systems. The dataset comprises 5 hours and 15 minutes of aligned audio and text data. Hawrami is classified as Definitely Endangered by UNESCO.

License: CC-BY-4.0

Locale: hac

Task: TTS

Format: WAV

Size: 706.11 MB

Common Voice

Common Voice Scripted Speech 25.0 - Tajik

A collection of read speech recordings in Tajik.

License: CC0-1.0

Locale: tg

Task: ASR

Format: MP3

Size: 18.64 MB

Balochistan Educational and Cultural Organization

NAWA-E-WATAN Balochi Newspaper Corpus

A ~1.02M-token Balochi newspaper corpus from NAWA-E-WATAN, representing contemporary journalistic and public discourse.

License: CC-BY-NC-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 1.43 MB

Common Voice

Common Voice Spontaneous Speech 3.0 - Tashlhiyt

A collection of spontaneous responses to questions in Tashlhiyt.

License: CC0-1.0

Locale: shi

Task: ASR

Format: MP3

Size: 35.52 MB

Common Voice

Common Voice Scripted Speech 25.0 - Tatar

A collection of read speech recordings in Tatar.

License: CC0-1.0

Locale: tt

Task: ASR

Format: MP3

Size: 831.34 MB

Jazab Publishers

Jazab Sindhi Newspaper Corpus

The corpus contains 1.07 million tokens from the Jazab a Sindhi Newspaper published from the year 2023-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.33 MB

Common Voice

Common Voice Scripted Speech 25.0 - Zaza

A collection of read speech recordings in Zaza.

License: CC0-1.0

Locale: zza

Task: ASR

Format: MP3

Size: 54.41 MB

Taruen

Chuvash TTS

A ~5-hour speech dataset for Chuvash Text-to-Speech (TTS) research, featuring a single female speaker reading news and digits at a rapid tempo.

License: CC-BY-SA-4.0

Locale: cv

Task: TTS

Format: PARQUET

Size: 854.02 MB

Community

Urdu Multi-Speaker TTS Dataset

An Urdu multi-speaker TTS dataset distributed in 36 zip files, each containing audio files and a TSV mapping file, with approximately 10 hours of speech.

License: CC-BY-NC-4.0

Locale: urd

Task: TTS

Format: WEBM, TSV

Size: 514.54 MB

MDC Community Concierge

VoxForge - Persian

16 minutes (157 utterances) of read speech of ‭فارسی‬ (Persian).

License: GPL-3.0

Locale: fa

Task: ASR

Format: WAV, TSV

Size: 58.20 MB

Institute of African Digital Humanities

Hausa-TTS-Dataset

This dataset consists of segmented Hausa speech audio clips paired with text, totalling 5h 25m and 38s.

License: NOODL-1.0

Locale: hau

Task: TTS

Format: MP3, TSV

Size: 276.90 MB

Common Voice

Common Voice Spontaneous Speech 3.0 - Pashto

A collection of spontaneous responses to questions in Pashto.

License: CC0-1.0

Locale: ps

Task: ASR

Format: MP3

Size: 195.14 MB

Tamir News Agency

Tamir Sindhi News Corpus

The corpus contains 1.1 million tokens from the Tamir Sindhi Newspaper published from the year 2022-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.56 MB

Common Voice

Common Voice Scripted Speech 25.0 - Kurmanji Kurdish

A collection of read speech recordings in Kurmanji Kurdish.

License: CC0-1.0

Locale: kmr

Task: ASR

Format: MP3

Size: 1.91 GB

CLEAR Global

TWB Parallel Sentence kits - Hausa (30k)

30,000 English–Hausa parallel sentences from CLEAR Global's Gamayun kits, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: hau

Task: MT

Format: TSV

Size: 1.68 MB

Anjuman e Katib

Anjuman-e-Katib Farsi/Persian Literature Corpus

This corpus is a collection of more than one million tokens of Farsi/Persian language. The corpus contains work of literature including novels, fictional and non-fictional, poems and many more. the data is shared with the approval of the authors and aims to support linguistic research, language technology development and its preservation.

License: CC-BY-NC-4.0

Locale: fas

Task: NLP

Format: TXT

Size: 2.82 MB

Browse Datasets

Awal Tamazight Dataset

AmaWar

Tamazight Open Speech Dataset

Common Voice Scripted Speech 25.0 - Tamazight

TODa: Tamazight Open Dataset

Elkhani Hazargi Literature Corpus

Keblagh-e-Azergi Hazargi literature corpus

Central Kurdish TTS dataset 1.0

Hawrami Kurdish TTS dataset 1.0

Common Voice Scripted Speech 25.0 - Tajik

NAWA-E-WATAN Balochi Newspaper Corpus

Common Voice Spontaneous Speech 3.0 - Tashlhiyt

Common Voice Scripted Speech 25.0 - Tatar

Jazab Sindhi Newspaper Corpus

Common Voice Scripted Speech 25.0 - Zaza

Chuvash TTS

Urdu Multi-Speaker TTS Dataset

VoxForge - Persian

Hausa-TTS-Dataset

Common Voice Spontaneous Speech 3.0 - Pashto

Tamir Sindhi News Corpus

Common Voice Scripted Speech 25.0 - Kurmanji Kurdish

TWB Parallel Sentence kits - Hausa (30k)

Anjuman-e-Katib Farsi/Persian Literature Corpus