Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Saraiki–English Parallel Corpus”

100 Datasets

Community

Semarang Dialect-Javanese Parallel Corpus (IND|JAV|ENG|ARB)

The languages represented in the corpus include Javanese in the Semarang dialect, Indonesian, English, and Arabic.

License: CC-BY-SA-4.0

Locale: ind,jav,eng,arb

Task: MT

Format: TSV

Size: 552.39 KB

MDC DatasetsCompensated

🚧 Hazargi Corpus for Speech Recognition 🚧

A Hazargi ASR dataset with approximately 10 hours of audio with transcriptions.

License: MDC DLA-1.0

Locale: haz

Task: ASR

Format: MP3, TSV

Size: 511.56 MB

Bahasa Bahana

Lumajang Dialect-Javanese Parallel Corpus

This dataset consists of a parallel corpus of Javanese translations of the Lumajang dialect from the city of Lumajang in East Java, Indonesia

License: CC-BY-SA-4.0

Locale: ind,jav,eng,arb

Task: ML

Format: TSV

Size: 523.50 KB

MirasAI

Dameli Literature Corpus

A literary corpus of Dameli texts preserving the language’s literary traditions, cultural heritage, narratives, and diverse forms of written expression.

License: CC-BY-NC-4.0

Locale: dml

Task: NLP

Format: TXT, DOCX

Size: 9.83 MB

CLEAR Global

Synthetic Text Corpus for African Language ASR

LLM-generated synthetic text in 10 African languages with human linguistic quality evaluations

License: CC-BY-NC-4.0

Locale: bm,ny,ha,kr,luo

Task: NLP

Format: TSV

Size: 746.63 KB

Sindh Sujag Newspaper Agency

Sindh Sujag Newspaper Corpus

The corpus contains approximately 1.2 million tokens from the Sindh Sujag Newspaper Agency published between 2024 and 2025. It includes complete newspaper content such as headlines, editorials, finance news, and advertisements. The newspaper is published daily in Karachi, Pakistan, and represents a comprehensive collection of contemporary Sindhi journalistic writing.

License: CC-BY-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.63 MB

Community

Sindhi Word Segmentation (SdSEG)

A sentence-level annotated dataset for training and evaluating sequence labeling models such as CRF, BiLSTM, and transformer-based architectures.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: JSON

Size: 1.13 MB

RFE/RL

RFE/RL Tajik News Text Corpus

Longitudinal Tajik & Russian news corpus from Radio Ozodi (2000-2026) with over 166,000 articles and 20M tokens.

License: CC-BY-NC-SA-4.0

Locale: tg,ru

Task: NLP

Format: TXT

Size: 145.27 MB

Balochistan Educational and Cultural Organization

BECO Brahui Literature Corpus

A ~355k-token Brahui literary corpus of short stories, novels, and other creative works for linguistic research and NLP.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 1.19 MB

MirasAI

Associated Press Pakistan 78.1 Million English Corpus

The Associated Press of Pakistan 78.1 Million English Corpus is a large-scale English text released for non-commercial research with APP's permission.

License: CC-BY-NC-SA-4.0

Locale: eng

Task: NLP

Format: TXT

Size: 178.01 MB

Tamahi Suneha Magazine

Punjabi Literature Corpus

This corpus contains 10,39,430 tokens of Punjabi Shahmukhi script.

License: CC-BY-NC-4.0

Locale: pa-PK

Task: OTH

Format: TXT

Size: 1.83 MB

Community

Jombang Dialect of JAV-IND-ENG-ARB Parallel Corpus

This dataset consists of a parallel corpus of Javanese translations of the Jombang dialect from the city of Jombang in East Java, Indonesia.

License: CC-BY-SA-4.0

Locale: ind,jav,eng

Task: MT

Format: TSV

Size: 354.21 KB

Jazab Publishers

Jazab Sindhi Newspaper Corpus

The corpus contains 1.07 million tokens from the Jazab a Sindhi Newspaper published from the year 2023-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.33 MB

Community

Priangan Dialect of Sundanese-IND-ENG-ARB Parallel Corpus

This dataset consists of a parallel corpus of Sundanese translations of the Priangan dialect especially from Cianjur City in West Java, Indonesia.

License: CC-BY-NC-SA-4.0

Locale: sun

Task: MT

Format: tsv

Size: 366.64 KB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Enets Speech Corpus

A 3.7-hour supervised Speech-to-Text dataset for Enets, an endangered Samoyedic language. Features sentence-level audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: enf, enh

Task: ASR

Format: TSV, MP3

Size: 140.56 MB

RFE/RL

RFE/RL Tatar-Bashkir News Text Corpus

This dataset is longitudinal news corpus for the Tatar and Bashkir languages, sourced from Azatliq Radiosi, from 2001 to 2025, it contains over 105,000 articles (30M tokens).

License: CC-BY-NC-SA-4.0

Locale: tt,ba,ru

Task: NLP

Format: TXT

Size: 102.44 MB

MDC DatasetsCompensated

🚧 Hazargi Multimodal Dataset 🚧

A Hazargi multimodal dataset with 10 hours of synchronized video, audio, transcriptions, speech segmentation, and ELAN annotations.

License: MDC DLA-1.0

Locale: haz

Task: NLP

Format: MP4, EAF

Size: 44.00 GB

Collaborative Action For Research & Development (CARD)

Gawri (گاؤری) Magazine Corpus

The Gawri (گاؤری) Magazine Corpus is a curated collection of monthly Gawri magazine text (~67,724 tokens) that supports research and language technology.

License: CC-BY-NC-4.0

Locale: gwc

Task: NLP

Format: TXT

Size: 146.71 KB

RFE/RL

RFE/RL Pashto (Pakistani) News Text Corpus

Longitudinal Pakistani Pashto news corpus from Radio Mashaal (2010-2026) with over 52,000 articles and 14.5M tokens.

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 39.26 MB

Institute of African Digital Humanities

Sample Tupuri-Bango_TTS-Dataset (male voice)

Tupuri-Bango (tui) scripted TTS dataset: 983 clips (≈1h 06m) from 10 sessions, AGLC orthography. Kaele & Mayo-Danay, Far-North, Cameroon.

License: NOODL-1.0

Locale: tui

Task: TTS

Format: MP3, TSV

Size: 46.93 MB

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part1

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for Somali language, produced by Digital Divide Data

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 7.68 GB

MirasAI

Rangpuri (অংপুরি Ôṅgpuri) Text Corpus

A 500K token corpus of Rangpuri literature and drama provided in UTF-8 format for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: rkt

Task: NLP

Format: TXT

Size: 3.68 MB

Community

Mandar Spontaneous Speech

This dataset is a compilation of spontaneous Mandar speech featuring Indonesian code-switching.

License: CC-BY-NC-4.0

Locale: mdr

Task: ASR

Format: MP3, TSV

Size: 534.45 MB

Chana

Kakataibo: Phonetic Word List

150 Kakataibo lexical items with WAV recordings and Praat TextGrids, including botanically identified items and comparable Aymara and Awajún data.

License: Chana 2.0

Locale: cbr

Task: N/A

Format: WAV, TextGrid, MD, CSV

Size: 65.10 MB