Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Saraiki–English Parallel Corpus”

100 Datasets

Balochi Academy

Eastern Balochi Literature Corpus

A UTF-8 normalized Eastern Balochi literature corpus (~1.9M tokens) covering poetry, folklore, novels, and cultural texts for linguistic research and NLP.

License: CC-BY-NC-4.0

Locale: bgp

Task: NLP

Format: TXT

Size: 949.67 KB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Selkup Speech Corpus

A 1.6-hour supervised Speech-to-Text dataset for Selkup, an endangered Samoyedic language. Features sentence-level audio-text alignments.

License: CC-BY-NC-SA-4.0

Locale: sel

Task: ASR

Format: TSV, MP3

Size: 45.46 MB

MirasAI

Associated Press Pakistan 16.9 Million Balochi Corpus

A 16.9M-word Balochi news corpus from Associated Press of Pakistan, covering 59,172 articles published between 2016 and 2026.

License: CC-BY-NC-SA-4.0

Locale: bal

Task: NLP

Format: TXT

Size: 22.85 MB

Community

Gresik Dialect of Javanese-IND-ENG-ARB Parallel Corpus

This dataset comprises a parallel corpus of 5,173 lines of literal translation text in Indonesian, the Gresik dialect of Javanese, English, and Arabic.

License: CC-BY-NC-SA-4.0

Locale: ind,jav,eng,arb

Task: ML

Format: TSV

Size: 550.10 KB

Balochistan Educational and Cultural Organization

Brahui Research Work Corpus

This corpus consists of research works, academic theses, and scholarly papers, comprising approximately 185,000 tokens. It covers a range of academic topics and formal registers, reflecting standardized writing practices and disciplinary conventions. The corpus is intended to support linguistic analysis, discourse studies, and computational research on academic and research-oriented text.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 1.13 MB

Community

Sindhi Corpus

SdCorpus is a large scale monolingual Sindhi text corpus collected from publicly available web sources for NLP and language model development.

License: CC-BY-NC-4.0

Locale: snd

Task: LM

Format: TXT

Size: 321.00 MB

CLEAR Global

TWB Parallel Sentence kits - Nande (15k)

15,000 French–Nande parallel sentences from CLEAR Global's Gamayun kits, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: nnb

Task: MT

Format: TSV

Size: 1.26 MB

Forum for Language Initiatives

Hussain Faizy Indus Kohistani Corpus

The Indus Kohistani corpus contains around 500k tokens of folktales, stories, poetry, biographies, and conversational texts, all transcribed with a consistent community orthography. Reviewed by native speakers, the corpus offers a representative snapshot of the language’s vocabulary and grammar for linguistic and computational research.

License: CC-BY-SA-4.0

Locale: mvy

Task: NLP

Format: TXT

Size: 14.70 MB

MirasAI

Ormuri Bilingual Dictionary by Rozi Khan Burki

A Ormuri dictionary by Rozi Khan Burki documenting Ormuri vocabulary and meanings to support language preservation, linguistic research, and NLP development.

License: CC-BY-ND-4.0

Locale: oru

Task: TTS

Format: JPG, PDF, DOCX

Size: 15.68 MB

MirasAI

Sylheti Text Corpus by Haque Publishers

A 524K token Sylheti corpus featuring drama scripts and cultural texts in UTF-8 format for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: syl

Task: NLP

Format: TXT

Size: 3.53 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Dolgan Speech Corpus

A 13-hour supervised Speech-to-Text dataset for Dolgan, an endangered Turkic language. Features sentence-level audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: dlg

Task: ASR

Format: TSV, MP3

Size: 583.34 MB

MirasAI

Kannada Time Aligned Speech Corpus

A 5-hour Kannada speech dataset with time-aligned transcriptions, designed for ASR, forced alignment, and speech research.

License: CC-BY-NC-SA-4.0

Locale: kan

Task: ASR

Format: OGG, SRT

Size: 355.77 MB

Keblagh e Azergi

Keblagh-e-Azergi Hazargi literature corpus

This corpus is a collection of more than one hundred thousand tokens of Hazargi language. The corpus contains work of literature, poems, folk and short stories and dramas. The data is being shared with the approval of the authors. It claims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 193.28 KB

CLEAR Global

Kanuri Books Corpus

Randomized sentences from Kanuri-language books by four authors, containing 10,281 sentences and 90,706 words.

License: CC-BY-4.0

Locale: kr

Task: LM

Format: TXT

Size: 545.68 KB

Institute of African Digital Humanities

Tupuri-ASR-Dataset

Tupuri (tui) scripted speech: 2,085 clips (≈2h46min) from different speakers across two dialect subsets — Bango and Banwere.

License: NOODL-1.0

Locale: tui

Task: ASR

Format: MP3,, TSV

Size: 97.82 MB

MDC DatasetsCompensated

🚧 Khowar Speech Translation Corpus 🚧

A Khowar-English speech translation dataset with approximately 9.5 hours of Khowar audio with English text translations.

License: MDC DLA-1.0

Locale: khw, en

Task: MT

Format: MP3, TSV

Size: 244.96 MB

MirasAI

Noakhalian (নোয়াখাইল্লা) Text Corpus

A 500K token corpus of Noakhalian linguistic data including drama scripts and cultural texts for professional NLP research and language preservation.

License: CC-BY-NC-4.0

Locale: oak

Task: NLP

Format: TXT, DOCX

Size: 3.61 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Nganasan Speech Corpus

A 38.5-hour Speech-to-Text dataset for Nganasan, an endangered Samoyedic language. Features audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: nio

Task: ASR

Format: TSV, MP3

Size: 1.29 GB

MDC Community Concierge

Bangor Siarad Welsh-English Corpus

Welsh-English bilingual speech corpus with 40 hours of recorded audio and transcriptions making up 450,000 words

License: GPL-3.0

Locale: cym

Task: ASR

Format: MP3, CHA. TSV

Size: 2.13 GB

Institute of African Digital Humanities

Bati-MultiDialectalASR-Dataset

This dataset contains paired audio and text resources for three Bati dialects (Kelleng, Mbougue, and Nyambat), which belong to the Yambasa group of Bantu languages found in Cameroon. It contains 13,344 audio clips totalling 6 hours, 8 minutes and 12.286 seconds and 44 audio/text mapping files totalling 13,346 lines. Due to its cross-dialectal nature, the dataset is suitable for multilingual automatic speech recognition tasks.

License: NOODL-1.0

Locale: btc

Task: ASR

Format: WAV, TSV

Size: 3.27 GB

Institute of African Digital Humanities

Mada-French Parallel Corpus 1.0

This dataset comprises a parallel corpus of 2,154 lines of translations of literary texts from Mada (mxu) to French.

License: NOODL-1.0

Locale: mxu

Task: MT

Format: TSV

Size: 122.37 KB

Anjuman e Katib

Persian Literature Corpus by Najwai Sukhan

A curated Persian literary corpus of ~1.26M tokens spanning literature, poetry, educational writing, and culturally significant texts.

License: CC-BY-NC-4.0

Locale: fas

Task: NLP

Format: TXT

Size: 38.62 MB

Community

SKAD Ladino Parallel Corpus

Human-authored parallel sentences for Ladino (Judeo-Spanish) paired with English and Turkish, created by the Sephardic Center of Istanbul (SKAD).

License: CC-BY-4.0

Locale: lad, eng, tur

Task: MT

Format: TSV

Size: 74.14 KB

Forum for Language Initiatives

Kohistani Shina Word List

A UTF-8 encoded Kohistani Shina dictionary and word list corpus with lexical entries, meanings, and annotations for linguistic research and NLP use.

License: CC-BY-NC-4.0

Locale: plk

Task: NLP

Format: TXT

Size: 394.05 KB