Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Saraiki–English Parallel Corpus”

100 Datasets

CLEAR Global

TWB Parallel Sentence kits - Rohingya (5k)

5,000 English–Rohingya parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: rhg

Task: MT

Format: TSV

Size: 358.88 KB

CLEAR Global

TWB Parallel Sentence kits - Tigrinya (5k)

5,000 English–Tigrinya parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: tig

Task: MT

Format: TSV

Size: 404.75 KB

Balochi Academy

Balochi Academy Text Corpus

This corpus contains approximately 500k tokens of text from novels, poetry, articles, riddles, and proverbs, covering both literary and traditional genres. It is intended for linguistic research, NLP tasks (e.g., language modeling and text analysis), and cultural documentation.

License: CC-BY-NC-SA-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 1.88 MB

Community

Synthetic Ladino Parallel Corpus

Synthetically produced parallel sentences for Ladino paired with English, Spanish, and Turkish, generated using rule-based translation.

License: CC-BY-4.0

Locale: lad, en, es, tr

Task: MT

Format: TSV

Size: 898.32 MB

Keblagh e Azergi

Elkhani Hazargi Literature Corpus

Hazargi literary corpus (~0.5M tokens) of poetry, folklore, and prose texts representing Hazara linguistic and cultural heritage.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 2.46 MB

Institute of African Digital Humanities

Ewondo-French Parallel Corpus

A parallel corpus of 3,631 aligned Ewondo–French translation units derived from recorded speech, suitable for machine translation tasks.

License: NOODL-1.0

Locale: ewo

Task: MT

Format: TSV

Size: 137.84 KB

Community

Multidialect of JAV-IND-ENG-ARB Parallel Corpus

The dataset covers a parallel corpus of 5,173 lines of literal translation text in Indonesian, Javanese multi-dialect, English, and Arabic.

License: CC-BY-NC-SA-4.0

Locale: ind,jav,eng,arb

Task: MT

Format: TSV

Size: 566.75 KB

Balochistan Educational and Cultural Organization

NAWA-E-WATAN Balochi Newspaper Corpus

A ~1.02M-token Balochi newspaper corpus from NAWA-E-WATAN, representing contemporary journalistic and public discourse.

License: CC-BY-NC-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 1.43 MB

Aim Foundation

Aim Foundation Dari Literature Corpus

This corpus is a collection of more than seven hundred thousand tokens of Dari language. The corpus contains work of literature including poems, stories, novels, fictional and non-fictional and different articles. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 1.74 MB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Yoruba) 🚧

100k native-reviewed colloquial sentences translated from US English into Yoruba for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: yo-NG, en-US

Task: MT

Format: TSV

Size: 5.02 MB

CLEAR Global

TWB Parallel Sentence kits - Congo Swahili (25k)

25,305 French–Congo Swahili parallel sentences from CLEAR Global's Gamayun kits, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: swc

Task: MT

Format: TSV

Size: 2.18 MB

CLEAR Global

TWB Parallel Sentence kits - Lingala (5k)

5,000 French–Lingala parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: lin

Task: MT

Format: TSV

Size: 494.43 KB

Aim Foundation

Dari Literature Corpus by Anjuman e Adabi Nayestan

A ~1 M-token Dari (Afghan Persian) literary corpus compiled by Anjuman e Adabi Nayestan, covering prose, poetry, and cultural texts in Perso-Arabic script.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 12.67 MB

Community

Sindhi Parts Of Speech (SiPOS)

A large-scale Sindhi Part-of-Speech (SiPOS) tagging dataset for developing and evaluating NLP models in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 874.04 KB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Yoruba) 🚧

49k native-reviewed colloquial sentences translated from US English into Yoruba for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: yo-NG, en-US

Task: MT

Format: TSV

Size: 3.25 MB

Community

Demakan Dialect of JAV-IND-ENG-ARB Parallel Corpus

The Demakan dialect is a regional dialect of the Javanese language spoken by the people of the Demak regency in Central Java, Indonesia

License: CC-BY-SA-4.0

Locale: ind,jav,eng,arb

Task: MT

Format: TSV

Size: 555.42 KB

MirasAI

Associated Press Pakistan 21.4 Million Pashto Corpus

Pashto news corpus from the Associated Press of Pakistan, containing 99,495 articles and 21.4 million words from 2015–2026.

License: CC-BY-NC-SA-4.0

Locale: pus

Task: NLP

Format: TXT

Size: 38.81 MB

MirasAI

Ormuri Literature corpus by Rozi Burki

Ormuri Literature Corpus is a collection of Ormuri literary texts by Rozi Burki, supporting research and preservation of this under-resourced language.

License: CC-BY-NC-SA-4.0

Locale: oru

Task: NLP

Format: PDF, DOCX

Size: 18.92 MB

Balochistan Educational and Cultural Organization

Talar (تلار) Barahui Magazine Corpus

A ~150,000-word Brahui corpus from the monthly magazine Talar, covering editorials, essays, fiction, poetry, and socio-cultural commentary.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 317.22 KB

Institute of African Digital Humanities

Bamun-French Parallel Corpus 1.1

This dataset is an updated version of the "Bamun-French Parallel Corpus", a parallel corpus of texts in Bamun (Shupament) and French.

License: NOODL-1.0

Locale: bax

Task: MT

Format: TSV

Size: 99.78 KB

Common Voice

Common Voice Scripted Speech 26.0 - Parkari Koli

A collection of read speech recordings in Parkari Koli.

License: CC0-1.0

Locale: kvx

Task: ASR

Format: MP3

Size: 219.50 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Evenki Speech Corpus

A 2.5-hour supervised Speech-to-Text dataset for Evenki, an endangered Tungusic language. Features sentence-level audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: evn

Task: ASR

Format: TSV, MP3

Size: 103.03 MB

Balochistan Educational and Cultural Organization

Western Balochi Literature Cropus

A cleaned literary corpus in Western Balochi (Rakhshani) including articles, research, translations, and creative literature. (~1.1 m tokens)

License: CC-BY-NC-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 2.26 MB

MirasAI

Wakhi Literature Corpus

A literature corpus of Wakhi language texts, preserving the language’s literary, cultural, and linguistic heritage for research and low-resource NLP.

License: CC-BY-ND-4.0

Locale: wbl

Task: NLP

Format: DOCX, TXT

Size: 74.83 KB