Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Torwali Text Corpus”

100 Datasets

Community

Sindhi Corpus

SdCorpus is a large scale monolingual Sindhi text corpus collected from publicly available web sources for NLP and language model development.

License: CC-BY-NC-4.0

Locale: snd

Task: LM

Format: TXT

Size: 321.00 MB

Aim Foundation

Dari Literature Corpus by Anjuman e Adabi Nayestan

A ~1 M-token Dari (Afghan Persian) literary corpus compiled by Anjuman e Adabi Nayestan, covering prose, poetry, and cultural texts in Perso-Arabic script.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 12.67 MB

MirasAI

Kannada Text Corpus

A curated Kannada text corpus containing diverse written content for natural language processing, linguistic research, and language technology development.

License: CC-BY-NC-SA-4.0

Locale: kan

Task: NLP

Format: TXT

Size: 2.61 MB

Balochistan Educational and Cultural Organization

BECO Brahui Literature Corpus

A ~355k-token Brahui literary corpus of short stories, novels, and other creative works for linguistic research and NLP.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 1.19 MB

Aim Foundation

Aim Foundation Dari Literature Corpus

This corpus is a collection of more than seven hundred thousand tokens of Dari language. The corpus contains work of literature including poems, stories, novels, fictional and non-fictional and different articles. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 1.74 MB

Forum for Language Initiatives

Gojri Literature Corpus

A curated Gojri (Gujari) text corpus of approximately 60K tokens covering poetry, stories, short stories, and literary prose.

License: CC-BY-NC-4.0

Locale: gju

Task: NLP

Format: TXT

Size: 117.97 KB

MirasAI

Marathi Blog & Literature Corpus

A curated Marathi text corpus containing diverse written content for natural language processing, linguistic research, and language modeling tasks.

License: CC-BY-NC-4.0

Locale: mar

Task: NLP

Format: TXT

Size: 4.20 MB

CLEAR Global

Kanuri Books Corpus

Randomized sentences from Kanuri-language books by four authors, containing 10,281 sentences and 90,706 words.

License: CC-BY-4.0

Locale: kr

Task: LM

Format: TXT

Size: 545.68 KB

Kaleem Art Press

Kaleem Art Press Saraiki Literature Corpus

This corpus contains approximately one million tokens of Saraiki text curated over the past ten years by Kaleem Art Press. It features a wide range of literary genres, including stories, short stories, novels, fiction, non-fiction, travelogues, poetry, biographies, and historical writings. All content is shared with full author approval. The dataset is intended to support linguistic research, Saraiki language technology development, and the preservation of cultural and literary heritage.

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 1.84 MB

MirasAI

Dameli Literature Corpus

A literary corpus of Dameli texts preserving the language’s literary traditions, cultural heritage, narratives, and diverse forms of written expression.

License: CC-BY-NC-4.0

Locale: dml

Task: NLP

Format: TXT, DOCX

Size: 9.83 MB

Taruen

Tatar Folklore Text Corpus

A 485k-word Tatar folklore corpus from 20th-century field recordings, selected from 5 academic volumes to prioritize contemporary linguistic usage.

License: CC0-1.0

Locale: tt

Task: NLP

Format: TXT

Size: 1.40 MB

MirasAI

Hindi Literature & News Corpus

A diverse Hindi text corpus spanning literary works and news article blogs, curated for NLP research and language modeling tasks.

License: CC-BY-NC-SA-4.0

Locale: hin

Task: NLP

Format: TXT

Size: 19.52 MB

MirasAI

Chittagonian (চাটগাঁইয়া, saṭgãia) Text Corpus

A 690K token corpus of raw Chittagonian text covering drama, poetry, and folklore for linguistic research and NLP development.

License: CC-BY-NC-SA-4.0

Locale: ctg

Task: NLP

Format: TXT

Size: 6.59 MB

Balochistan Educational and Cultural Organization

NAWA-E-WATAN Balochi Newspaper Corpus

A ~1.02M-token Balochi newspaper corpus from NAWA-E-WATAN, representing contemporary journalistic and public discourse.

License: CC-BY-NC-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 1.43 MB

MirasAI

Noakhalian (নোয়াখাইল্লা) Text Corpus

A 500K token corpus of Noakhalian linguistic data including drama scripts and cultural texts for professional NLP research and language preservation.

License: CC-BY-NC-4.0

Locale: oak

Task: NLP

Format: TXT, DOCX

Size: 3.61 MB

Kaleem Art Press

Multilingual Religious Parallel Corpus (Kaleem Art Press)

This dataset is a multilingual parallel sentences corpus containing 6,465 aligned sentence units with approximately 0.98 million words, curated from Kaleem Art Press archives. It includes parallel religious text data in Arabic, Urdu, Saraiki (standard and dialectal), Punjabi (Shahmukhi), and English, supporting research in machine translation, comparative linguistics, digital humanities, and low-resource language studies.

License: CC-BY-SA-4.0

Locale: mul

Task: MT

Format: CSV

Size: 2.27 MB

Common Voice

Common Voice Scripted Speech 26.0 - Wadiyara Koli

A collection of read speech recordings in Wadiyara Koli.

License: CC0-1.0

Locale: kxp

Task: ASR

Format: MP3

Size: 221.10 MB

MDC DatasetsCompensated

🚧 Hazargi-English Parallel Text Corpus 🚧

A Hazargi-English parallel corpus derived from transcribed and translated video recordings

License: MDC DLA-1.0

Locale: haz, en

Task: MT

Format: TSV

Size: 434.04 KB

Rana Printers Multan

Rana Printers Urdu Literature Corpus

This corpus comprises 1.68 million tokens of high-quality Urdu text collected over the past decade through Rana Printers. It includes a diverse range of literary genres such as stories, short stories, novels, fiction, non-fiction, poetry, and historical works. All content is shared with the authors’ approval. The dataset is intended to support linguistic research, Urdu language technology development, and the preservation of literary and cultural heritage.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 3.00 MB

Bismillah Graphics Publishers

Urdu Literature Corpus

This corpus contains 16,17,074 tokens of multiple Urdu literature books published by Bismillah Graphics Publishers.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 2.86 MB

Kaleem Art Press

Kaleem Art Press Urdu Literature Corpus

This corpus is a collection of 1.44 million tokens of Urdu language . The data was produced under the Kaleem Art Press over the last fifteen years . The corpus contains work of literature including Stories, Short Stories, Novels, fiction, non-fiction, Travelogues, Poetry, Biography, and History. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 2.85 MB

Kaleem Art Press

Jhoke Publisher Multan’s Saraiki Newspaper Corpus

Jhoke Publisher Multan’s Saraiki Newspaper Corpus (~1.25M tokens) is a normalized UTF-8 collection of Saraiki newspaper.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.30 MB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Hausa) 🚧

100k native-reviewed colloquial sentences translated from US English into Hausa for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: en-US, ha-NG

Task: MT

Format: TSV

Size: 4.49 MB

MirasAICompensated

🚧 Noakhali 10 Hours TTS (Male Speaker) 🚧

A high-quality Noakhali TTS dataset with paired speech recordings and text transcriptions for speech synthesis, linguistic research, and language preservation.

License: MirasAI Data License

Locale: oak

Task: TTS

Format: WAV, TSV

Size: 2.87 GB