Datasets | Mozilla Data Collective

Weekly Kaleem Magazine Multan

Kaleem Magazine Urdu Corpus

This corpus is a collection of around 1.4 million tokens of Urdu language. The data was extracted from the archives of a famous Urdu magazine "Kaleem" published weekly from last 30 years. This corpus contains work of literature including stories, short stories, news, poetry, literary reports, fiction, non-fiction, and travelogues. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: urd

Task: NLP

Format: TXT

Size: 2.74 MB

Common Voice

Common Voice Scripted Speech 27.0 - Kurmanji Kurdish

A collection of read speech recordings in Kurmanji Kurdish.

License: CC0-1.0

Locale: kmr

Task: ASR

Format: MP3

Size: 1.99 GB

Common Voice

Common Voice Scripted Speech 27.0 - Kateviri

A collection of read speech recordings in Kateviri.

License: CC0-1.0

Locale: bsh

Task: ASR

Format: MP3

Size: 202.62 MB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Yoruba) 🚧

49k native-reviewed colloquial sentences translated from US English into Yoruba for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: yo-NG, en-US

Task: MT

Format: TSV

Size: 3.25 MB

All Datasets

Not sure where to start?

Kaleem Magazine Urdu Corpus

Common Voice Scripted Speech 27.0 - Kurmanji Kurdish

Common Voice Scripted Speech 27.0 - Kateviri

🚧 Colloquial Parallel Text (English - Yoruba) 🚧