Associated Press Pakistan 74.4 Million Urdu Corpus

Overview

Associated Press Pakistan 74.4 Million Urdu Corpus

The Associated Press Pakistan 74.4 Million Urdu Corpus is a large-scale collection of Urdu-language news articles published by the Associated Press of Pakistan, one of Pakistan’s national news agencies. Established in 1947, the Associated Press of Pakistan is the country’s premier news service and publishes news across multiple languages, including English, Urdu, Chinese, Arabic, Sindhi, Saraiki, Pashto, Balochi, and Brahvi.

This dataset specifically contains Urdu-language text and comprises approximately 74.4 million words across 267,887 articles, covering news published between 2015 and 2026. It provides a substantial collection of contemporary written Urdu news content and represents a valuable resource for research on Urdu, an under-resourced language in natural language processing (NLP).

Language

Urdu is an Indo-Aryan language and the national language of Pakistan, spoken by millions of people worldwide. It is widely used in education, media, literature, and everyday communication. Urdu has a rich linguistic heritage and plays an important role in the development of speech and language technologies for low-resource languages.

Summary Statistics

Data Structure

Urdu-20260827T204233Z-1-001.tar/
└── Urdu/
    ├── 2015/
    │   └── *.txt
    ├── 2016/
    │   └── *.txt
    ├── 2017/
    │   └── *.txt
    ├── 2018/
    │   └── *.txt
    ├── 2019/
    │   └── *.txt
    ├── 2020/
    │   └── *.txt
    ├── 2021/
    │   └── *.txt
    ├── 2022/
    │   └── *.txt
    ├── 2023/
    │   └── *.txt
    ├── 2024/
    │   └── *.txt
    ├── 2025/
    │   └── *.txt
    ├── 2026/
    │   └── *.txt
    └── Unknown Date/
        └── *.txt

Sample Text

آپریشن ضرب عضب ملک کی سیاسی اور عسکری قیادت کا متفقہ عزم ہے، قوم کو جلد دہشت گردی کے ناسور سے نجات مل جائے گی، حکومت نے صحت کی معیاری سہولتوں کی فراہمی کےلئے کئی میگا پروجیکٹس شروع کئے ہیں

گورنر پنجاب کا ”اپنا “کے اعزاز میں تقریب سے خطاب

لاہور۔21 دسمبر(اے پی پی)گورنر پنجاب ملک محمد رفیق رجوانہ نے کہا ہے کہ آپریشن ضرب عضب ملک کی سیاسی اور عسکری قیادت کا متفقہ عزم ہے جس کے مثبت نتائج سامنے آرہے ہیں اور بہت جلد قوم کو دہشت گردی کے ناسور سے نجات مل جائے گی،کراچی آپریشن و ہا ںکے رہائشیوں کی دل کی آواز ہے اس حوالے سے کوئی بھی فیصلہ کرنے سے پہلے ان کی نبض شناسی کرلینی چاہئے۔ ان خیالات کا اظہار انہوں نے کنگ ایڈورڈ میڈیکل یونیورسٹی کی ایلومینائی ایسوسی ایشن اور نارتھ امریکہ میں مقیم پاکستانی ڈاکٹروں کی تنظیم (اپنا) کے اعزاز میں تقریب سے خطاب کے دوران کیا۔

Permission, Ownership & Licensing

This corpus is uploaded and hosted with the express permission of the Associated Press of Pakistan. The Associated Press of Pakistan retains full and exclusive ownership of the data at all times. MirasAI holds no ownership, copyright, or other proprietary interest and acts solely as documentation and hosting facilitator. The corpus is available under a restricted, approval-based access model on the Mozilla Data Collective and is licensed for non-commercial research use only. No sale, sublicensing, or commercial redistribution is permitted. The Associated Press of Pakistan may request takedown at any time, with compliance within 48 hours.

Intended Use & Attribution

Intended for non-commercial NLP and AI research in Urdu, including language modeling, ASR/TTS text resources, machine translation, and information retrieval. All uses must credit the Associated Press of Pakistan as the sole and primary source.

Collection Methodology

Articles were collected from the Associated Press of Pakistan's publicly published Urdu-language section on app.com.pk using an automated web crawler developed by MirasAI. The crawler traversed the section's public article pages, and each article's HTML was parsed to extract the headline, body text, publication date, and source URL. The collected articles were then deduplicated, cleaned of boilerplate, and normalized to plain text with Urdu script preserved in UTF-8. Crawling was rate-limited to avoid placing load on the Associated Press of Pakistan's servers, and was conducted with the knowledge and permission of the Associated Press of Pakistan.