A strategic partnership between Misraj AI and the Nusuk application to facilitate communication in over 170 world languages for the benefit of pilgrims, within the framework of Saudi Vision 2030
Introduction
The Hajj season has long been the largest gathering encompassing immense linguistic and cultural diversity, drawing millions of pilgrims and Umrah performers from more than 180 countries, with a vast multiplicity of languages and backgrounds. This poses a significant challenge to effective communication with service providers and the official bodies responsible for managing this event.
In response to this challenge, the Ministry of Hajj and Umrah launched through a strategic partnership with Misraj AI and the Nusuk application an AI-powered simultaneous translation service combining voice and text, integrated directly within the Nusuk app: the official digital platform dedicated to serving pilgrims. The service operates through an integrated AI pipeline encompassing Speech-to-Text (STT), translation via Large Language Models (LLMs), and Text-to-Speech (TTS), enabling pilgrims to communicate in real time across more than 170 languages in under three seconds.
This initiative, under the auspices of the Ministry of Hajj and Umrah, embodies a clear strategic direction to harness artificial intelligence in service of humanity, and represents a practical pillar within the ecosystem of Saudi Vision 2030 which aims to elevate the Hajj and Umrah experience and achieve:
Linguistic inclusivity, real-time responsiveness, and scalability without high marginal costs.
Approach and Solution
Technical Architecture
At Misraj AI, we designed a comprehensive translation system operating through a sequential technical pipeline engineered to deliver the highest levels of accuracy and speed:
-
Voice input reception and processing using advanced noise-reduction algorithms to minimize the impact of ambient noise in crowded environments.
-
Speech-to-Text (STT) with a built-in capability for automatic recognition of varying dialects and pronunciations.
-
Content verification through an intelligent filtering layer that screens out content conflicting with religious values or inappropriate material.
-
Translation via Large Language Models (LLMs) with automatic identification of source and target languages.
-
Text-to-Speech (TTS) with customization of dialects and voices appropriate to the target language, along with audio compression to ensure rapid delivery.
Operational Features
The service goes beyond standard translation functionality to encompass a suite of mature operational features that reflect a deep understanding of the operational environment's requirements:
-
A system that detects inappropriate and disruptive messages to trigger immediate alerts and block them.
-
Automatic rerouting mechanisms between service providers to ensure continuity of operation during peak periods.
-
A live statistical dashboard providing detailed indicators on usage patterns and geographic and demographic distribution.
Results and Performance
Project Achievements in Numbers
|
Value
|
Indicator
|
|
162,000
|
Total Usage
|
|
2.8 seconds
|
Response Speed
|
|
English 54,484 requests
|
Most Requested Language
|
|
The Grand Mosque (Masjid al-Haram) 102,436 interactions
|
Highest Usage Location
|
|
18–40 years
|
Largest Age Group
|
Future Vision
Smart Geographic Expansion Expansion plans extend to critical touchpoints such as airports, Hajj hospitals, hotels, and checkpoints, with the adoption of QR codes and interactive screens enabling immediate access to the service without requiring an app download.
Intelligent Usage Analytics Building a statistical database to extract recurring linguistic patterns such as emergency terminology, religious inquiries, and spatial navigation requests in order to continuously refine and improve the service.
Translation with Religious and Cultural Context Transitioning from literal translation to contextual translation that draws upon religious and cultural references, thereby narrowing the gap in meaning and enhancing accurate comprehension for translation recipients.
Conclusion
The service developed by Misraj AI stands as a distinguished model for deploying artificial intelligence in public service addressing a pressing need at significant scale. This partnership between Misraj AI and the Ministry of Hajj and Umrah establishes a scalable foundation for enhancing services toward a comprehensive digital communication ecosystem befitting the Kingdom of Saudi Arabia's standing as the host of the world's largest annual human gathering.
