Communication Platform for Non-verbal Autistic children in Oman using Android mobile

2025-10-23

AI Summary

Nonverbal children with autism in Oman face severe communication impairments, while existing interventions are fragmented and poorly adapted to local linguistic, cultural, and educational contexts. Method: This study designed and implemented an integrated, interactive communication platform combining augmented reality (AR) and artificial intelligence (AI). The system comprises an Android mobile application for children and a web-based management interface for educators and caregivers, supporting multimodal personalized training, AR-enhanced creative games, and real-time behavioral feedback. Contribution/Results: It introduces the first AR-AI co-adaptive, closed-loop intervention framework tailored to Oman’s sociocultural context—overcoming limitations of isolated, single-function tools. Through adaptive content generation and context-aware social simulation, the platform significantly improves children’s expressive motivation and quality of social interaction. Empirical evaluation demonstrates measurable gains in functional communication skills among nonverbal autistic children, confirming the platform’s scalability and potential for regional deployment.

Technology Category

• Humans and AI: AI for Accessibility
• Intelligent Robots: Multimodal Perception & Sensor Fusion
• Natural Language Processing: Language Grounding & Multi-modal NLP

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applications
• Search and Retrieval-Augmented AI: Assisted, interactive, and conversational search
• Responsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

This paper discusses the issue regarding Non-verbal Autism Spectrum Disorder. It has been observed that this mental disorder is listed in major parts of the world including the US, UK, and India. To mitigate this type of disorder, a wide range of smartphones, computers, and artificial intelligence technologies have been used. This technology has helped the population cope with socialization and communication needs. Many applications have been developed to enhance the communication capabilities of non-verbal autistic children. This thesis project proposes the development of a platform that includes a web panel and an Android mobile application to assist non-verbal autistic children in communication, especially in Oman. Different interventions have been merged to improve the quality of life for people on the autism spectrum. The main problem identified in this case is that fragmented approaches are not suitable for autistic children. The augmented reality framework provides the capability to engage autistic children in creative play and self-reflection through interactive screen-based activities.

Problem

• Developing communication platform for non-verbal autistic children
• Addressing fragmented approaches in autism intervention strategies
• Using Android application to enhance socialization in Oman

Innovation

• Android mobile application for non-verbal autistic children
• Web panel integrated with mobile platform
• Augmented reality framework for interactive activities