Windows Sphere: Multi-Modal Operating System Control for Disability Support using Artificial Intelligence
R. Sudharsanan, Aayush Mishra, Bhuvanesi Barua, Prateek Rane, Punniyakotti Varadharajan Gopirajan · EPJ Web of Conferences · 2025
Most traditional computer systems are based strongly on the standard input devices such as keyboard and mouse and they can pose a huge challenge for people with disabilities. 'Windows Sphere' is a multimodal operating system control system designed to empower individuals with disabilities through the use of artificial intelligence. Two key modules that the system integrates are: a gesture-based control module and a voice driven assistant bot F.R.I.D.A.Y. The gesture-based module allows users with partial hand functionality to operate the operating system with efficiency, thereby reducing the need for standard input devices. At the same time, F.R.I.D.A.Y., a voice recognition-based assistant, allows users without hand functionality to have seamless system control, thus enabling an offline inclusive operating experience. The system provides dual control modalities overcoming the fatigue of using a single input method by allowing additional control modalities. Additionally, the anticipated outcome of this research is a cost-effective AI driven interface that would increase accessibility and autonomy for the user however they have physical capabilities. The focus of this project is on defining a new standard for accessibility through the proposed framework, which offers great potential for extending application beyond its constraints.