Toy hackathon helps children with severe disabilities to communicate

  • October 21, 2022
Toy hackathon helps children with severe disabilities to communicate

Pradipta Biswas has led a first of its kind toy hackathon to help children with severe disabilities to communicate through eye-controlled interfaces.

A first of its kind toy hackathon has been organised by a Gates Cambridge Scholar to help children with severe disabilities communicate with the world.

Pradipta Biswas [2006], associate professor at the Centre for Product Design and Manufacturing and associate faculty at Robert Bosch Centre for Cyber Physical Systems at the Indian Institute of Technology in Madras, is behind the hackathon that took place at the institute in October.

The aim was to help children with severe speech and motor impairment learn to use cyber physical systems and associated eye gaze controlled human robot interfaces in their education and rehabilitation.  It also helped researchers see what new uses the software could be put to. For example, teaching users with severe motor impairment to draw, paint and type using a low-cost robotic manipulator and personalised interface.

The hackathon was the first of its kind to be based around users of assistive technology. All the participants underwent training with software that has an eye gaze-controlled interface. 

The children used toys such as drones, robotic arms and remotely-controlled toy cars with a remote connection to a laptop which can read their eye movement. The event builds on research led by Pradipta which began in 2016 with work on creating virtual keyboards on screen that are controlled by eye movements through a laptop camera the recognises and interprets the direction in which the person is looking, using artificial intelligence.

The reason toys are used is to insert an element of playfulness into the process which encourages children to engage, something that has been particularly important due to the negative impact of Covid on learning.

Pradipta has been working with the India-EU ICT Standardisation Collaboration Project as part of the work.

Latest News

Addressing the mental health emergency

Mental health has been rising up the global health priority list over the last few years, but Covid accelerated it. Yet the resources available to those in crisis situations are few. Gates Cambridge Scholar Usama Mirza is addressing one particular gap in his home country of Pakistan, having recently launched Asia’s first mental health ambulance […]

Food security in Africa through a multi-disciplinary lens

Three Gates Cambridge Scholars are collaborating on an innovative project to map and address the disappearance of historically undervalued African indigenous and traditional food crops at a time of climate crisis. The project is the brainchild of Dr Carol Ibe, founder of the JR Biotek Foundation, a charity which trains, upskills and empowers present and […]

Double winner

Jenna Armstrong has done it again. Last year she was part of the winning Cambridge women’s rowing team and her team did it again last weekend. Jenna [2020] started rowing in 2011 as an undergraduate, but took five years off from 2015 to 2020 until she picked it up again when she started at Cambridge. She […]

What does extreme weather mean for us?

Three Gates Cambridge Scholars from China, the US and India are taking part in the third episode of the Gates Cambridge podcast, So, now what? which is out today [26th March] as part of the Cambridge Festival’s Festival of Podcasts. The episode, featuring Victoria Herrmann [2015], Songqiao Yao [2014] and Ramit Debnath [2018] and hosted […]