Toy hackathon helps children with severe disabilities to communicate

  • October 21, 2022
Toy hackathon helps children with severe disabilities to communicate

Pradipta Biswas has led a first of its kind toy hackathon to help children with severe disabilities to communicate through eye-controlled interfaces.

A first of its kind toy hackathon has been organised by a Gates Cambridge Scholar to help children with severe disabilities communicate with the world.

Pradipta Biswas [2006], associate professor at the Centre for Product Design and Manufacturing and associate faculty at Robert Bosch Centre for Cyber Physical Systems at the Indian Institute of Technology in Madras, is behind the hackathon that took place at the institute in October.

The aim was to help children with severe speech and motor impairment learn to use cyber physical systems and associated eye gaze controlled human robot interfaces in their education and rehabilitation.  It also helped researchers see what new uses the software could be put to. For example, teaching users with severe motor impairment to draw, paint and type using a low-cost robotic manipulator and personalised interface.

The hackathon was the first of its kind to be based around users of assistive technology. All the participants underwent training with software that has an eye gaze-controlled interface. 

The children used toys such as drones, robotic arms and remotely-controlled toy cars with a remote connection to a laptop which can read their eye movement. The event builds on research led by Pradipta which began in 2016 with work on creating virtual keyboards on screen that are controlled by eye movements through a laptop camera the recognises and interprets the direction in which the person is looking, using artificial intelligence.

The reason toys are used is to insert an element of playfulness into the process which encourages children to engage, something that has been particularly important due to the negative impact of Covid on learning.

Pradipta has been working with the India-EU ICT Standardisation Collaboration Project as part of the work.

Latest News

Decolonising energy research

Energy policy in the Global South needs to be rooted in the local context, according to a new paper, co-authored by a Gates Cambridge Scholar, which outlines ways of bridging the Global North-South research divide. The paper, Bridging the divide in energy policy research: Empirical evidence from global collaborative networks, is published this week in […]

Scholar is finalist for prestigious business book award

A Gates Cambridge Scholar is in the running for a prestigious business book publishing prize for her proposal on the pioneering work of climate change entrepreneurs. Âriel de Fauconberg is one of three finalists for the  Financial Times and McKinsey’s Bracken Bower Award for her book proposal, Before the Dawn: Racing to net zero on […]

Is climate change affecting animals’ body size?

New evidence shows that some mammals increase in size in warmer settings, upsetting established norms and suggesting that climate change may be having an unexpected impact on animal body size. The study*, published in Scientific Reports, finds that recent changes in treeshrew body size subvert two of the most studied ecogeographical rules about body size […]

How anti-black logic travelled back to Africa

When she first started doing Women’s Studies, Ola Osman [2019] spent time in Liberia researching the impact of the civil war on women. For her PhD she has taken a step back to look at the deeper roots of Liberian politics and how the repatriation of enslaved people during the ‘Back to Africa’ Movement in […]