Opening technology up to all

  • April 16, 2015
Opening technology up to all

Pradipta Biswas leads research team looking to help people with physical impairments to access technology.

Researchers led by a Gates Cambridge Scholar have devised a computer control interface which will help people with physical impairments and others who cannot use a mouse or touchscreeen to perform complex computing tasks at speed.

The team of researchers at the Department of Engineering, led by Dr Pradipta Biswas, has developed a computer control interface that uses a combination of eye-gaze tracking and other inputs. The team’s research was recently published in a paper, ‘Multimodal Intelligent Eye-Gaze Tracking System,’ in the International Journal of Human-Computer Interaction.

The researchers provided two major enhancements to a standalone gaze-tracking system. First, sophisticated software interprets factors such as velocity, acceleration and bearing to provide a prediction of the user’s intended target. Next, a second mode of input is employed, such as a joystick.

“We hope that our eye-gaze tracking system can be used as an assistive technology for people with severe mobility impairment,” said Pradipta, a Senior Research Associate in the Department’s Engineering Design Group. “We are also exploring the potential applications in military aviation and automotive environments where operators’ hands are engaged with controlling an aircraft or vehicle.”

One challenge that arises when designing such a system is, once the target is selected, how does the user indicate a desire for selection? On a typical personal computer, this is accomplished with a click of the mouse; with a phone or tablet, a tap on the screen.

Basic eye-gaze tracking systems often use a signal such as blinking the eyes to indicate this choice. However, blinking is not often ideal. For example, in combat situations, pilots’ eyes might dry up, precluding their ability to blink at the right time.

Pradipta’s team experimented with several ways to solve the selection problem, including manipulating joystick axes, enlarging predicted targets, and using a spoken keyword such as ‘fire’ to indicate a target.

Unsurprisingly, they found that a mouse remains the fastest and least-cognitively stressful method of selecting a target – possibly assisted by the fact that most computer users are already comfortable with this technique. But, a multimodal approach combining eye-gaze tracking, predictive modelling, and a joystick can almost match a mouse in terms of accuracy and cognitive load. Further, when testing computer novices and with sufficient training in the system, the intelligent multimodal approach can even be faster.

The hope is that these revelations will lead to systems that perform as well – or better – than a mouse. “I am very excited for the prospects of this research,” Pradipta said. “When clicking a mouse isn’t possible for everyone, we need something else that’s just as good.”

Latest News

Gates Cambridge collaboration leads to re-interpretation of ancient text

Two Gates Cambridge Scholars have joined forces to correct a mistake that has persisted in classical scholarship for over 400 years. Daniel Hanigan [2019] and Grant Kynaston [2019] have just published Autopsy and didactic authority: rethinking the prologue of the Periodos to Nicomedes, an article in Classical Quarterly, the leading journal in Classical Studies, in […]

Widening access through MOOCs

People without college degrees perform better at entry-level MOOCs specifically designed to increase access to university enrolment, researchers have found. The study, The  Promise  of  MOOCs  Revisited?  Demographics  of  Learners  Preparing  for University, led by Gates Cambridge Scholar Mike Meaney [2016], has just been published in the Journal of Learning Analytics. It is the first time […]

Scholar on Clinton Foundation initiative panel

Gates Cambridge Scholar Shadrack Frimpong has spoken on a panel chaired by former presidential nominee Hillary Clinton at Clinton Global Initiative University. Shadrack participated in a session on 4th March in Nashville, chaired by Clinton, on Protecting the Rights of Girls and Women During Conflict and Uncertainty. He spoke about the need to combine academic […]

Peace through gender equality

A Gates Cambridge Scholar has co-authored a book on how best to engage more men in gender equality. William McInerney is co-author of Das Buch, Das Jeder Mann Lesen Sollte: In 4 Schritten zum Feministen [The Book that Every Man Should Read: 4 Steps to Becoming a Feminist], which has just been released in Germany. […]