NSF Convergence Accelerator: Track H: Mobility Independence through Accelerated Wheelchair Intelligence

Northwestern University, Evanston IL

Investigators

Abstract

There are millions of potential power wheelchair drivers today for whom independent mobility is difficult, or even entirely impossible. This project proposes to accelerate the utility of power wheelchairs by radically changing how control inputs are captured from the human body and transferred to the machine, and by leveraging practical machine intelligence to enhance safety and facilitate independent wheelchair operation. The wheelchair industry has yet to fully harness artificial intelligence (AI) and driver assistance tools to help ensure safety and efficacy. In 2020 this began to change, as the first commercially-available, FDA-registered driver assistance system for power wheelchairs entered the market (LUCI). There remains a gap however between their (subtractive-only) assistance and the automation achieved by robot companies or even automobile driver assistance. From active steering around obstacles to semi-autonomous navigation, the potential impact for active driving assistance is tremendous. TThis project will bring to market the first active driving assistance system for power wheelchairs. It also will continue to develop and advocate for a digital and open wheelchair communication standard and develop a flexible control interface that conforms to an individual's abilities and preferences. With these innovations, the project will greatly expand access to independent mobility by those with severe motor impairments-which is significant for both for quality of life and participation in the workforce. The partners on this project include stakeholders to provide hands-on use and clinical expertise that guides the prototype design, and engineers to translate that design. The partnership spans non-profits (AbleGamers, Shirley Ryan AbilityLab), academia (Northwestern University), and industry (LUCI Mobility, Function Engineering, LifeDrive). The following research thrusts will accomplish this work- Thrust 1: Advancing safety and independence with wheelchair intelligence that provides active, as well as fully autonomous, driving assistance. We will bring to market active driving assistance within a commercial sensor-based wheelchair safety system (LUCI). - Thrust 2: Modernizing and democratizing the wheelchair input mechanism, by advocating for the adoption of a digital and open-source API (the Wheelchair Digital Interface) as the International Standards Organization RESNA  standard for communication between wheelchair control systems and control inputs-opening the door to any digital interface being used to drive a power wheelchair. - Thrust 3: Bridging the gap in wheelchair control between drivers who can operate a joystick and those who cannot, through the development of a flexible and multimodal control interface that conforms to the user and captures control signals from nearly anywhere on their body, and can be used in concert with existing interfaces for both wheelchair and computer control. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.