I-Corps: Translation potential of minimally invasive tubular retractors to maximize visualization in spine operations

Icahn School Of Medicine At Mount Sinai, New York NY

Investigators

Abstract

The broader impact of this I-Corps project is the development of a system to aid surgeons performing spinal surgery. Currently, minimally invasive surgical techniques are becoming the primary method by which spinal pathologies and deformities are treated. However, the small incision sizes inherent in these approaches prevents optimal visualization of the operating area, and these procedures require the use of cumbersome surgical microscopes at awkward angles, increasing the risk of surgical error and negatively impacting surgical ergonomics. This solution is a camera system with integrated artificial intelligence (AI) software that subtracts obstructive tool shafts from the field of view, and also highlights tooltips and vital anatomy for the surgeon in real time. By allowing for maximal visualization in minimally invasive settings, this technology may increase the accessibility, ease, and reliability of these procedures. In addition, the AI software and modular hardware create a foundation for a database of surgical procedures that may be used to train other algorithms to be applied in a range of surgical settings including laparoscopic, endoscopic, and robotic techniques. This I-Corps project utilizes experiential learning coupled with a first-hand investigation of the industry ecosystem to assess the translation potential of the technology. The solution is based on the previous development of a camera system with integrated artificial intelligence (AI) software that maximizes the visualization of minimally invasive spine operations through minimally invasive tubular retractors (MITRs). Minimally invasive tubular retractors (MITRs) are metal tubes with diameters ranging from 14-22 mm that are used as operating corridors in minimally invasive spine surgeries. They suffer from limited visibility, awkward tool angling, and reliance on cumbersome surgical microscopes. This solution utilizes an array of cameras that focus down the MITR’s operating corridor and capture the operating field from multiple angles. These views are analyzed by the integrated AI software to produce a single live image that removes obstructive and unwanted parts of surgeon tools (e.g., tool shaft) while retaining other necessary components (e.g., tooltip). Specifically, the software aims to combine the array of camera inputs into a singular real-time video output that is segmented and inpainted to increase the surgeons view by over 30%. This is achieved with the help of a specialized deep learning computer vision model that enables the software to identify (via segmentation) and crop out (via inpainting) obstructive objects (tool shafts) within the video feed. Ultimately, this visually maximized image is displayed on a heads-up screen in front of the surgeon, improving outcomes by maximizing the visualization of the operating area and the ergonomics of the procedure. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.