Augmented reality guidance for spinal surgery with stereoscopic displays and magnified views

Smart overview of the Invention

The patent application introduces a method and apparatus for augmented reality guidance in spinal surgery. It focuses on providing real-time stereoscopic augmented views for surgeons, using advanced image registration techniques. This system integrates preoperative and intraoperative images with real-time video, allowing surgeons to view and interact with a 3D representation of the patient's anatomy through a head-mounted display.

Background

Traditional surgical practices require surgeons to mentally map anatomical structures by alternating between the patient and external monitors displaying relevant images. This process is challenging and can lead to inaccuracies. Existing systems use intraoperative interactive planning and display methods, but these often lack precision in 3D surface reconstruction and image registration. There is a need for improved systems that provide accurate, real-time integration of preoperative images with virtual graphics.

System Components

The disclosed system comprises a stereoscopic camera setup, which captures real-time 3D images of the patient's anatomy. These images are processed alongside preoperative or intraoperative data to create a composite view. The augmented reality is presented to the surgeon via a head-mounted display, enabling them to see both the internal and external structures in a unified view. The system allows for user interaction, such as adjusting transparency, color, and contrast of the images.

Functionality

The system enhances surgical precision by allowing real-time adjustments during surgery. It provides an augmented view where 3D volume images are displayed over live video, aligning with the surgeon's perspective. The system supports tracking of surgical instruments and implants, integrating these into the augmented view for better guidance. This setup facilitates dynamic interaction with the surgical environment, improving decision-making and outcomes.

Technical Implementation

The technology involves recording stereoscopic video using mounted cameras within the surgeon's field of view. Virtual graphics are superimposed on these recordings, offering a comprehensive visual guide during surgery. The system employs surface reconstruction techniques using 3D scanners to align preoperative images with live video feeds accurately. This approach eliminates the need for markers, providing flexibility and speed in image registration.