AUGMENTED REALITY DISPLAY FOR FLUORESCENCE GUIDED SURGERY

Smart overview of the Invention

An innovative method and apparatus for real-time surgery is designed to provide a stereoscopic augmented view of a patient, enhancing the surgical experience for the surgeon. This system utilizes real-time three-dimensional surface reconstruction combined with preoperative and intraoperative image registration. Surgeons can view a graphical representation of anatomical structures alongside live video images through a see-through display, which aids in precise surgical navigation.

Challenges in Traditional Surgical Navigation

Surgeons traditionally face challenges when alternating between viewing the patient and monitors displaying anatomical information. This process requires mental mapping, which can be difficult and may lead to inaccuracies. Existing systems have been developed to integrate live video with computer-generated models of internal anatomy; however, these systems often struggle with precision and speed in image registration and surface reconstruction.

Enhanced Real-Time Surgical Navigation

The proposed system offers a solution by integrating a stereoscopic camera system that captures real-time images of the patient's target area. By determining location and orientation data in a common coordinate system, this system allows for seamless blending of 3D volume images with live video feeds. The augmented reality is presented through a head-mounted display, allowing surgeons to visualize both internal and external structures simultaneously during surgery.

User Interaction and Customization

Surgeons can interact with the displayed images in real time, adjusting parameters such as transparency, color, and contrast through an intuitive user interface, which may include gesture recognition. This customization enhances the usability of the system, enabling surgeons to modify their view based on specific surgical needs. The apparatus can operate independently for various tasks, ensuring flexibility in surgical procedures.

Integration of Preoperative Imaging

The system allows for the registration of preoperative images overlaid with virtual graphics within the surgeon's field of view. By utilizing 3D scanners for surface reconstruction and integrating these with preoperative CT or MR scans, accurate real-time positioning of internal anatomical structures is achieved. This capability facilitates better surgical planning and execution without relying on markers, thereby improving overall efficiency in surgical navigation.