| abstract |
A computer assisted system is disclosed that includes an optical tracking system. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted surgical system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, register pre-operative and/or intra-operative data to the color images using the fiducial locations, and generate an augmented reality (AR) image of the environment by overlaying the data over the color image. The computer assisted surgical system can further include a monitor or a head-mounted display (HMD) configured to present the AR image. |