| abstract |
A system and method is disclosed for augmenting image data of an invasive medical device using optical imaging. An optical imaging sensor, separate from the invasive medical device, can generate images of the medical device within a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with orientation and distance information of the invasive medical device. An imaging computer system can apply the trained model to images of the invasive medical device within the patient to determine a current orientation and a current distance of the invasive medical device. The images of the invasive medical device as captured by the optical imaging sensor, visual orientation information representing the current orientation of the invasive medical device, and visual distance information representing the current distance of the invasive medical device within the patient can be displayed. |