VISIE

ICS Teams with VISIE to Showcase Advanced Spatial Computing Technology for Robotic Surgery

VISIE is poised to revolutionize robotic surgery with its cutting-edge 3D spatial computing technology. The team’s deep-tech optical platform provides exceptional precision — over 10 times more accurate than current industry standards — designed to enable robotic-assisted systems to visualize anatomy in 3D detail and in real-time, just like surgeons do when they look at their patients. Whereas robots currently require invasive pins and time-consuming registration based on 30-40 points to track anatomy, VISIE's platform captures detailed, high-resolution 3D  images that dynamically re-register hundreds of thousands of points every second. 

To attract partners in the medical device industry, VISIE needed a powerful demo to showcase its transformative technology. The team turned to Integrated Computer Solutions (ICS) for Qt development and UI design that would bring VISIE’s high-resolution scans to life, highlighting the clarity and precision that set their system apart.

THE CHALLENGE

Designing for Precision: Perfecting 3D Imagery Across Diverse Screen Sizes

While there were many obstacles, the biggest design challenge ICS faced was ensuring that VISIE’s ultra-high-definition 3D images would look perfect on both small, low-resolution medical device screens and large 50-inch 4K TVs. 

Our design team tackled this Herculean task by developing a UI that would seamlessly display complex 3D point clouds with pixel-perfect clarity, even when viewed on drastically different screen sizes. This required careful attention to scaling, resolution and layout to ensure that the visual fidelity would remain uncompromised, even when transitioning between different screen sizes.

THE SOLUTION

Real-Time 3D Scanning and CAAT Integration

While ensuring image clarity was a significant design hurdle, another pressing challenge came when VISIE developed its Continuous Anatomic  Auto Tracking (CAAT) technology — a groundbreaking feature that allows  dynamic tracking of anatomy without the need for re-calibration. This  innovation required that ICS completely overhaul the tech stack to  support the streaming and visualization of 3D scans in real-time.

Specifically, we adjusted our approach to rendering 3D scans, leveraging PySide6 and  Qt 6.5 to create a bridge between VISIE’s backend and the QML interface  to allow for dynamic, real-time visualizations. Additionally, we updated the UI to support the new CAAT-enabled system; developed scalable  network architecture to handle 3D point cloud data and live transforms;  and created custom QML components for seamless data rendering.

Raising the Bar: Redefining Knee Surgery Visualization with CAAT

Impressed with the original demo ICS created, VISIE again leaned on us  when they were ready to publicly unveil CAAT. Their ask: two additional  demos, this time specifically geared toward knee replacement surgery.  One demo would show convincingly how CAAT can be used to calculate  gapping between a patient’s femur and tibia when the knee is manipulated into various positions during surgery, while the other demo would  present how CAAT analyzes the movement of the femur to calculate the  center of the leg movement at the hip. The goal was to highlight the  tracking capabilities of the CAAT technology in a most compelling way,  and spotlight its advanced features in real-time.

THE RESULT

Showcasing the Full Potential of VISIE’s Transformative Technology

These demos did more than explain the technology — they brought VISIE’s  CAAT to life with an experience that has enthralled prospective medical  device partners, helping solidify VISIE’s position as a trailblazer in  robotic surgery. Working on an accelerated timeline, our team helped  VISIE deliver a series of visually stunning demos that persuasively  demonstrates the full potential of the transformative technology.