AR System Enables Free-Hand, Real-Time Needle Guidance for Prostate Cancer Diagnosis
By MedImaging International staff writers Posted on 06 Mar 2023 |

Prostate cancer is the second most common cause of cancer-related deaths among men, according to the US Centers for Disease Control and Prevention. Transperineal (TP) biopsy is one of the conventional methods used for diagnosing and treating prostate cancer by collecting tissue samples through a needle inserted through the perineum wall. TP biopsy typically involves a pre-operation MRI scan and a transrectal ultrasound, with the images combined and displayed on a monitor for the urologist to visualize. The urologist can perform the needle insertion process free-hand or through a grid-based method. However, 2D visualization of a 3D region can make the needle's guidance and visualization a challenging task.
To address this issue, researchers from the US National Institutes of Health (NIH, Bethesda, MD, USA) have proposed an approach based on an augmented reality (AR) system called HoloLens. In their recent paper published in the Journal of Medical Imaging, the researchers have detailed their successful HoloLens AR system that accurately and effectively projects MRI and ultrasound images onto patients, helping to guide a needle to the target. The HoloLens AR system employs a volumetric 3D scan, like an MRI scan, to create an accurate view of the patient. Leveraging reference data from the patient, the MRI scan can be superimposed precisely onto the patient. The superimposed image is fed into the HoloLens goggles worn by the urologist and enables viewing the patient as well as the MRI of the patient in proper alignment. The HoloLens goggles also enable the urologist to view the image at different angles by moving the head. HoloLens can also display the pre-planned needle path on the patient, the target tissue of the prostate, and the real-time needle position during the procedure.
To evaluate their AR system's image overlay accuracy and needle targeting precision, the researchers utilized a 3D-printed phantom. They used the free-hand as well as planned-path guidance methods to guide needles into a gel phantom, and subsequently recorded the needle placement errors. The system was also used to deliver soft tissue markers onto tumors of a human pelvis phantom. The researchers found similar placement errors associated with both free-hand and planned-path guidance methods. Moreover, all implanted soft tissue markers were inside or in close proximity to the tumors.
“The current methods have certain limitations to them,” said Dr. Ming Li from the NIH who led the research. “Robot-assisted guidance is costly and adds procedural time, while other methods require a certain path for the needle that leaves out the outer reaches of the prostate. These problems are solved using the HoloLens AR system, which provides the doctor with the ability to use a free-hand approach.”
“The HoloLens has the potential to provide more flexibility than the current grid-based TP methods and can do so accurately,” highlighted Li. “By providing a 3D immersive experience, the HoloLens AR system makes free-hand lesion targeting feasible. As needle procedures move from rectum to the perineum, AR systems could provide great clinical value to doctors and patients by solving the problems associated with prostate intervention procedures.”
Related Links:
NIH
Latest MRI News
- PET/MRI Improves Diagnostic Accuracy for Prostate Cancer Patients
- Next Generation MR-Guided Focused Ultrasound Ushers In Future of Incisionless Neurosurgery
- Two-Part MRI Scan Detects Prostate Cancer More Quickly without Compromising Diagnostic Quality
- World’s Most Powerful MRI Machine Images Living Brain with Unrivaled Clarity
- New Whole-Body Imaging Technology Makes It Possible to View Inflammation on MRI Scan
- Combining Prostate MRI with Blood Test Can Avoid Unnecessary Prostate Biopsies
- New Treatment Combines MRI and Ultrasound to Control Prostate Cancer without Serious Side Effects
- MRI Improves Diagnosis and Treatment of Prostate Cancer
- Combined PET-MRI Scan Improves Treatment for Early Breast Cancer Patients
- 4D MRI Could Improve Clinical Assessment of Heart Blood Flow Abnormalities
- MRI-Guided Focused Ultrasound Therapy Shows Promise in Treating Prostate Cancer
- AI-Based MRI Tool Outperforms Current Brain Tumor Diagnosis Methods
- DW-MRI Lights up Small Ovarian Lesions like Light Bulbs
- Abbreviated Breast MRI Effective for High-Risk Screening without Compromising Diagnostic Accuracy
- New MRI Method Detects Alzheimer’s Earlier in People without Clinical Signs
- MRI Monitoring Reduces Mortality in Women at High Risk of BRCA1 Breast Cancer
Channels
Radiography
view channel
Novel Breast Imaging System Proves As Effective As Mammography
Breast cancer remains the most frequently diagnosed cancer among women. It is projected that one in eight women will be diagnosed with breast cancer during her lifetime, and one in 42 women who turn 50... Read more
AI Assistance Improves Breast-Cancer Screening by Reducing False Positives
Radiologists typically detect one case of cancer for every 200 mammograms reviewed. However, these evaluations often result in false positives, leading to unnecessary patient recalls for additional testing,... Read moreMRI
view channel
PET/MRI Improves Diagnostic Accuracy for Prostate Cancer Patients
The Prostate Imaging Reporting and Data System (PI-RADS) is a five-point scale to assess potential prostate cancer in MR images. PI-RADS category 3 which offers an unclear suggestion of clinically significant... Read more
Next Generation MR-Guided Focused Ultrasound Ushers In Future of Incisionless Neurosurgery
Essential tremor, often called familial, idiopathic, or benign tremor, leads to uncontrollable shaking that significantly affects a person’s life. When traditional medications do not alleviate symptoms,... Read more
Two-Part MRI Scan Detects Prostate Cancer More Quickly without Compromising Diagnostic Quality
Prostate cancer ranks as the most prevalent cancer among men. Over the last decade, the introduction of MRI scans has significantly transformed the diagnosis process, marking the most substantial advancement... Read moreUltrasound
view channel
Deep Learning Advances Super-Resolution Ultrasound Imaging
Ultrasound localization microscopy (ULM) is an advanced imaging technique that offers high-resolution visualization of microvascular structures. It employs microbubbles, FDA-approved contrast agents, injected... Read more
Novel Ultrasound-Launched Targeted Nanoparticle Eliminates Biofilm and Bacterial Infection
Biofilms, formed by bacteria aggregating into dense communities for protection against harsh environmental conditions, are a significant contributor to various infectious diseases. Biofilms frequently... Read moreNuclear Medicine
view channel
New SPECT/CT Technique Could Change Imaging Practices and Increase Patient Access
The development of lead-212 (212Pb)-PSMA–based targeted alpha therapy (TAT) is garnering significant interest in treating patients with metastatic castration-resistant prostate cancer. The imaging of 212Pb,... Read more
New Radiotheranostic System Detects and Treats Ovarian Cancer Noninvasively
Ovarian cancer is the most lethal gynecological cancer, with less than a 30% five-year survival rate for those diagnosed in late stages. Despite surgery and platinum-based chemotherapy being the standard... Read more
AI System Automatically and Reliably Detects Cardiac Amyloidosis Using Scintigraphy Imaging
Cardiac amyloidosis, a condition characterized by the buildup of abnormal protein deposits (amyloids) in the heart muscle, severely affects heart function and can lead to heart failure or death without... Read moreGeneral/Advanced Imaging
view channel
New AI Method Captures Uncertainty in Medical Images
In the field of biomedicine, segmentation is the process of annotating pixels from an important structure in medical images, such as organs or cells. Artificial Intelligence (AI) models are utilized to... Read more.jpg)
CT Coronary Angiography Reduces Need for Invasive Tests to Diagnose Coronary Artery Disease
Coronary artery disease (CAD), one of the leading causes of death worldwide, involves the narrowing of coronary arteries due to atherosclerosis, resulting in insufficient blood flow to the heart muscle.... Read more
Novel Blood Test Could Reduce Need for PET Imaging of Patients with Alzheimer’s
Alzheimer's disease (AD), a condition marked by cognitive decline and the presence of beta-amyloid (Aβ) plaques and neurofibrillary tangles in the brain, poses diagnostic challenges. Amyloid positron emission... Read more.jpg)
CT-Based Deep Learning Algorithm Accurately Differentiates Benign From Malignant Vertebral Fractures
The rise in the aging population is expected to result in a corresponding increase in the prevalence of vertebral fractures which can cause back pain or neurologic compromise, leading to impaired function... Read moreImaging IT
view channel
New Google Cloud Medical Imaging Suite Makes Imaging Healthcare Data More Accessible
Medical imaging is a critical tool used to diagnose patients, and there are billions of medical images scanned globally each year. Imaging data accounts for about 90% of all healthcare data1 and, until... Read more
Global AI in Medical Diagnostics Market to Be Driven by Demand for Image Recognition in Radiology
The global artificial intelligence (AI) in medical diagnostics market is expanding with early disease detection being one of its key applications and image recognition becoming a compelling consumer proposition... Read moreIndustry News
view channel
Bayer and Google Partner on New AI Product for Radiologists
Medical imaging data comprises around 90% of all healthcare data, and it is a highly complex and rich clinical data modality and serves as a vital tool for diagnosing patients. Each year, billions of medical... Read more