Segmentation and immersive visualization of brain lesions using deep learning and virtual reality
dc.contributor.author | Kelley, Brendan, author | |
dc.contributor.author | Plabst, Lucas, author | |
dc.contributor.author | Plabst, Lena, author | |
dc.contributor.author | ACM, publisher | |
dc.date.accessioned | 2025-03-13T18:31:29Z | |
dc.date.available | 2025-03-13T18:31:29Z | |
dc.date.issued | 2025-01-19 | |
dc.description.abstract | Magnetic resonance imaging (MRIs) are commonly used for diagnosing potential neurological disorders, however preparation and interpretation of MRI scans requires professional oversight. Additionally, MRIs are typically viewed as single cross sections of the affected regions which does not always capture the full picture of brain lesions and can be difficult to understand due to 2D's inherent abstraction of our 3D world. To address these challenges we propose a immersive visualization pipeline that combines deep learning image segmentation techniques using a VGG-16 model trained on MRI fluid attenuated inversion recovery (FLAIR) with virtual reality (VR) immersive analytics. Our visualization pipeline begins with our VGG-16 model predicting which regions of the brain are potentially affected by a disease. This output, along with the original scan, are then volumentrically rendered. These renders can then be viewed in VR using an head mounted display (HMD). Within the HMD users can move through the volumentric renderings to view the affected regions and utilize planes to view cross sections of the MRI scans. Our work provides a potential pipeline and tool for diagnosis and care. | |
dc.format.medium | born digital | |
dc.format.medium | articles | |
dc.identifier.bibliographicCitation | Brendan Kelley, Lucas Plabst, and Lena Plabst. 2024. Segmentation and Immersive Visualization of Brain Lesions Using Deep Learning and Virtual Reality. In The 19th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI 24), December 01 02, 2024, Nanjing, China. ACM, New York, NY, USA, 8 pages. https://doi.org/10.1145/3703619.3706035 | |
dc.identifier.doi | https://doi.org/10.1145/3703619.3706035 | |
dc.identifier.uri | https://hdl.handle.net/10217/240172 | |
dc.language | English | |
dc.language.iso | eng | |
dc.publisher | Colorado State University. Libraries | |
dc.relation.ispartof | Publications | |
dc.relation.ispartof | ACM DL Digital Library | |
dc.rights | ©Brendan Kelley, et al. ACM 2024. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in VRCAI 24, https://dx.doi.org/10.1145/3703619.3706035. | |
dc.subject | deep learning | |
dc.subject | image segmentation | |
dc.subject | medical imaging | |
dc.subject | medical applications | |
dc.subject | virtual reality | |
dc.subject | immersive analytics | |
dc.subject | immersive visualization | |
dc.title | Segmentation and immersive visualization of brain lesions using deep learning and virtual reality | |
dc.type | Text |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- FACF_ACMOA_3703619.3706035.pdf
- Size:
- 2.99 MB
- Format:
- Adobe Portable Document Format