There is significant progress and opportunity in integrating 3D+ imaging sensors—such as LiDAR, ultrasound, and mm-wave radar—into Augmented Reality (AR) systems to enhance human vision. AR technology is rapidly advancing across various sectors, aiming to augment human senses and improve performance. When paired with 3D+ imaging sensors, AR systems can bridge gaps in the human visual system by providing precise environmental mapping, which is critical for applications demanding high spatial awareness, accurate visualization, and real-time interactive overlays.

This paper reviews the current state of AR integration with 3D+ imaging sensors, focusing on applications in safety-critical domains such as vehicle navigation, industrial environments, and medical interventions. Key use cases include improved situational awareness for night driving, enhanced operator safety in factory settings, and navigation aids for high-speed crafts. AR's potential for life-saving applications is also explored, such as through-smoke path visualization for emergency evacuations and under-rubble person detection during rescue operations. Additionally, AR systems coupled with these sensors show promise in real-time medical diagnostics and training, where enhanced sensory feedback can significantly aid professionals.

The paper also analyzes the ethical considerations and trade-offs in AR systems as we consider future advancements. Our proposals include multisensory data fusion and more intuitive interface designs aimed at improving accessibility and safety. By integrating 3D+ imaging sensors, AR has the transformative potential to enhance human-environment interactions, improve workplace safety and productivity, and broaden accessibility across diverse demographics.


Access paper here: https://docs.google.com/document/d/1j9Lo2HtZIrPRtxWuONqhBoOQoh_-M6XcSWU8m1HjgIs/edit?usp=sharing



This is a literature review paper on the current state of AR integration with 3D+ imaging sensors, focusing on applications in safety-critical domains such as vehicle navigation, industrial environments, and medical interventions.

Significant advancements in integrating 3D+ imaging sensors like LiDAR and ultrasound with Augmented Reality (AR) are enhancing human vision in safety-critical areas such as vehicle navigation, industrial environments, and medical interventions. Key applications include improved situational awareness for night driving, operator safety in factories, and navigation aids for high-speed crafts. The paper also discusses ethical considerations and proposes multisensory data fusion and intuitive interface designs to enhance accessibility and safety, highlighting AR's potential to transform human-environment interactions and improve workplace productivity.