CMU logo
Expand Menu
Close Menu

AR / VR / XR

Augmented Reality (AR) / Virtual Reality (VR) / Extended Reality (XR)

Extended Reality (XR) technologies represent a paradigm shift in computing, enabling users to interact with the digital world seamlessly and effortlessly. HCII works are the forefront of this interdisciplinary research area, and contribute to key factors such as: understanding and modeling human behavior when interacting with XR, creating novel multi modal interactive devices and sensors, adaptive XR systems, and leveraging the technology for applications such as productivity, healthcare, manufacturing, or entertainment. 

We work closely with campus-wide initiatives such as the CMU Extended Reality Technology Center (XRTC), the Entertainment Technology Center (ETC), and the Center for Transformational Play (CTP).

  • Vivian facilitating a demo at UIST 2023. [This image is from the official ACM UIST photo album]

    HCII at UIST 2023


    The 2023 ACM Symposium on User Interface Software and Technology (UIST) was held in San Francisco, California from October 29 to November 1, 2023. ...

  • Virtual, augmented and other extended reality technologies could transform health care, education, entertainment, communication and more. CMU has launched its Extended Reality Technology Center (XRTC) to bring together researchers, industry and consumers to maximize the field's potential.

    Carnegie Mellon University's XRTC Will Drive Research into VR, AR Innovations


    Virtual, augmented and other extended reality technologies present the possibility to transform health care, education, entertainment, communication and more....

  • Scenario of a user working with the RealityReplay system with side by side views of the environment with and without RealityReplay



    Humans easily miss events in their surroundings due to limited short-term memory and field of view. This happens, for example, while watching an instructo...

  • A grid of six images showing different VR environments (street, museum, supermarket) and different types of navigation instructions (arrows on ground, avatar, call outs).

    User Preference for Navigation Instructions in Mixed Reality


    Current solutions for providing navigation instructions to users who are walking are mostly limited to 2D maps on smartphones and voice-based instructions...

  • Screenshots of two examples of Diminished Reality. One shows two side-by-side images of a desk with a computer, mouse, keyboard and decorative object on one side, and the same desk with all objects but the decorative object faded out. The other image shows a shelf with books on one side, and a shelf with all but one book faded out.

    Towards Understanding Diminished Reality


    Diminished reality (DR) refers to the concept of removing content from a user's visual environment. While its implementation is becoming feasible, it is s...

  • UML-style workflow diagram of system. A Mixed Reality layout is generated by users, and an automatic system the adapts its positioning.



    We present an optimization-based approach that automatically adapts Mixed Reality (MR) interfaces to different physical environments. Current MR layouts, ...

  • A team of CMU students is part of the 2022 NASA Spacesuit User Interface Technologies for Students (SUITS) Challenge, which aims to incorporate an augmented reality interface in the agency's next generation of space suits.

    Moon Buddy Team Working With NASA on Spacesuits for Lunar Exploration


    Students working on Carnegie Mellon University's Moon Buddy likely will not walk on the lunar surface as part of NASA's upcoming Artemis missions. But their technology could make its way i...