
RealityReplay
Humans easily miss events in their surroundings due to limited short-term memory and field of view. This happens, for example, while watching an instructo...
Audio Emotion Recognition
We have built an emotion recognition system based on prosodic features (i.e. intensity, pitch, formant frequencies of sounds) combined with short-term per...
Daniel Siewiorek
Virtual Rehabilitation Assistants (VRAs)
VRAs are applications of wearable devices which track patient home exercises in order to quantify exercise metrics regarding compliance, performance, and ...
Daniel Siewiorek
Virtual Coach for Stroke Rehabilitation Therapy
This Virtual Coach evaluates and offers corrections and feedback for rehabilitation of stroke survivors. The Virtual Coach is composed of a tablet for cli...
Daniel Siewiorek
Seating Coach
The goal of Seating Coach (SC) is to facilitate power wheelchair users to utilize auxiliary seating functions for health management while preventing poten...
Daniel Siewiorek
Health Kiosk
Our contention is that multi-user health kiosks, designed with input from older adults and situated in convenient community locations, offer a way to bols...
Daniel Siewiorek
Connection Machines
Our Connection Machines project investigates nonverbal and verbal behaviors of two partners in a conversation setting in the context of rapport. We have c...
Justine Cassell,
Supporting Opportunistic Groups
This project is focused on tools, techniques and applications that support the opportunistic grouping of devices and/or users. This includes support for c...
Enabling Technologies
Sensor Data Mining and Wearable UI/UX
Our research in sensors and machine learning techniques seeks to improve HCI experience by developing objective and near real-time methods for recognizing...
Seniors and Quality of Life Technology
We address quality of life issues for seniors who have difficulty interacting with virtual information spaces. We lead projects to improve safe driving th...
Jodi Forlizzi,
Predicting User Mobility Patterns
By modeling the temporal and spatial movements of individuals, we can predict how long they will stay in their current location and where they will transi...
Enabling Technologies
Phenom
Our goals with Phenom are to (a) integrate various sources of data about us (e.g. call logs, contact lists, location data), and (b) offer an underlying pr...
Enabling Technologies
Multisensory Interactions/Sensory Augmentation Systems
We employ theories related to executive control of our working memory (e.g., cognitive load theory) and differentiation of resource capacity according to ...
Enabling Technologies
Modeling the Impact of System Response Delays on User State
In the early days of computing, there was a great deal of research into how system response times impacted user experiences. However, the text-based syste...
Daniel Siewiorek,
Enabling Technologies
In Situ Imaging
Our objective is to permit in situ visualization of medical images so that direct hand-eye coordination can be employed during invasive procedures. A meth...
Enabling Technologies

Lumitrack
Movement is one of the fundamental ways we interact with the world around us. We can configure our limbs and bodies into innumerable poses, locomote aroun...
Scott Hudson
Enabling Technologies
Scalable Cognitive Modeling Through Compositional Reuse
Cognitive modeling can scale affordably, and be routinely and efficiently applied to large complex tasks, only if it becomes an exercise of composing new ...
Bonnie John
Enabling Technologies
Pebbles
The Pebbles project is exploring how Personal Digital Assistants (PDAs), such as the Palm Handheld or a device running the Microsoft Windows CE or Pocket ...
Brad Myers
Enabling Technologies
Usability and Software Architecture
The usability analyses or user test data are in; the development team is poised to respond. When the usability problems are presented, someone around the ...
Len Bass
Enabling Technologies
Natural Programming
The goal of the Natural Programming project is to make computer programming more accessible to novice, professional and end-user programmers. We are inves...
Brad Myers,
Enabling Technologies

Sonic Flashlight
Our objective is to permit in situ visualization of ultrasound images so that direct hand-eye coordination can be employed during invasive procedures. A m...
Roberta Klatzky
Enabling Technologies
Leveraging Human Knowledge to Improve Learning
We are interested in understanding what a machine learning system could ask a user to improve its performance and when it is appropriate to ask the user. ...
Enabling Technologies
Intelligiblity of Context-Aware Applications
Applications that behave proactively on a user’s behalf, particularly those that react to implicit user context, need to be intelligible to end users, exp...
Enabling Technologies
Informedia Digital Video Library
Informedia is applying automated video and audio indexing and video portal development in support of oral history collections, based on pioneering work re...
Enabling Technologies

End-User Programming of Context-Aware Systems
Context-aware systems adapt to users’ context of use. We are investigating novel interaction techniques to support end-users in building their own context...
Enabling Technologies
Building Virtual Worlds
Building Virtual Worlds is not only taught to encourage working with other disciplines, but also is an experience with tools and process. Students use the...
Enabling Technologies

Expanding the 3D Interaction Lexicon
Much of the research on 3D interaction, particularly for immersive virtual environments, focuses on emulating the real world. Emulating the real world is ...
Enabling Technologies
User-Controllable Privacy and Security for Pervasive Computing
Currently, it is hard to manage privacy and security in mobile and pervasive computing environments, both for system administrators and end-users. We are ...
Marmite: End User Programming for the Web
The goal of Marmite is to make it easy to create "mashups" that combine content from multiple web sites and web services. Marmite lets end-users extract c...
Jason Hong