HCII PhD Thesis Defense: Stephanie Valencia Valencia
When
-
Description
Agency in Augmentative and Alternative Communication
**HYBRID EVENT**
Stephanie Valencia Valencia
HCII Ph.D. Thesis Defense
Time and Location:
NSH 3305 and Streaming via Zoom
Monday, July 10th, 10:00am-11:30am (EDT)
Meeting ID: 937 7553 0327
Passcode: 978479
Thesis Committee:
Jeff Bigham (Co-Chair, HCII, CMU)
Henny Admoni (Co-Chair, RI, HCII,CMU)
Jodi Forlizzi (HCII, CMU)
Jeff Higginbotham (Communicative Disorders and Sciences, State University of New York at Buffalo)
Abstract:
Augmentative and alternative communication (AAC) devices enable speech-based communication when people cannot use their own physical voice to speak. Speech-generating AAC devices include specialized keyboards and interfaces designed to support individuals in message composition and speech synthesis. Composing a message with an AAC device can take more time than using verbal speech which poses social interaction challenges to AAC users. Augmented communicators (ACs) often fall behind in group conversations when topics move fast or only get asked yes/no questions instead of open-ended ones, limiting the AC’s possible responses. While focusing on improving the rate at which AAC users can communicate and increasing ease to vocabulary access have been an important focus of the field of designing for AAC, this dissertation presents and argues for conversational agency as a new research and design frame to study AAC technology and AAC-based interactions among disabled and non-disabled individuals.
Conversational agency considers conversational constraints such as when AAC users can speak, what they can say, and who they can address. The first part of this dissertation presents metrics to measure how conversational agency is expressed within constraints specific to AAC-based interaction. Using agency as a lens for AAC research uncovered new design opportunities for AAC systems that center AAC users’ personal conversational goals. The second part of this thesis explored technologies that can help balance participation in a group and signal to partners that an AC is still making use of their turn to address social constraints related to managing attention and conversational dynamics. The third part of this dissertation explores technologies that can retrieve content from a conversation and clarify misunderstandings to provide ACs with more control over the content of a conversation and the relevance of their messages. Through empirical studies, co-design, participatory design, and the development and deployment of different systems, this dissertation investigates how different design materials, such as expressive customized robots and Large Language Models, can support AAC users in easily exercising their conversational agency and help non-AAC users become better communication partners.
Thesis Document (draft): https://drive.google.com/file/d/1MCIqmO2eyH8WbJKe6QAkBksfqkDjRLPh/view?…
Speaker's Bio
More information as the event nears.