Computational Representations for User Interfaces
Yue Jiang (Aalto University)
Colloquium
Monday, March 17, 2025, 3:30 pm
Gates Center - Zillow Commons
Abstract
Traditional “one-size-fits-all” user interfaces (UIs) often fail to provide the necessary adaptability, leading to challenges in accommodating varying contexts and enhancing user capabilities. This talk explores my research on developing intelligent UIs that bridge the
gap between static design and dynamic user engagement. My research focuses on facilitating the creation of intelligent UIs that support two key areas: assisting designers in building adaptive systems and capturing user behaviors to enable automatic interface
adaptation. In this talk, I will focus on how to develop computational representations that embed domain-specific knowledge into AI models, providing intelligent suggestions while ensuring that designers maintain control over the design process. Additionally,
I will discuss how to develop neural models that simulate and predict user behaviors, such as gaze movement on UIs, aligning interactions with users' unique abilities and preferences.
BIO
Yue Jiang is a final-year Ph.D. student supervised by Prof. Antti Oulasvirta at Aalto University and the Finnish Center for AI in Finland. She earned her Master’s degree from the University of Maryland, College Park, USA, and her Bachelor’s degree in Computer Science and Mathematics from the University of Toronto, Canada. Her research focuses on computational user interface understanding, with specific interests in generating adaptive UIs for diverse users and contexts, AI-assisted design, and modeling human behaviors. She has published in top venues for Human-Computer Interaction and Computer Vision, including CHI, UIST, and CVPR. She initiated and served as the main organizer of the Computational UI workshops at CHI four times from 2022 to 2025 and co-organized the Mobile Eye-based Interaction Workshop at ETRA. Additionally, she was the Accessibility Chair for CHI 2023 and CHI 2024, served as an Associate Chair for CHI 2025, and was a jury member for the CHI 2023 Workshop Proposals and the ASSETS 2024 Experience Reports. She has received the Meta Research PhD Fellowship, the Google Europe Scholarship for Students with Disabilities, and a Nokia Scholarship. She was also selected as a Heidelberg Laureate Forum Young Researcher and a UCSD Data Science Rising Star. She has worked or interned at Intel, Adobe Research, Apple, and the Max Planck Institute, and was a visiting Ph.D. student at Carnegie Mellon University. More information can be found on her website: https://yuejiang-nj.github.io/.