2nd year PhD student in UW CSE.
Advised by Prof. Jon Froehlich at the Makeability Lab
My research interest lies in Human Computer Interaction, with special focus on Augemented Reality,
creativity support and accessibility.
I’m currently building interactive interfaces and systems (especially in AR) that assists people sense and modify their indoor spaces, in order to create a more accessible world for everyone. I also envision huge opportunity of creativity and productivity in physical spaces, and hope to develop context aware technologies to enable and enlighten people.
Here are some recent projects I lead/participate in UW CSE
May 2022 - Now, at UW CSE
Feb 2020 - Apr 2022, at UW CSE
Here are some recent publication produced by projects I lead/participate in UW CSE and Tsinghua
We introduce RASSAR (Room Accessibility and Safety Scanning in Augmented Reality), a new proof-of-concept prototype for semi-automatically identifying, categorizing, and localizing indoor accessibility and safety issues using LiDAR + camera data, machine learning, and AR. We present an overview of the current RASSAR prototype and a preliminary evaluation in a single home.PDF DOI
We present Kinergy—an interactive design tool for creating self propelled motion by harnessing the energy stored in 3D printable springs. Kinergy allows the user to create motion-enabled 3D models by embedding kinetic units, customize output motion characteristics by parameterizing embedded springs and kinematic elements, control energy by operating the specialized lock, and preview the resulting motion in an interactive environment.PDF
we present an exploration work of automating interior layout design. We put forward a set of representation rules which turn interior scene photos into structuralized scene graphs. With representation rule containing both categorial and spatial information, we establish an interior scene graph dataset by annotating well-designed interior scene pictures downloaded from online photo sharing sites. Using the interior scene dataset which contains over 400 valid interior scene graphs, we train a graph generative model and further render its output as reconstructed scenes.PDF DOI
We introduce an interactive evolutionary computation (IEC) design experiment that deals with a simplified interior design task and has already been tested on 230 subjects. Using the data gathered during the experiment, we conduct data analysis and visualization involving methods including Holistic color interval and K-means clustering to show categories and processes in design. Additionally, we train a content-based recommendation system with experiment data to capture user preference and make the IEC system more efficient and intelligent.PDF DOI
In this study, new data structure of command-object graph retrieved from 3D modeling event logs was proposed. It reflects the cause-and-effect relationship between commands and objects to accommodate 3D modeling process. A case study was conducted on 110 students' event logs generated from solving a well-defined façade model. As result: an average trial-and-error ratio was calculated at 0.3357 based on original and simplified graphs. Four main types of ‘modeling bubble’ were summarized base on unit-tag graphs. Key commands were found by graph centrality. Auto-prediction of samegroup objects was developed with mis-group rate less than 0.9%.PDF DOI
185 E Stevens Way NE, Seattle, WA 98195
HCI PhD student in UW CSE. Does AR+Accessibility+Creativity research