Projects

We introduce Ponify, a sonification method that translates a painting’s sense of dynamics into music through pose analysis. Ponify analyzes the limb movements of human figures in paintings and configures musical parameters such as the tempo and density to convey dynamic perceptions.

This article introduces Designatomy, a novel approach to guide technology-driven design approaches to tech-novice design students. This method employs a taxonomy framework as a foundational thinking strategy, encouraging students to independently explore and comprehend design features shaped by new technologies.

This paper envisions generative Artificial Intelligence (AI) and eXtended Reality (XR) as means to better novices in adopting dual roles as designers and users while personalizing 3D products. A generative design study with 24 participants in their homes examined how novices think and act while designing personal products.

This study investigates how XR interactions enhance museum knowledge delivery by analyzing 737 exhibit commentaries, interviewing curators to identify communication challenges, and proposing XR design strategies that incorporate situated visualization, spatio-temporal interaction, and participatory embodiment for richer visitor experiences.

This study proposes a desktop robot companion, Roby, that monitors workers’ behaviors to provide real-time interactive feedback to increase productivity and to enhance the WFH experience.

ShapeloreVR is proposed, which utilizes everyday objects and basic primitives in a VR design playground so that non-experts can quickly interact with, merge, modify, and generate desired 3D shapes while brainstorming.

We propose a generative design workflow that integrates a stochastic multi-agent simulation with the intent of helping building designers reduce the risk posed by COVID-19 and future pathogens.

We propose OccSim, a system that automatically generates occupancy behaviours in a 3D model of a building and helps users analyze the potential effect of virus transmission from a large-scale and longitudinal perspective.

To better understand how workplace design shapes social interactions, we ran an empirical study in an office context over a two week period. Based on the data, we discuss dynamics of socio-spatial formations and how this knowledge can support social interactions in the domain of space design systems and interactive interiors.

We investigated how office interior layouts influence the way we socially experience office buildings. Using the real-world vision data, we propose the concepts of socio-spatial comfort: social buffers, privacy buffers, and varying proxemics to inform a user-centered way of designing human building interactions and architecture.

We designed a Skeletonographer is an online tool that supports digital ethnographic studies using anonymous skeletonized representations of human bodies. Users can play back and annotate skeleton data similar to a video analysis tool.

We introduceSmartManikin, a mannequin with agency that responds to high-level commands and to real-time design changes. The SmartManikin's pose is generated by the predicted features as well as by using forward and inverse kinematics.

We performed a Wizard of Oz study to find the best timing for changing desk height to minimize interruption and discomfort. The results are in line with prior work on task interruption in graphical user interfaces and show that the table should change height during a task change.

We developed situated and interactive guidelines to assist users in design applications. We applied these guidelines in a Virtual Reality (VR) system that lets users customize their desk and provides real-time feedback and feedforward on pose and design.

We developed situated and interactive guidelines to assist users in design applications. We applied these guidelines in a Virtual Reality (VR) system that lets users customize their desk and provides real-time feedback and feedforward on pose and design.

We developed situated and interactive guidelines to assist users in design applications. We applied these guidelines in a Virtual Reality (VR) system that lets users customize their desk and provides real-time feedback and feedforward on pose and design.

We extend the research on digital gastronomy by using digital fabrication to create custom tools that assist the process of cooking. We present the iterative process of designing the “Ori-mandu” system, and how Ori-mandu enables users to fabricate dumplings in whatever shape they want.