Projects

Interaction
Application
Method
Recognition
PoseMate: AI-Generated Socially Driven Pose Guidance for Gen Z Photo-Taking Gen Z photo AI social pose intelligence privacy-aware guidance trend-driven UX
PoseMate explores how AI can support Gen Z photo-taking by turning socially shared pose trends into controllable, privacy-aware guidance. Rather than recommending a universal best pose, it helps users build meaningful reference sets from filtered social media photos and translate recurring pose patterns into interpretable prompts.
PoseMate: AI-Generated Socially Driven Pose Guidance for Gen Z Photo-Taking

PoseMate project page: Archives of Design Research (AoDR) 2026 paper on AI-generated socially driven pose guidance for Gen Z photo-taking by Nur Izzatty Binti Mohamad Jamal and Bokyung Lee.

DanXeReflect: Bring Videos into XR Studio for Reflective Choreographic Collaboration XR choreography studio embodied reflection pose-based search creative collaboration
We introduce DanXeReflect, an XR system that transforms rehearsal videos into interactive dance studio for embodied and reflective choreography making. The system enables dancers to explore and communicate feedback through pose-based search, embodied revision, and body-anchored annotation.
TwistLens: Anticipation-Preserving Image Previews for Museum Experiences anticipation-preserving AI museum preview design semantic image transformation curiosity-driven UX
TwistLens creates docent-informed, semantically transformed artwork previews that preserve anticipation before museum visits. By combining an information taxonomy with EchoLens and DecoyLens strategies, it turns previews into cues for curiosity, interpretation, and later discovery.
TwistLens: Anticipation-Preserving Image Previews for Museum Experiences

TwistLens project page: CHI 2026 paper on anticipation-preserving, docent-informed image previews for museum experiences by Thao Phuong Vu and Bokyung Lee.

PARASCENT: Motion‑based Parametric Viz to Digitally Communicate Perfume Scents scent visualization motion-based fragrance parametric branding sensory UX
We introduce ParaScent, a parametric visualization toolkit that translates perfume attributes into motion-based visuals. By mapping scent qualities such as intensity, diffusion, and longevity to animated parameters, the system enables intuitive understanding of fragrances in digital environments.
PONIFY: Pose-based Painting Sonification for Empathetic Musical Artwork Perception AI art listening pose-based sonification empathetic music UX cultural computing
We introduce Ponify, a sonification method that translates the perceived dynamics of paintings into music through pose analysis. By extracting limb movements from human figures in artworks, Ponify maps visual motion cues to musical parameters such as tempo and density.
DESIGNATOMY: Tech-Driven Rapid Ideation Pedagogy for Tech-Novice Design Students technology-driven ideation design pedagogy taxonomy for creativity tech-novice innovation
We introduce Designatomy, a taxonomy-driven design pedagogy that helps technology-novice students generate technology-inspired design ideas. The approach structures technological features into conceptual categories that support systematic ideation.
Design Implications of Generative AI and XR Interactions for 3D Product Design Tools generative AI + XR novice 3D design user-designer mindset future design tools
This paper envisions generative AI and XR as means to better novices in adopting dual roles as designers and users while personalizing 3D products. A generative design study in their homes examined how novices think and act while designing personal products.
Design Implications of Interactive XR Docent for Situated Knowledge Delivery in Museums XR museum learning situated knowledge interactive docent cultural AI
We investigate how XR-based interactive docents can enhance knowledge delivery in museum exhibitions. Through large-scale exhibit commentary analysis and curator interviews, we identify interaction strategies for situated museum learning.
ROBY: Work Companion Robot for Work-From-Home Productivity and Experience work companion robot WFH productivity behavior-aware feedback physical AI
We introduce Roby, a desktop companion robot that supports productivity in work-from-home environments. By monitoring user behavior and providing real-time feedback, Roby encourages focused work routines.
Shaplore: Using Everyday Objects in VR Shape Ideation Tools for Novice Artists VR shape ideation everyday-object creativity novice 3D making immersive design tools
We introduce ShapeloreVR, a VR design playground that helps novice artists explore 3D form creation using everyday objects and primitives. The system supports intuitive experimentation with geometric shapes in immersive environments.
Generative Multi-Agent Simulation to Design Pathogen-Resilient Spaces generative space design pathogen-resilient architecture multi-agent AI simulation-driven planning
We propose a generative design workflow that integrates multi-agent simulation to evaluate infection risks in architectural layouts. The system helps designers explore spatial strategies that reduce pathogen transmission.
OCCSIM: Multi-Agent Occupant Simulation to Support Pandemic-Aware Space Planning multi-agent simulation pandemic-aware planning digital twin risk-aware space UX
We introduce OccSim, a multi-agent occupant simulation system that models human movement and interactions in buildings. It enables designers to analyze spatial layouts and evaluate potential virus transmission scenarios.
Socio-Spatial Interaction Patterns in Collaborative Offices workplace analytics socio-spatial intelligence computer vision collaboration design
To better understand how workplace design shapes social interactions, we ran an empirical study in an office context over a two week period. Based on the data, we discuss dynamics of socio-spatial formations and how this knowledge can support social interactions in the domain of space design systems and interactive interiors.
Socio-Spatial Comfort: Vision-based Analysis for User-Centred Human-Building Interactions human-building interaction spatial comfort analytics vision-based UX smart workplace
We investigated how office interior layouts influence the way we socially experience office buildings. Using the real-world vision data, we propose the concepts of socio-spatial comfort: social buffers, privacy buffers, and varying proxemics to inform a user-centered way of designing human building interactions and architecture.
SKELETONOGRAPHER: Skeleton-based Digital Ethnography Tool privacy-preserving vision skeleton data digital ethnography activity analytics
We designed a Skeletonographer is an online tool that supports digital ethnographic studies using anonymous skeletonized representations of human bodies. Users can play back and annotate skeleton data similar to a video analysis tool.
SMARTMANIKIN: Virtual Humans with Agency for Design Tools agentic virtual human AI pose generation responsive design tools fashion-tech UX
We introduceSmartManikin, a mannequin with agency that responds to high-level commands and to real-time design changes. The SmartManikin's pose is generated by the predicted features as well as by using forward and inverse kinematics.
The Effect of Interruption Timings on Autonomous Height-Adjustable Desks autonomous furniture interruption-aware UX adaptive workspace physical AI
We performed a Wizard of Oz study to find the best timing for changing desk height to minimize interruption and discomfort. The results are in line with prior work on task interruption in graphical user interfaces and show that the table should change height during a task change.
BODY2DESK: Interactive and Situated Guidelines for Personalized Ergonomics VR ergonomics embodied guidelines real-time feedback personalized workspace
We developed situated and interactive guidelines to assist users in design applications. We applied these guidelines in a Virtual Reality (VR) system that lets users customize their desk and provides real-time feedback and feedforward on pose and design.
BODYMETER: Embodied Posing Input for Furniture Personalization Interface embodied input pose-based design personal fabrication body-aware UX
We developed situated and interactive guidelines to assist users in design applications. We applied these guidelines in a Virtual Reality (VR) system that lets users customize their desk and provides real-time feedback and feedforward on pose and design.
Consumer to Creator: How Households Buy Furniture to Inform DIY Design Interfaces DIY design consumer creativity furniture personalization design decision insights
We developed situated and interactive guidelines to assist users in design applications. We applied these guidelines in a Virtual Reality (VR) system that lets users customize their desk and provides real-time feedback and feedforward on pose and design.
ORI-MANDU: Korean Dumpling into Whatever Shape You Want digital gastronomy food fabrication playful making cultural design tech
We extend the research on digital gastronomy by using digital fabrication to create custom tools that assist the process of cooking. We present the iterative process of designing the “Ori-mandu” system, and how Ori-mandu enables users to fabricate dumplings in whatever shape they want.