Designing Projection-Mapped Interview Rooms with Diffusion Models for Sustainable Digital Interaction

We developed an integrated pipeline that combines generative AI and 3D modeling technologies to create a realistic virtual interview environment for sustainable digital interaction. The process begins with generating virtual interview room images using Stable Diffusion. Spatial information is then extracted on the X, Y, Z axes and the camera through FSpy manually. Based on this information, 3D structures are modeled in the Blender environment and a corresponding depth map is generated. This depth information, along with text prompts, serves as input to ControlNet, enabling the generation of additional interview room images under various perspectives and conditions. These images are projected onto the 3D models as textures via projection mapping in Blender. The resulting 3D objects are imported into the Unity engine to construct an interactive virtual interview space. The developed pipeline effectively supports the creation of immersive and realistic environments, demonstrating its applicability not only for interview simulations but also for training, education, and experiential content development.