relight

ART & TECH | HYE SOO YANG

Relighting the scene in ar

Intermittent mini project III

Introduction

Virtual contents can seamlessly be integrated in the real environment with the help of augmented reality technology in which AR markers give information about the orientation of the surface for the 3D content to be displayed from the correct view point perspective. However, these 3D contents often look off and do not blend into the environment so well due to their inherent light settings, if any.

Relight the Scene project is geared towards giving users the ability to control the direction of the light with a fingertip. The PMD Camboard Nano camera, as shown in the image on the right, is used to capture the

depth information about the hand. Through a number of image filtering operations, the tip of the index finger is acquired with which the user can move the light source around and relight the AR scene for it to match the light settings of the real environment. *For this mini project, only one light source was used.

PMD Camboard Nano

Screen Snapshot of the Project in Action

Relighting the Scene in AR Demonstration

Webpage designed by Hye Soo Yang