- ChRY

Facade Runner

A Projection Mapping Project Exploring the Mutual Influence Between The Surface And The Projected Visuals

Team: Ruyan Chen

MY JOB: TouchDesigner Development

TOOLS: TouchDesigner, Projector

PROJECT OVERVIEW

CONCEPT & INSPIRATION

I always believe that different projection surfaces have different affordances. Projection mapping is not just about the technique of mapping virtual content onto a 3D object, it also makes possible a mutual effect to take place between the projection surface and the virtual content–the virtual content should respect, echo, define, inform, and make use of the projection surface while the projection surface should help to better present and elaborate the virtual content being projected.

Therefore, my approach was letting the projection surface inspire the virtual content I would create. We were given the projection surface shown in the image on the left. The geometric complexity of this projection surface creates a visually compelling structure that share characteristics with modern architecture.

It reminds me of the “What If” projection mapping project at White Night Melbourne 2018 which transformed the architecture of Melbourne’s iconic buildings by reimagining their facades through dynamic visuals and animations. The architecture became a canvas for storytelling.

What stories could take place on a building’s exterior? Cinematic moments where the characters scaled the exterior of skyscrapers kept crossing my mind.

OBJECTIVES

PROCESS & METHODOLOGY

Defining the Projection Surface

Since most modern skyscraper shave exteriors dominated by glass windows, I found and experimented with different glass window texture using Kantan Mapper to create the most realistic building’s exterior.

The projection surface is being transformed into a glass building.

Creating Animations

I looked for climbing animations that are suitable for building climbing.

With the help of ChatGPT, I created animations of climbing, falling, and changing directions.

OUTCOMES

REFLECTIONS

TouchDesigner and projection mapping make possible the transformation of any surface into a living canvas. The overlay of digital content onto real surfaces/environments is seen in augmented reality too. This project can be developed further to become interactive. For example, a microcontroller may be used to act as a controller through which the player can control the movement of the climber. Animations of shooters firing at the climber can be added to create an interactive game. An interactive projection mapping game project has the potential to create a mixed reality experience that extends the boundary of entertainment by integrating every corner of our environment into the game.