Escape Room

Mobile multimodal puzzle-solving

Nov 2023 – Jan 2024 · Modified 2025-02-23

• Links: demo video
• Tools: unity csharp vuforia

In order to win the player completes four puzzles, collecting the codes and keys required to open the door and escape. We used books as tangibles as they can be handled with one hand, be used for image recognition, and most people have some at home.

Meta puzzle

The Meta puzzle ties together all the other four puzzles with four locks. In accordance with the “open structure”, they can be solved in any order:

The two code locks use AR buttons with screen touch as input, while the two padlocks require keys attached to tangibles:

Labyrinth puzzle

The labyrinth puzzle has the player tilting the book, getting the ball to the goal to receive a key:

Racing puzzle

And for the racing puzzle you rotate the book like a wheel, steering a remote-controlled car to collect the key. Gas is applied through a traditional GUI touch button.

User evaluation

We performed a couple of think-aloud sessions coupled with interviews to evaluate the interactions and compare the different modalities. I handled the qualitative analysis, which included coding, affinity diagramming, and insights extraction:

Our main findings include:

• multitasking input modalities was difficult
• tangibles had unclear affordances but felt natural and immersive once learnt
• puzzle order affected learning of how to interact with untraditional modalities

Related project: VR Urban Stress Mapping

Dec 2023 – Jan 2024

In this VR study we designed a city and examined the impact of environmental variables on perceived stress – including cold vs warm light:

And three different levels of vegetation with accompanying sounds:

We found that natural elements and sounds had a calming effect, while lighting preferences were mixed.