The Flow
A controller-free XR journey where Tai Chi-inspired movement reveals bamboo forests, mountains, and cosmic worlds instead of treating the environment like something to conquer.
The Flow began with a question that feels almost rebellious on the internet: what if an experience asked us to slow down? Instead of scrolling faster, completing another task, or forcing a world to respond, the player has to find a rhythm and stay with it.
Inside the experience
What someone can actually do
- Raise both hands to reveal a living bamboo world
- Complete slow circular gestures to move from bamboo to mountain to cosmos
- Influence a distant planet through rhythm rather than direct manipulation
- Return every landscape to the character 道
- Receive adaptive visual and audio guidance without controllers
How the idea took shape
The journey starts in a white void. Earth awakens beneath the player, a bamboo forest appears when both hands rise, and a continuous circular movement carries the environment through mountain, sky, and cosmos. The same gesture becomes the language of the entire experience, so learning to move is also learning what the story means.
My work focused on the controller-free PICO experience: a readable three-stage hand-tracking ritual and the adaptive spatial guidance around it. The system looks at movement speed, continuity, hand position, and completion, then changes audiovisual feedback so the player can adjust without a menu constantly interrupting the moment.
That prototype also gave us a smaller river-crossing environment for testing. Each calm circle raises a stepping stone. It is less visually elaborate than the complete journey, but it let us answer the important interaction questions early: does the gesture feel natural, can different bodies perform it comfortably, and does the experience communicate progress before the movement is finished?
The biggest lesson was that gesture design is choreography. Coordinates alone do not create meaning. Speed, scale, direction, continuity, and response decide whether a movement feels like a command, a spell, an exercise, or a meditation.
“A spatial interface can teach patience when its feedback rewards continuity and comfort instead of speed.”
Explore how it was built +
I built the controller-free PICO interaction prototype, designed the three-stage movement ritual, and developed adaptive guidance for hand speed, continuity, position, and gesture completion.
- WebXR
- Unity 6
- PICO 4 Ultra
- Hand tracking
- Gaussian splatting
- World Labs Marble
Where it could go next