Role
Led interaction design
Team
4 designers +
design manager
Company
Microsoft
Status
Shipped · Patented
Microsoft
Mesh
Controller-free interaction for Microsoft Mesh in VR, helping people collaborate naturally with their hands.
01
INTRO
PRODUCT
Mesh brought teams together in shared 3D spaces — on desktop, in Teams, and in VR.
SCOPE
A bare-hand interaction system for Mesh in VR, designed to replace handheld controllers.
MY ROLE
I led interaction design for the controller-free experience, owning the gesture system and hand cursor with engineering and user research.
02
CHALLENGE
Controllers kept pulling people out of the meeting. Mesh needed to work with bare hands.
03
APPROACH
One pinch for everything — the palm sets intent, and a cursor at the fingertips confirms it.
INPUT
Pinch
The most natural motion for people, and the most reliable for tracking.
INTENT
Palm orientation
Down to teleport, sideways to turn, up for the menu.
FEEDBACK
Fingertip cursor
A small fluid form that shows what the system sees.
04
OUTCOME
Shipped in Mesh for VR on Quest, with a patent on the gesture system and hand cursor.
IN USER TESTING
Natural
Pinch was clear from the first try.
Memorable
Pinch and teleport were remembered without help.
Either hand
People switched hands on their own when one was busy.
Shipped product, recorded on Quest.
NOTE
This work is under NDA, so this page shares only a high-level overview. Feel free to contact me to learn more.
