CALIBRATE CALIBRATE

Spatial Computing & Gesture Interface

Invisible
OS

A computer with no visible computer. A UI you control with your hands in the air. A system that deletes itself and asks you to try again.

Type Interactive Installation
Year 2025
Medium Projection, Gesture Tracking, Audio
Stack MediaPipe, p5.js, JavaScript
Hardware 12″ × 24″ Canvas, Short-Throw Projector, Webcam

No Computer Visible

InvisibleOS began as a technical investigation: what does it feel like to interact with a user interface using nothing but your hands in space? No mouse, no keyboard, no touchscreen. Just the air between your body and a canvas, mediated by computer vision.

The physical setup strips away every familiar signal of computation. A bare white canvas, 12 by 24 inches. A projector offset to the side. A webcam mounted on top. No visible computer anywhere. The effect is a contract between two aesthetics that rarely meet: the futurism of gesture-controlled interfaces and the traditional blankness of an artist's canvas.

The piece is also, quietly, about the products we interact with every day: bloated, confusing, demanding, and ultimately indifferent to the data they take from us.

InvisibleOS parodies the logic of the modern tech product. It onboards you. It tutorials you. It makes you feel like you are learning something. And then, when you have finally navigated its puzzles and unlocked its sequences, it tells you there has been an error. All your data has been deleted. Would you like to speak to support? Yes or no — it does not matter. The system restarts. You calibrate again.

What Happens

You approach the canvas. A skeleton of your hands appears on the surface.

01
Calibration
You step forward or back until your hands fill two calibration boxes on the canvas. The system reads your depth, maps your skeleton, locks you in. You feel it click.
02
Tutorial
A tutorial walks you through the gesture vocabulary. Pinch with one hand to click. The other hand's pinch controls element sizing. Click and drag elements exist. You practice. The system rewards correct gestures with satisfying haptic-style audio.
03
Unlock Sequence
A randomized sequence of gestures, buttons, and spatial puzzles. The system cycles through a few rounds, each building in complexity. You are learning its logic. You are getting good at it.
04
Error
A screen appears. There has been an error. All your data has been deleted. You are offered the chance to speak with AI support. Yes or no. Neither answer matters.
05
Restart
The system restarts. The calibration boxes reappear. You step forward or back until your hands fill the frame. It begins again.

How It Works

The piece runs entirely in the browser via p5.js, with MediaPipe's hand tracking model processing webcam input in real time to extract 21 landmark points per hand. Those landmarks drive all UI interaction: pinch detection, depth estimation, drag and click events, and the calibration sequence.

The physical setup is deliberately minimal. A 12 by 24 inch canvas acts as the projection surface, facing the viewer directly. A short-throw projector offset to the side fills the canvas without the viewer casting shadows. A webcam mounted on top of the canvas looks outward, tracking the viewer's hands in the space between their body and the surface.

The audio layer uses synthesized tones and haptic-style feedback sounds timed to gesture events, reinforcing the sensation that your hands are genuinely touching something, even though they are touching nothing at all.

Tracking
MediaPipe Hands
Rendering
p5.js
Language
JavaScript
Hardware
Canvas, Projector, Webcam
Live Demo & Source Code
Try InvisibleOS

Next in Lab

Signal Jammer