Gesture Synth.net
Play in under a minute

How to play Gesture Synth

Give the browser a chord, an energy level and a mute cue. Gesture Synth keeps the notes in key, moves voices smoothly and supplies the bass and rhythm, so you can focus on the performance.

Open the instrument

1. Choose Camera or No camera

Camera

Choose Camera when you want your hand movement and the mirrored camera view in the performance. Starting it unlocks Web Audio, asks for camera permission and loads the locally hosted hand model. The short camera check helps with framing, light and room to move, but experienced players can skip it.

No camera

Choose No camera to play the same arranger with mouse, touch or keyboard. It unlocks sound only: it never requests camera permission and does not load MediaPipe. This is also the immediate fallback when camera permission is blocked or no camera is found.

2. Select one of five safe chords

With Camera, hold one to five fingers briefly. The observed chord appears first, Next shows the stable choice waiting for the musical boundary, and Playing shows the chord you hear. The short wait prevents a flicker from changing the music.

1 fingerIC in C Major 2 fingersviAm in C Major 3 fingersIVF in C Major 4 fingersVG in C Major 5 fingersiiDm in C Major

Changing the Music Key keeps the same I / vi / IV / V / ii functions and updates the real chord names. In No camera, move across the five lanes, drag on touch, or press 1–5 for the same chord functions.

3. Shape Quiet, Normal or Full energy

Energy changes the pad, bass, rhythmic pulse and filter together. It is an arrangement level, not a fragile volume slider.

In One hand mode, the same hand controls chord and height. In Two hands mode, the hand that begins screen-left selects the chord and the hand that begins screen-right controls energy. The role colors and responsibilities stay with those hands if they cross. “Screen-left” and “screen-right” refer to the mirrored preview, not anatomical left and right hands.

In No camera, vertical pointer or touch position sets energy. Keyboard players use ↑ and ↓. Make either active Camera hand into a fist, or press Space in No camera, to mute with a short musical fade.

4. Keep tracking and sound stable

  1. Use even front light and keep every fingertip inside the frame.
  2. Leave space above and below your palm for all three energy bands.
  3. Hold a finger count until Next appears instead of changing every frame.
  4. Open the chord hand again after a fist or tracking loss.
  5. Watch the single live status: it explains whether sound is locked, a gesture is stabilizing, a fist is muting, a chord hand is missing or tracking is lost.

If tracking becomes expensive, the tool reduces the inference rate and displays Performance reduced. That notice does not replace the main explanation for silence.

5. Record a local 15-second performance

  1. Choose 16:9 landscape or 9:16 portrait before recording.
  2. Set Camera/No camera, mode, sound scene and key.
  3. Select Record and use the three-second countdown as your start cue.
  4. Perform for up to 15 seconds, or stop early.
  5. Check the local preview, then Share when file sharing is supported or Download the file.
  6. Discard or Record again if you want another take.

Countdown locks the input, mode, scene, key and frame so the clip does not change format by accident. Camera clips contain the mirrored view, aligned hand feedback, HUD, brand and the same synth mix you hear. No-camera clips replace the camera with a state-driven music visualizer. Both layouts are composed independently at 1280×720 or 720×1280.

The browser chooses an actually supported WebM or MP4 MIME type. System Share is capability-dependent; a cancelled or failed Share keeps the preview and Download available. No server upload or remote transcoding is used.