Skip to main content

Custom Mode Builder

Define your own gestures-to-actions mapping without changing core code. The Custom Mode Builder lets you create a tailored mode and activate it from the GUI.

Custom Mode Builder

What you can configure

  • Gesture → Action bindings (per hand)
  • Confidence thresholds per gesture
  • Cursor/scroll enablement and sensitivity
  • Game/volume integration toggles

How it plugs into the system

  • Configuration is loaded by config_manager and exposed on self.params/self.app_modes for the engine.
  • ApplicationModeManager reads the active mode (e.g., custom_mode) and executes actions according to your bindings.
  • Use event_bus to observe executed actions or to feed UI indicators.

Typical workflow

  1. Open the Custom Mode Builder in the GUI.
  2. Select a base set of gestures (static from classifier or dynamic from landmark rules).
  3. Bind each gesture to an action (mouse/keyboard/volume/game).
  4. Save and activate your custom mode.

Tips

  • Start from a simple set of non-conflicting gestures.
  • Use per-gesture confidence thresholds and a short debounce to avoid accidental triggers.
  • Keep a visual overlay to confirm the recognized gesture before execution.