EN

Movement 1 – Face & Hands | INTERCUL

Training Manual for Trainers: Teaching Facial and Gesture-Based Performance Interfaces 

Objective Equip trainers with a step-by-step guide to effectively teach Al-powered facial expression and hand gesture tracking as performance instruments, creating accessible and expressive digital performance tools.

Structure of the Training Session

  1. Preparation (approx. 10 minutes)
  • Objective: Set up facial and hand tracking

•     Steps:

  1. Research tracking libraries (MediaPipe, OpenPose, or commercial alternatives).
  2. Prepare web development environment (React, Vuejs, or vanilla JavaScript).
  3. Set up graphics libraries (PSjs, Threejs, or Canvas API) for visual
    Checklist:
  • Webcam with good lighting
  • Tracking software with face and hand models
  • Web browser with camera permissions
  • Graphics rendering environment

2.   Introduction to Gesture-Based Interaction (approx. 15 minutes)

  • Objective: Introduce participants to hands and face as expressive

•     Steps:

  1. Explain facial landmark detection and hand pose estimation principles.
  2. Demonstrate existing gesture-controlled applications and
  3. Show the accessibility benefits of hands-free interaction Trainer Tip: Let participants experience immediate visual feedback from their own movements.

3.   Hands-on Practice (approx. 30 minutes)

  • Objective: Build a basic gesture-controlled visual

•     Steps:

  1. Implement basic face detection with key landmark
  2. Add hand gesture recognition for common poses and
  3. Create visual responses that reflect facial expressions and hand Trainer Tip: Focus on smooth, responsive feedback to maintain engagement and expression flow.

4.   Advanced Features and Creative Use Cases (approx. 15 minutes)

  • Objective: Explore complex gesture interpretation and multi-modal

•     Steps:

  1. Demonstrate emotion recognition from facial
  2. Show advanced hand tracking for finger-level control and complex
  3. Explore combining face and hand data for nuanced performance

5.   Wrap-Up and Feedback (approx. 10 minutes)

  • Objective: Reinforce gesture-based interface

•     Steps:

  1. Summarize tracking techniques and creative mapping
  2. Share resources for accessibility-focused interaction
  3. Encourage exploration of personal gesture vocabularies and

Post-Training Follow-Up

  • Provide access to recordings, cheat sheets, or tool
  • Schedule optional Q&A sessions or office

    Trainer Tip: Encourage a collaborative group where participants can share projects and solutions.