Training Manual for Trainers: Teaching Full-Body Motion Capture for Digital Performance

Objective Equip trainers with a step-by-step guide to effectively teach depth camera sensors and pose estimation for translating full-body movement into digital instruments, creating immersive body­ controlled performance systems.

Structure of the Training Session

1. Preparation (approx. 10 minutes)

• Objective: Set up full-body tracking and lighting control

•     Steps:

1. Research depth cameras (Kinect, RealSense, ZED, or webcam-based solutions).
2. Prepare pose estimation software (OpenPose, PoseNet, or commercial alternatives).
3. Set up lighting control systems and 3D graphics Checklist:

• Depth camera positioned for full-body
• Pose estimation software calibrated and
• DMX lighting interface or simulator
• 3D graphics environment (Blender, Unity, or visual programming tools)

2.   Introduction to Full-Body Tracking (approx. 15 minutes)

• Objective: Demonstrate the expressive potential of whole-body

•     Steps:

1. Explain depth sensing technology and skeletal tracking
2. Show examples of body-controlled installations and stage
3. Demonstrate different body parts controlling different performance Trainer Tip: Encourage participants to move and see immediate visual feedback to understand the system’s responsiveness.

3.   Hands-on Practice (approx. 30 minutes)

 

• Objective: Create a basic full-body controlled performance

•     Steps:

1. Set up skeletal tracking with key joint position
2. Map different body positions and movements to lighting control
3. Experiment with gesture recognition and movement-to-visual Trainer Tip: Start with large, obvious movements before refining sensitivity for subtle gestures.

4.   Advanced Features and Creative Use Cases (approx. 15 minutes)

• Objective: Explore complex movement analysis and stage

•     Steps:

1. Demonstrate movement quality analysis (speed, acceleration, flow).
2. Show multi-person tracking and interaction
3. Explore integration with professional stage lighting and projection

5.   Wrap-Up and Feedback (approx. 10 minutes) 

• Objective: Consolidate full-body interaction

•     Steps:

1. Review depth sensing, pose estimation, and stage control
2. Share resources for movement analysis and choreographic
3. Encourage exploration of personal movement vocabularies and spatial

Post-Training Follow-Up

 

• Provide access to recordings, cheat sheets, or tool
• Schedule optional Q&A sessions or office
  
  Trainer Tip: Encourage a collaborative group where participants can share projects and solutions.