Training Manual for Trainers: Live AI Prompting & Visual Interaction in Performance | CULTUURCONNECT

Objective
Guide trainers in teaching performers how to integrate AI live during performances, visually and interactively, using real-time prompting tools and visual generation models. 

 

  1. Preparation (approx. 10 minutes)
  • Objective: Set up the technical environment and prepare for an interactive session. 
  • Steps: 
  1. Choose a real-time generative AI tool (e.g., GPT-4 with voice interface, Runway ML, TouchDesigner with AI plugins, etc.). 
  1. Prepare a simple performance scenario where live AI prompting will be used. 
  1. Test AI tools with your chosen projection or screen setup for visual output. 

Checklist: 

  • AI tools/accounts ready and logged in 
  • Internet connection stable 
  • Visual projection system tested 
  • Microphone/audio input tested (for voice prompting, if used) 
  • Backup prompts or assets ready 

 

  1. Introduction to AI in Live Performance (approx. 10 minutes)
  • Objective: Familiarize participants with the role of AI in enhancing live performance through live interaction and visuals. 
  • Steps: 
  1. Showcase 2–3 short examples of performances using live AI (e.g., text-to-image in real time, AI dialogue generation, audience interaction, real-time AI generated visuals, voice modulation, virtual characters). 
  1. Explain basic mechanics: how a performer can interact with AI mid-performance via prompts or triggers. 
  1. Clarify the creative potential and the unpredictability that AI brings. 
  1. Inform artists of the ethical considerations of the use of AI: ambiguous creative ownership, potentially biased training data, privacy issues, transparency, consent, sustainability, etc. 

Trainer Tip: Encourage creative exploration and collaboration with AI, while acknowledging potential concerns or limitations. Create space for mindful discussion without letting it turn into an extended ethical debate. 

 

  1. Hands-On Practice (approx. 30 minutes)
  • Objective: Allow participants to experience and test AI interaction in a live setting. 
  • Steps: 
  1. Divide participants into small groups; assign each a setup (laptop, projector, microphone). 
  1. Guide them to input live prompts during a mock performance scene (e.g., generate a visual on-the-fly based on an improvised line). 
  1. Have participants try different AI options during different stages of the creative process. e.g. text-to-image generation on stage, dialogue generation, voice modulating AI, etc.) 
  1. Experiment with voice prompting or gesture-triggered interactions if tools allow. 

Trainer Tip: Encourage improvisation and observe how the AI changes the flow of the scene. Highlight adaptability. 

 

  1. Creative Challenges & Alternate Scenarios (approx. 15 minutes)
  • Objective: Deepen understanding through variation and troubleshooting. 
  • Steps: 
  1. Assign creative limitations: e.g., only one-word prompts, audience-suggested prompts, thematic prompts. etc. 
  1. Simulate technical failure and discuss backup strategies (e.g., pre-generated AI responses, fallback media). 
  1. Explore alternative tools and workflows depending on budget and tech skills. 

 

  1. Wrap-Up and Feedback (approx. 10 minutes)
  • Objective: Review key takeaways and gather participant input. 
  • Steps: 
  1. Discuss how AI influenced creative choices during the practice. 
  1. Reflect on how AI can be used in their own, individual creative work. 
  1. Share links to tools, plugins, and examples for further exploration. 
  1. Ask for feedback: What worked? What felt awkward or inspiring? 

 

Post-Training Follow-Up 

  • Suggest creating a shared resource folder for ongoing experimentation. 
  • Recommend watching or analyzing live performances that feature AI as a co-creator. 

Trainer Tip: Remind participants to be mindful of their use of AI and that AI doesn’t replace creativity, it challenges and expands it.