Objective
Guide trainers in teaching how to scan spaces using Gaussian splatting to create highly detailed 3D models from pixel data using Luma.AI, emphasizing real-world application in digital arts and performance contexts.
Structure of the Training Session
- Preparation (approx. 10 minutes)
- Objective: Set up the environment and tools for an efficient session.
- Steps:
- Select the space to be scanned (indoor/outdoor with varied surfaces).
- Prepare scanning equipment.
- Install necessary software (e.g. Nerfstudio, Luma.AI, COLMAP). In this manual we will focus on Luma.AI.
- Test file input/output compatibility for your chosen platform.
Checklist:
- All software installed and functioning
- Camera/device tested with sample capture
- Backup storage ready for large image datasets
- Basic walkthrough presentation prepared
- Introduction to Gaussian Splatting (approx. 15 minutes)
- Objective: Introduce the technique and its creative potential.
- Steps:
- Define Gaussian splatting in simple terms: “projecting colored 3D Gaussian blobs into space using 2D images to reconstruct detailed 3D geometry.”
- Show examples comparing Gaussian splatting with traditional mesh/point-cloud scans.
- Explain the options and possibilities of how to make a Gaussian splat (local Gaussian splatting vs. other less technical methods e.g. Luma.AI)
- Emphasize its advantages: speed, finer detail, more natural lighting and responsive to virtual light sources.
Trainer Tip: Use visual comparisons – real object, mesh scan, Gaussian splat result.
- Hands-On Capture and Processing (approx. 30 minutes)
- Objective: Use Luma.AI to quickly create and visualize a 3D Gaussian splat without technical setup.
- Steps:
- Download and open the Luma.AI app on an iPhone.
- Capture the scene: Use the app to record photos or a video while walking around the object or environment.
- Automatic upload and processing: Luma.AI uploads the images and begins training the model automatically.
- View the model: You’ll get a notification once the model is ready. View it directly in the app or via a web browser.
- Export the Gaussian splat as a .ply file for use in 3D engines or editing software.
Trainer Tip: Use this method for fast results and lower the technical barrier for beginners. Pre-load example scenes to show during the session.
- Advanced Use and Troubleshooting (approx. 15 minutes)
- Objective: Explore optimization and creative application.
- Steps:
- Discuss tips for better detail (camera path planning, lighting).
- Introduce downsampling vs. full-resolution trade-offs.
- Show how to integrate Gaussian splat models into game engines or XR tools.
- Wrap-Up and Feedback (approx. 10 minutes)
- Objective: Reinforce key learnings and collect feedback.
- Steps:
- Recap: Capture > Process > Render > Apply
- Share links to open-source tools, tutorials, and sample data
- Gather participant feedback on clarity and practical use
Post-Training Follow-Up
- Provide cheat sheet of steps and commands
- Offer optional office hours for Q&A
- Encourage participants to scan their own space and share results
Trainer Tip: Create a shared gallery or folder for participants to upload their models.
