[nuts-rice]

• Introduces the Spatial struct for Mux for describing how a broadcasted media fills space around a viewer. Holds onto projection, stereo and layout. Has associated fns for video and audio.

• Adds an Three.js scene with:

  • spatial audio
  • rendering for a VR headset
  • plays test video for now

• Tests for running that scene and checks for video being wrapped as expected.

• CLI flags for projection , video and audio layouts

• Documentation for pipeline of test video -> ready for XR -> publish to relay

[kixelated]

lemme know if you want to finish this

[kixelated]

Thanks @nuts-rice! I finished this in #8781 on top of your latest three commits from webxr_vr_demo (including the HUD and recentre ones from yesterday), which keep your authorship. Since #7308 already fills projection, stereo, and the ambisonic layout on import, it drops the CLI flags and moq_mux::catalog::Spatial, and the harness now imports a VR180 MP4 with ambisonic Opus instead. It also fixes @moq/watch dropping the OpusHead, which kept the ambisonic track from decoding at all.

(Written by Claude Opus 5.5)