Track: WebRTC and Real-Time Applications |
| Delivering stereoscopic, wraparound and |
| Our team develops high-resolution, high-color, ultra-low-latency, surround-sound conferencing software used for secure remote editing and finishing of films and TV shows. We were tasked with porting our software to support Apple Vision Pro, so that our studio clients could use it for their secure pre-release content workflows, which tend to be technically challenging due to bitrate, latency and input device requirements. We’ll present the techniques we used and various challenges we overcame to stream stereoscopic and 360-degree video over WebRTC to the Apple Vision Pro using the Janus SFU. We’ll demonstrate the hardware and briefly dive into some of the considerations in delivering effective “spatial” content over WebRTC. We will address: • How we ported libwebRTC to AVP including developing custom Audio Device Module, Camera Capture (CameraSession, CameraCapturer and CameraPreview components), and Custom Renderers • Different stereo/dimensional formats (over/under, side-by-side, 360 spherical projection) and making them work with studio standard format capture devices • Developing multiple custom renderers to supports different color spaces and pixel formats in 2D, immersive, 180/360 and spatial modes using a MetalLayer-based renderer and a Compositor service |
|
| Presentation Video |
| Presentation Notes |
| Stolarz-WebRTConAppleVisionPro.pdf |
Real Time Communications Conference & Expo at Illinois Tech
IEEE International Conference
Follow Us
Share This
