Track: WebRTC and Real-Time Applications |
| How WebRTC Can Better Enable the Metaverse |
| Brief: As the metaverse takes shape, there’s no doubt augmented reality (AR) and virtual reality (VR) will play a crucial role in how users engage with it. To overcome the challenges of AR and VR, such as device limitations and feelings of isolation, WebRTC offers solutions. Overview: The metaverse means many things to many people, but I’d like to focus specifically on two areas: augmented reality and virtual reality. If we are to build a thriving metaverse, we need to tackle the unique challenges of AR and VR and seize their unique opportunities. Augmented Reality In augmented reality, we face device limitations. These include minimal input controls and low processing power, but network connectivity has become more reasonable thanks to mobile phones. Here’s how WebRTC specifically helps solve these limitations: - For input controls, why not let a remote party help guide you? Or use artificial intelligence to translate speech to text, and take action that way. - For low processing power, a combination of on-device limited capability and power detection with higher quality remote streamed detection can create a powerful combination. This is especially handy when analyzing the AR environment for free-form objects (i.e. not QR codes and such but more dynamic object detection). WebRTC’s ability to run on these lower power devices and also natively in a browser means multi-party experiences are easy to create and reduce the barrier to entry in AR. Virtual Reality For virtual reality, the worst result is feeling isolated. While VR is an inherently isolating experience, WebRTC can provide a multi-party experience based on standards that allow interoperability between not just other VR devices, but also AR devices, web browsers, and mobile devices. This brings the greatest possible number of people together to create a social VR experience—taking VR from a solo toy to a shared and present experience. |
|
| Presentation Video |
| Presentation Notes |
| Venema-How-WebRTC-Can-Better-Enable-the-Metaverse.pdf watch?v=Q06KguXDUqU&list=PLpKNVpFmUKiMwZu4tZjJcHznhI0tOqitT&index=5 |
