Track: WebRTC and Real-Time Applications |
| Going Live with Conversational AI: Overcoming Hurdles to Reliability and Scalability |
| As conversational AI comes closer to achieving truly natural real-time interactions via voice and video, there are a few major challenges to rolling this functionality out to the public including the last mile, latency, time-to-market and the cost to scale. This presentation delves into what is necessary to bridge the gap between laboratory performance and reliable, cost-effective real-time conversational AI experiences in diverse real-world environments. The first challenge lies in the inherent instability and fluctuations of everyday internet connections—particularly in the last mile. Issues with bandwidth fluctuations, signal dropouts, higher congestion and packet-loss make it difficult to deliver a reliable and consistent connection for real-time communication between humans and AI. Another key network-related challenge is latency. The average latency in turn-taking in a typical human conversation between people in the same room is 208ms, which should be the goal for conversational AI. That said, achieving that level of ultra-low latency over the internet is complex and requires an end-to-end approach for optimizing latency considering devices, network, and infrastructure. Scalability and cost-effectiveness, particularly for video-enabled AI conversations, represents another major hurdle. A hybrid device-cloud architecture that leverages the strengths of both can help to deliver high-quality AI interactions while optimizing resource utilization. Finally, how can developers meet the demand for rapid deployment and iteration in the fast-paced AI landscape? An open-source approach can help to accelerate development, foster collaboration, and increase adoption in AI systems. Attend this presentation to gain insights on the intersection of real-time communication and human-computer interaction along with a better understanding of how to address the major challenges to deploying reliable conversational AI in your application. |
|
| Presentation Video |
| Presentation Notes |
| ZHANG-Going-Live-With-Conversational-AI-Overcoming-Hurdles-to-Realiability-and-Scalability3.pptx |
Real Time Communications Conference & Expo at Illinois Tech
IEEE International Conference
Follow Us
Share This
