OpenAI API: Realtime API on the Server

With OpenAI’s Realtime API, you can build custom server-side real-time voice-to-voice AI chat into any application using WebSockets. In this course you’ll explore server-side integration of the Realtime API for tighter security and more advanced functionality. The course includes a hands-on example building on the WebRTC projects from the previous course, and covers how to capture and record user audio, send and receive audio and text, and integrate the server-side API app with a headless front-end app using vanilla JavaScript.

Learning objectives

• Discover how to set up a server environment for accessing the Realtime API.
• Discover how to capture and receive audio from a headless app and send it to the server.
• Explore how WebSockets sends and receives audio and text from the API.