Contact person: Full-Stack AI Voice Assistant with Real-Time Communication (WebRTC)

Phone:Show

Email:Show

Location: Pakistan

Budget: Recommended by industry experts

Time to start: As soon as possible

Project description:
"We are looking for an expert full-stack developer to build a server-side, real-time communication system. The core function of this project is to create an automated voice assistant that intercepts incoming WhatsApp calls, streams the audio to an OpenAI model, and streams the AI's real-time response back to the user on the call. This is a fully automated, headless backend solution.

Project Scope:

The ideal candidate will develop and connect three core components:

WhatsApp Call Webhook Handler: A backend service that will receive webhook notifications for incoming calls from a WhatsApp API (e.g., Meta Cloud API or a third-party provider like Twilio). This service will be the trigger for the entire process.

WebRTC Signaling and Media Server: A custom-built WebSocket server that acts as a central communication hub. This server will handle the WebRTC signaling (offers, answers, ICE candidates) to establish a real-time audio connection with OpenAI's API. It will also manage the audio streams, forwarding them from the WhatsApp call to OpenAI and vice versa.

OpenAI Integration Logic: Code to interface with the OpenAI real-time API. This includes generating a new session, managing the connection, and handling the streaming of audio data.

Key Responsibilities:

Design and develop the backend architecture using Node.js and a framework like [login to view URL] for the webhook and ws for WebSockets.

Implement a server-side WebRTC client using a library such as node-webrtc to establish a peer-to-peer connection with OpenAI's API.

Handle the flow of audio data between the WhatsApp API, your server, and the OpenAI API in real-time.

Ensure the system is robust, low-latency, and capable of handling multiple concurrent calls.

The system should be production-ready and securely configured.

Required Skills:

Expertise in WebRTC and real-time communication protocols (STUN/TURN/ICE).

Strong backend development skills, preferably with Node.js.

Experience with WebSockets and API integration (e.g., RESTful APIs).

Familiarity with server-side WebRTC libraries (e.g., node-webrtc or similar).

Experience with OpenAI API or other large language model (LLM) APIs.

Knowledge of webhook handling and audio streaming.

(Optional but a plus) Experience with a specific WhatsApp API (e.g., Meta, Twilio).

Deliverables:

A fully functional, commented, and well-documented codebase for all three components.

Instructions for deployment on a VPS (Virtual Private Server).

A brief write-up explaining the system architecture and flow." (client-provided description)