Encoding/Decoding audio for WebSocket Application – Social Media Manager
I'm working on a web application using an audio-in, audio-out API of an AI platform which sends back AI responses when it receives user message.
This involves recording audio from the user's microphone, converting the audio to mono (single channel) µ-law (mu-law) encoded at 16000Hz and sent as base64 encoded string over a WebSocket connection to a remote server.
So far I have been able to establish a Websocket connection with the service and receive a greeting message from the AI which is sent as base64 audio binary which I have successfully been able to decode and play it in my browser.
However, I'm facing issues sending the user message in the right manner to the endpoint. We are receiving no response back and there is little to no documentation or support to help us.
I need assistance from an experienced developer familiar with audio recording, encoding, and WebSocket communication to help me identify and resolve the problem.
Requirements:
Expertise in web audio APIs, including getUserMedia and MediaRecorder
Knowledge of audio encoding formats, specifically mu-law encoding
Experience with WebSocket communication and data transfer
Familiarity with JavaScript and modern web development practices
Strong debugging and problem-solving skills
Deliverables:
1. Identify the root cause of the issue with the audio recording and mu-law conversion
2. Provide a working solution that accurately records audio, converts it to mu-law format, and sends it over the WebSocket connection which results in receiving a response from the AI.
3. Document any necessary code changes or explanations for the solution
Additional Information:
I can provide the complete codebase and any additional context or information required to understand and reproduce the issue. I'm open to sharing the project details and collaborating closely with the selected freelancer to resolve this problem.
Please provide your relevant experience and a brief explanation of your approach to tackling this issue. I look forward to working with a skilled developer to get this feature working correctly.
Hourly Range: $30.00-$150.00
Posted On: April 26, 2024 19:55 UTC
Category: Full Stack Development
Skills:Web Application, Software Debugging, JavaScript, Node.js, Websockets, WebRTC, Audio Engineering, Real Time Stream Processing, NodeJS Framework
Country: United States
click to apply