✨ Allow audio processing similar to frame processing

What feature or enhancement are you suggesting?

I'd love to be able to analyze the audio channel during the recording of a video like you can do it with the video channel with frame processors. Not sure if that's not possible already but from what I understood by reading the docs, frame processing plugins only receive an image buffer with no audio included. Would be great to be able to analyze the audio channel too. In the particular case I have in mind I would need to be able to check the audio channel of a video for short volume peaks.

What Platforms whould this feature/enhancement affect?

iOS, Android

Alternatives/Workarounds

I don't think there's a workaround to that yet. I could probably record audio and video separately and analyze the audio data with a library other than vision camera in parallel and later merge audio and video back together, not sure if that's possible though. Luckily I don't need that feature yet but I probably will in the future. I'd be happy to help you here, but I have never worked with Swift or Objective-C before so I don't know if I could really help you at this point. I could however help you with the RN/JS part. I have also implemented something like that in a web app not long ago so I could provide you with the code to give you an idea of how that could work.

Additional information

• I agree to follow this project's Code of Conduct
• I searched for similar feature requests in this repository and found none.