Question - is it possible to get a raw buffer image from a usb camera without any processing done to it. It seems no matter what format the camera output internally is when you grab it with getUserMedia it converts it to RGB.
Problem - I have a YUV 4:2:0 camera output that i'm pushing out over usb from a microcontroller. What i was planning to do is embedded some data information in the image on the Y channel for say the last 2 lines. But the problem i'm running into is that when you grab the image from the camera with getUserMedia and stick it into the video frame and then use the video frame data as you're buffer it's in RGB. I could try to convert the RGB back into YUV, but i think that in some edge cases the data is lossy as in there's rounding errors or the color spaces don't perfectly match up. So basically I'm just looking for a way to keep my buffer from the camera unedited.
From what i'm reading when a browser grabs a video stream it will convert it to a RGBA format. There doesn't really seam like a way around this.
So what i'm doing is using a electron app and grabbing the image at a os level and passing the image up.
I'm thinking of using either opencv or this library https://github.com/node-ffi-libraries/node-ffi-library-libuvc-v0.0.6 . which is a lower level usb camera interface.