getting openCV to read from an HDMI source

asked 2017-04-13 12:07:06 -0500

hanban gravatar image

Hey, I need to make openCV use an hdmi source (a medical camera which connects to an HDMI input). my problem is, the camera out is HDMI, not usb, needless to say, it is not a webcam.

what is the best way to get openCV to read the HDMI input? I have looked at video capture cards, but I dont really need to do any recording, I just need the video feed to go live in realtime. I dont need to save any of that data.

any ideas?


edit retag flag offensive close merge delete



does it come with an SDK ?

if so, probably your best bet is: use that to retrieve images, make a cv::Mat from those, later.

berak gravatar imageberak ( 2017-04-13 12:17:42 -0500 )edit

hi berak, camera is a Laparoscopic Surgery camera, I treat is as a black box with an HDMI output. I doubt It has an SDK. I just need to do some processing on openCV before i send the video to the TV monitor in the operating room. So openCV process letancy aside, i need the frames to arrive to the computer in real time. I also have a firefly RK-3288 reload development board running linux with an HDMI input .I can use it instead of a pc, , but I'm not sure how openCV can read from an HDMI input directly.

hanban gravatar imagehanban ( 2017-04-13 12:52:13 -0500 )edit

@hanban what @berak tries to say, is that OpenCV itself will NOT be able to read in HDMI signals directly. It is simply not built for that. SO you need something extra to grab the data and push that on to you OpenCV processing. The thing is, reading around on the net, HDMI input on Linux is seen as a video device, so you should be able to use any video backend to grab it, then pass it on.

StevenPuttemans gravatar imageStevenPuttemans ( 2017-04-14 04:38:08 -0500 )edit

Ow wait, let me correct that, given your board, read this discussion. It seems your board does not support video input for HDMI yet ... and it is not even planned. I wouldn't get my hopes up :/

StevenPuttemans gravatar imageStevenPuttemans ( 2017-04-14 04:39:26 -0500 )edit

Steven, Thanks for looking around for me, sucks that the HDMI input on the board is not supported.. So right now what should I consider as my best option? If I need to get a dongle or a capture card supported by openCV I would do that. The problem is I need somthing that can atleast in preview mode (as I dont need any actual recording) will allow me to see, say, my moving hand infront of the camera with practically no delay on my pc monitor. I cant have the surgeon see his camera movements with delay.. it's a big NO NO.. Is there anything out in the capture card market that can fit me? I'll take any idea you might have. P.S, my open cv code add litttle to no delay, its based on marking/drawing on live video. I dont use any heavy tracking ...(more)

hanban gravatar imagehanban ( 2017-04-14 18:17:16 -0500 )edit