Ask Your Question

I'm looking to use OpenCV with a Raspberry Pi as a vision system for FRC.

asked 2019-02-11 08:22:35 -0500

Ranganrs1 gravatar image

I'm a member of FRC Team 6936. We have installed and tested the Raspberry Pi FRC Console for driver vision, and we're looking to add functionality using computer vision to detect the vision targets that are placed on all field elements. I know nothing about openCV, but one of the mentors pointed me to it as a possibility. Can OpenCV be used for real-time image processing, e.g. to point out to an operator when the robot is correctly aligned for a certain task? Can OpenCV work in parallel with the vision console or would that have to be run on a separate Pi? (we have 2)

Our goal is to have the actual processing be done on the Raspberry Pi, so as to reduce the amount of information sent over the wireless network and adhere to the 4 mbps network limitation. We already have two cameras running for driver vision, which consume about 2 mbps together, and we need some left over for robot control and diagnostics.

With this in mind, our original plan was to use a PixyCam to detect the retroreflective vision targets. However, PixyCam can't be used with the Pi (as far as I know).

Can the same stream of video be used for streaming to the operator and for vision processing?

Anyway, thanks.

edit retag flag offensive close merge delete


@Ranganrs. Obsolutely. The robot can do accurately aligned for certain task. It will works on OpenCV using raspberry pi 3B3B/+. It doesn't have to be seperated. Can do rtsp too. Unfortuantely, the PixyCam/ PixyCam2 doesn't work on raspberry pi, because of raspberry pi using csi cable instead of pins connection..Yes, can do same streaming too. Btw, I do not have PixyCam. I will try to get buy one and work around to see if it is hook up on raspberry pi.

supra56 gravatar imagesupra56 ( 2019-02-11 09:05:16 -0500 )edit

How do you set up OpenCV running alongside the FRC vision console? We have 3B+ I think. Does OpenCV have C++ libraries that can be used here? The members of the programming team and I have CPP experience, and a few mentors have some Python.

Ranganrs1 gravatar imageRanganrs1 ( 2019-02-13 10:39:34 -0500 )edit
  1. I do not have PixyCam/ PixyCam2. I have picamera( very cheapest).
    1. Yes. It will work gcc. Here is link: gcc
    2. Install opencv with c++. Here is link: c++

As for raspberry pi linux. link: raspberry pi linux I will be attending in FRC in Toronto.

supra56 gravatar imagesupra56 ( 2019-02-14 08:43:23 -0500 )edit

1 answer

Sort by ยป oldest newest most voted

answered 2019-02-14 08:04:30 -0500

Ranganrs1 gravatar image

I've figured out most of the stuff. After importing the Python libraries, I grabbed the Python demo script from the vision system and tried to capture a stream from it. A bit of the documentation is confusing, and it's still complaining, but I'm sure that we'll figure it out.

edit flag offensive delete link more


Please do not post in answers. Put it in comment.

supra56 gravatar imagesupra56 ( 2019-02-14 08:44:55 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-02-11 08:22:35 -0500

Seen: 430 times

Last updated: Feb 14 '19