Object detection not working [closed]
Hello everybody! I Am working on my masters degree. My first task is to do bananadetector by following this tutorial:
http://technobium.com/object-detectio... Did whole tutorial but in the end, detector doesn't work. It shows red rectangle saying "banana" in the wrong places, it doesn't recognize bananas. Total disaster. I have been trying to make it work for more than 10 days, but nothing helped. For training I made 1400 positives and 3000 negatives and used next commands to train model:
opencv_createsamples -info positives.txt -num 1200 -w 60 -h 80 -vec training.vec
opencv_traincascade -data data -vec training.vec -bg negatives.txt -numPos 1000 -numNeg 1000 -numStages 10 -nsplits 2 -w 60 -h 80 -featureType LBP -minhitrate 0.999 -maxfalsealarm 0.5
Here is my BananaDetector.cpp file
include <highgui.h>
include <iostream>
include <stdio.h>
include <cv.h>
using namespace std; using namespace cv; using namespace std;
int main() {
cvNamedWindow("Banana detecting camera", 1);
// Capture images from any camera connected to the system
CvCapture* capture = cvCaptureFromAVI("/home/painkiller/Desktop/banana.mp4");
// Load the trained model
CascadeClassifier bananaDetector;
bananaDetector.load("src/banana.xml");
if (bananaDetector.empty()) {
printf("Empty model.");
return 0;
}
char key;
while (true) {
// Get a frame from the camera
Mat frame = cvQueryFrame( capture );
std::vector<Rect> bananas;
// Detect banana
bananaDetector.detectMultiScale(frame, bananas, 1.1, 30,
0 | CV_HAAR_SCALE_IMAGE, Size(100,440));
for (int i = 0; i < (int) bananas.size(); i++) {
Point pt1(bananas[i].x, bananas[i].y);
Point pt2(bananas[i].x + bananas[i].width,
bananas[i].y + bananas[i].width);
// Draw a rectangle around the detected banana
rectangle(frame, pt1, pt2, Scalar(0, 0, 255), 2);
putText(frame, "Banana", pt1, FONT_HERSHEY_PLAIN, 1.0,
Scalar(255, 0, 0), 2.0);
}
// Show the transformed frame
if (!frame.empty())
imshow("Banana detecting camera", frame);
// Read keystrokes, exit after ESC pressed
key = cvWaitKey(10);
if (char(key) == 27) {
break;
}
}
return 0;
}
I have 3 more days to solve this till monday...
It might help others help you if you add your code that does the detection and images of positives, negatives, and detector failure. Are you first creating a binary image by HSV segmentation (thresholding on yellow)? To my knowledge LBP works on 8-bit binary images.
Der Luftmensch, Before using images I applied greyscale on all of them. All my images are 8-bit. My detector doesn't show any error, it just can't recognize bananas. It put Rectangle showing bananas in wrong places when i run the video with bananas. My posiitive images size are 80x60. I edited my post by adding BananaDetector.cpp file.
Berak, I appreciate your answer, but also you don't have to be so aggressive/rude. I am doing my best, I understand every line of code written in my project and I have made various changes in my program before asking here for help. SO, I please you to stop writing guesses about anyone not knowing the code they write when you know nothing about it. Secondly, I made 204 positives by my camera and used batch processes to blur them, change the brightness, convert them upside down.. So from 204 images i get 1400. If I need to make more positives by camera, that is not problem for me. If it will help, I can make it. But i highly doubt the problem is in that since detector can't detect anything and 204 initial positives and 1400 total is not really a small number..
I tried your suggestions but it did't help. I'm slowly facing the reality of not making it :/... Can you please explain me what it takes for object to be good for detection. I Guess from fruits, strawberry would be a good choice since it has texture and no pose problems are involved. Also you said: for bananas there's only the shape, to hook into. what else can opencv hook into and how? Do i make LBP training like this time with all arguments and opencv does it by itself or there are some different techniques..?
i''d think,
might be far easier, than fruits, they come with a lot of "inner contours", and best of it -- they're standardized !
try to avoid anything from nature, too much variation. iirc, @StevenPuttemans once trained a strawberry classifier (so it's possible !), but they had a TON of real positives (and the negatives were from a strawberry field , so , restricted situation).
maybe you can restrict it a little, too. while it should be fairly easy to spot a STOP sign against blue sky, it will be difficult in a dense traffic situation, or against a wall plastered with ads.
maybe even bananas work, if you can keep the pose consistant, and the bg mostly uniform
@berak, maybe a stupid question (I couldn't find a quick answer), does OpenCV's LBP cascade classifier support BGR? If so, with bananas having such a distinct color range and little texture as you mentioned, it seems silly to simply convert to greyscale (but first thresholding on HSV is a valid preprocessing step which the questioner has chosen to simply ignore).
@Der Luftmensch - it converts to grayscale almost before anything else ..
also, i do not think, that the LBP features work nicely with binary images.
and sure, if it was only about finding bananas, i'd say too: HSV thresholding on yello, then some shape comparison. bonus points for implementing "onedollar".
however, (some sort of) cascade training seems to be an explicit requirement (uni), no?
Berak, i didn't succeed with bananas so i have to pick a new object to detect it with this type of training I used for banana detection. I have been thinking a lot and i decided to pick a fire extinguisher. Can you please tell my did I make the right choice and your opinion will detection work after this type of training...
yea, better.
OK Berak thank you, you helped me a lot till this moment. I hope it's gonna work with fire extinguisher and that this was my last question for you. Also I'm looking forward to upgrading you, so if there is any way just write me here.
@berak, I made negatives folder, took positive pictures, etc.. one more thing to ask. Can you please confirm if this is ok for my fire extinguisher:
1) my postives will be resized to 300X400 before finding bounding rectangles coordinates
2) in my opencv_createsamples command width will be 60 and heigt will be 140 (are these ok sizes for fire extinguisher?)