bunta's profile - activity

@AFK You need to change the orientation to 270 or 90 once the surface is created, then it will start working

Is there any Sad Facedetection classifier available to test few cases , like smile is available. Right now don't want to train the classifier so want any availlable options if available.

I am trying to use openCV in android. So I am following the link - http://docs.opencv.org/doc/tutorials/introduction/android_binary_package/dev_with_OCV_on_Android.html

My basic intenstion is to create my own Android project and copying all the OpenCV Sample - face-detection sample source code to the new project and test the same to verify the android project setup.

I created an android project XYZ and then added the openCV library, then copied the jni directory from OpenCV Sample - face-detection to XYZ project and then trigger http://docs.opencv.org/doc/tutorials/introduction/android_binary_package/android_dev_intro.html#cdt-builder

which generate a armeabi-v7a directory inside lib folder. Then I copied all the sourcecode from sample to xyz and run and then I found the following error-

java.lang.UnsatisfiedLinkError: Native method not found:

com.example.emotiondetector.DetectionBasedTracker.nativeCreateObject:(Ljava/lang/String;I) at com.example.emotiondetector.DetectionBasedTracker.nativeCreateObject(Native Method)

at com.example.emotiondetector.DetectionBasedTracker.<init> com.example.emotiondetector.FdView.<init>(FdView.java:146)

Means jni didnt work properly. Can anyone suggest where did I miss the core thing ?

Following warning came while generating jni-

C:\android-ndk-r9-windows-x86_64\android-ndk-r9\ndk-build.cmd Android NDK: WARNING:jni/Android.mk:detection_based_tracker: non-system libraries in linker flags: -lopencv_java Android NDK: This is likely to result in incorrect builds. Try using LOCAL_STATIC_LIBRARIES Android NDK: or LOCAL_SHARED_LIBRARIES instead to list the library dependencies of the Android NDK:
current module Install : libdetection_based_tracker.so => libs/armeabi-v7a/libdetection_based_tracker.so

AFter quick search I found its a popular problem-

"java.lang.UnsatisfiedLinkError: Native method not found: com.test.camera.DetectionBasedTracker.nativeCreateObject:(Ljava/lang/String;I)J", FdView.java ->

But couldnt get any solution ...

I am trying t

I am trying to run OpenCV Sample - face-detection example because found lot of response saying to use this version of openCV not javaCV as it still uses old version. But the problem is this sample get crashes if I try to do the detection with front Camera within no time.

mCamera = new VideoCapture(Highgui.CV_CAP_ANDROID_FRONT);

I changes this to make front camera work but it restarts my mobile ie Nexus4 which hardware has a good benchmark. So if Nexus4 is failing means somewhere big resource issue Where can i sort it out as Android is not at all giving or throwing any error and by the time I reach to solve the same it get crashes.

updated the screenshot , its better but not perfect, since it was not perfect thats why I moved to full screen mode, but i think I need to work in this only

@steven , which all APi's are old here , i will then change them .. considering Android and javaCV are the only choices left with me, then

actually i tried that and in that case Face rectangle goes more left and mouth rectangle doesn't even visible. Thats why I modified that part

I am trying to do a FaceDetection over an Image displayed over Android ImageView. I have made the ImageView as fulls screen mode, then I loaded the Image from storage as-

IplImage image = cvLoadImage(strImageFilePath, // filename
                CV_LOAD_IMAGE_GRAYSCALE);

Then I ran the classifiers and then tried to draw the rectangle but its coming some other region-

canvas.drawRect(new Rect(x, y, x + w, y + h), paint);

Following is the code sample-

public void process(String strImageFilePath) {


        ClassifierLoader classifierLoader = ClassifierLoader.getInstance(getContext());
        classifier = classifierLoader.getClassifier_face();
        classifier_mouth = classifierLoader.getClassifier_mouth();
        IplImage image = cvLoadImage(strImageFilePath, // filename
                CV_LOAD_IMAGE_GRAYSCALE);
        cvClearMemStorage(storage);
        Log.i("imageimage ", ""+image.height()+" Width "+image.width());


        cvClearMemStorage(storage);
        faces = cvHaarDetectObjects(image, classifier, storage, 1.1, 4,
                CV_HAAR_FIND_BIGGEST_OBJECT | CV_HAAR_DO_ROUGH_SEARCH);
        mouth = cvHaarDetectObjects(image, classifier_mouth, storage, 1.1, 3,
                CV_HAAR_FIND_BIGGEST_OBJECT | CV_HAAR_DO_ROUGH_SEARCH);

        invalidate();

        Log.i("AYA ", "IMAGE AAYA " + image+" FAC "+faces.total()+" mouth "+mouth.total()+ " THIS "+this.getWidth() );

    }

    @SuppressLint("DrawAllocation")
    @Override
    protected void onDraw(Canvas canvas) {
        super.onDraw(canvas);
        Paint paint = new Paint();
        paint.setColor(Color.RED);
        paint.setTextSize(20);
        paint.setStrokeWidth(8);
        paint.setStyle(Paint.Style.STROKE);
        canvas.drawCircle(20, 40, 5, paint);
        if(faces != null){
        if (faces.total() > 0) {

            String s = "Processed Face";
            float textWidth = paint.measureText(s);
            canvas.drawText(s, (getWidth() - textWidth) / 2, 20, paint);
            CvRect r = new CvRect(cvGetSeqElem(faces, 0));
            int x = r.x(), y = r.y(), w = r.width(), h = r.height();
            Log.i("IMAGE VIEW DRAW ", "x "+x+" y "+y+" w "+w+" h "+h);
            canvas.drawRect(new Rect(x, y, x + w, y + h), paint);

            if(mouth.total() > 0){
                CvRect rct = new CvRect(cvGetSeqElem(mouth, 0));
                canvas.drawRect(new Rect(rct.x(),rct.y(),rct.x()+rct.width(),rct.y()+rct.height()), paint);
            }

        }
    }
    }

I believe I need to do something with the height of IplImage but since I am directly loading the same from storage , it might be the issue. I actually wanted to load the image from image viewer but I couldn;t get it :( http://answers.opencv.org/question/22636/how-to-load-an-iplimage-from-android-imageview/?comment=22662#comment-22662

This is how algorithm is currently drawing the rectangle-

on Using drawing rectangle as-

 canvas.drawRect(new Rect(x, y, w, y ), paint);

the Mouth rectange is not at all visible.

One observation I found is that the rectangle it draw is not for the face size, but it will match if I open the same window in portrait mode, so It may be something doing for portrait mode, and I need to somewhere invert the image. I am here directly just opening the Image in landscape mode

and If I don;t use full screen mode, then things are quite better like -

But still not the perfect, using canvas.drawRect(new Rect(x, y, x + w, y + h), paint); Other case doesn;t even show the rectangle

@Moster, yes :( because I was unable to get the bytes from ImageView and then draw an IPlImage, what I did is anyway ImageView was full screen mode , so I just read it from system.

thanks @berak for notifying the point of converting pixel to IplImage..I'll look into it

ok I realized one thing that even IplImage.asCvMat is there to use

Moster.. sorry for that.. yes I admit thats a wrong point of asking ..@berak.. does it mean I can comfortably use IplImage in javaCv ..

any idea about equivalent of Utils.bitmapToMat(bmp32, imgMat); in javaCV

Mat image = Highgui.imread("/sdcard/TVguide/Detection/detected.jpg"); hows this ?

I have an image displayed in android ImageView. Now I want to convert that image to openCV IPlImage, how to do that. I am not reading the image file from file system because I want to draw on android imageView and width and height of the image displayed on imageView and original image in the storage will be different.

And the solution I used is-

IplImage image = cvLoadImage(strImageFilePath, // filename
                CV_LOAD_IMAGE_GRAYSCALE);

I am trying to implemented Face and mouth detection in Android using JavaCV. Things are happening in Landscape mode within a region. FaceDetection is working fine but MouthDetection is failing. Actually Even after Face is detected, I need to process as scaling and all then it worked but the same calculation you can doesn't work with Mouth.

 protected void onDraw(Canvas canvas) {

            Paint paint = new Paint();
            paint.setColor(Color.RED);
            paint.setTextSize(20);


            String s = "Face Detected - This side up.";
            float textWidth = paint.measureText(s);
            canvas.drawText(s, (getWidth()-textWidth)/2, 20, paint);        
            if (faces != null) {
                paint.setStrokeWidth(4);
                paint.setStyle(Paint.Style.STROKE);
                float scaleX = (float)getWidth()/grayImage.width();
                float scaleY = (float)getHeight()/grayImage.height();
                int total = faces.total();
                for (int i = 0; i < total; i++) {               
                    CvRect r = new CvRect(cvGetSeqElem(faces, i));


                    int x = r.x(), y = r.y(), w = r.width(), h = r.height();
                    float xAxis = x*scaleX;
                    Rect rTest = new Rect((int)(2*xAxis-xAxis/6),(int)(y*scaleY), (int)((x+w)*scaleX+(x+w)), (int)((y+h)*scaleY));
                    canvas.drawRect(rTest, paint);
                   // canvas.drawRect(x, y,x+w,y+h,paint);

                    cvClearMemStorage(storage);    
                    //cvSetImageROI(grayImage,new CvRect(r.x(),r.y()+(r.height()*2/4), r.width(), r.height()/3));
                    //cvSetImageROI(grayImage, new CvRect(rTest.left, rTest.top, rTest.right, rTest.bottom));
                    detectMouth(new CvRect(rTest.left, rTest.top, rTest.right, rTest.bottom) ,canvas);

                }
            }


    private void detectMouth(CvRect r, Canvas canvas) {
            Paint paint = new Paint();
            paint.setColor(Color.BLACK);
            paint.setTextSize(40);
            paint.setStrokeWidth(4);
            paint.setStyle(Paint.Style.STROKE);

            int x = r.x(), y = r.y(), w = r.width(), h = r.height();


            String s = "Emotion Detected";
            float textWidth = paint.measureText(s);
            canvas.drawText(s, (getWidth()-textWidth)/2, 40, paint);   

            //cvResetImageROI(grayImage);
            int total = mouth.total();
             for (int i = 0; i < total; i++) {
                 CvRect rM = new CvRect(cvGetSeqElem(mouth, i));
                 cvClearMemStorage(storage);    
                    //L,T,R,B

// This needs change
                 canvas.drawRect(x+rM.x(), 4*rM.y()+y, Math.min(w-rM.width(), 9*rM.width()), Math.max(h-rM.height(),14), paint);
             }

             cvResetImageROI(grayImage);
        }

If I simply write-

canvas.drawRect(x,y,x+w,y+h)

Then mouth rectange works fine but it doesn't come inside Face rectangle , it displays in some part of the screen. Please suggest how should I write the proper rectangle algorithm for Mouth Detection

canvas.drawRect(x+rM.x(), 4*rM.y()+y, Math.min(w-rM.width(), 9*rM.width()), Math.max(h-rM.height(),14), paint);

Above is the part which needed a proper change.

It was bit easy , I was sincerely creating a mess..

• Check for the main classifier, I mean first you need to find the face before finding eyes and mouth.
• Find the face by running classfier, inside each face try to run other classifiers of eyes, nose , mouth
• Once you find them draw :-)

I've detected a mouth of an image in javaCV using harcascased of haarcascade_mcs_mouth.xml. Now I've mouth rectangle , now I want to store the data and compare the data with other person mouth data.

So how should I do that , checking specific mouth data with other person's mouth data

If I am not clear , will try to explain again .

:-) sorry again for that , any source for training data . And is it actually easy to generate those big big xml files

sorry its should be emotion , it should be mouth. Training the xml , this is what I want to know properly but as a very new user to this platform and moreover no C++ bakcground creating issue, Can any link there which will make my life bit easier to understand of training the classifier

I have an Image , and I want to extract data of Mouth in the face from the Image only in JavaCV. Then I want to compare the same from large database of images (different emotions) and then would like to find the best matched.

I have two questions here- have two questions here- 1. 2.

How to extract emotion data from image.. How to extract emotion data from image.

How to map this with DB images as DB images are some other images , and data extracted from

emotion will be different faces. SO wont the mapping hurt or what all the steps I need to care for achieve.. How to map this with DB images as DB images are some other images , and data extracted from emotion will be different faces. SO wont the mapping hurt or what all the steps I need to care for achieve.

if its android use javaCV, and rest of the code will work in android platform

have you found the output, if yes can you please update here..

check the sample , there is a way mentioned to use Native camera or the java Camera , any one of them?

In the basic Object detection javaCV example , i tried to use two classifiers, one for face and other one for eyes. But surely I am doing something wrong that always the single one is coming. I am doing this just for the sake of learning , I even checked other example of OpenCV , but couldn't find whats wrong i am doing.

protected void processImage(byte[] data, int width, int height) {
    // First, downsample our image and convert it into a grayscale IplImage
    int f = SUBSAMPLING_FACTOR;
    if (grayImage == null || grayImage.width() != width/f || grayImage.height() != height/f) {
        grayImage = IplImage.create(width/f, height/f, IPL_DEPTH_8U, 1);
    }
    int imageWidth  = grayImage.width();
    int imageHeight = grayImage.height();
    int dataStride = f*width;
    int imageStride = grayImage.widthStep();
    ByteBuffer imageBuffer = grayImage.getByteBuffer();
    for (int y = 0; y < imageHeight; y++) {
        int dataLine = y*dataStride;
        int imageLine = y*imageStride;
        for (int x = 0; x < imageWidth; x++) {
            imageBuffer.put(imageLine + x, data[dataLine + f*x]);
        }
    }

    cvClearMemStorage(storage);
    faces = cvHaarDetectObjects(grayImage, classifier, storage, 1.1, 3, CV_HAAR_DO_ROUGH_SEARCH | CV_HAAR_FIND_BIGGEST_OBJECT);
    faces = cvHaarDetectObjects(grayImage, classifier_eyes, storage, 1.1, 3, CV_HAAR_DO_CANNY_PRUNING);
    postInvalidate();
}

Here I've tried to add both the classifiers to the same face Object. Initially it was just one. Here always the last one takes preference, can anybody suggest the actual way to add two classifiers in the following scenario

i tried following piece of code under onPreviewFrame overriden method but no luck-

IplImage my_image = (IplImage) grayImage; CvMat mat = my_image.asCvMat();

    int cols = mat.cols();
    int rows = mat.rows();
    IplImage DstImage = cvCreateImage(cvSize(rows, cols), IPL_DEPTH_8U, 1);


   int angle = ((180 / 90) % 4) * 90;

    //0 : flip vertical; 1 flip horizontal
    int flip_horizontal_or_vertical = angle > 0 ? 1 : 0;
    int  number = Math.abs(angle / 90);
    for(int i = 0; i != number; ++i){
        cvTranspose(grayImage, DstImage);        
        cvFlip(grayImage,DstImage,flip_horizontal_or_vertical);
    }

I tried-

IplImage my_image = (IplImage) grayImage; CvMat mat = my_image.asCvMat();

    int cols = mat.cols();
    int rows = mat.rows();
    IplImage DstImage = cvCreateImage(cvSize(rows, cols), IPL_DEPTH_8U, 1);


   int angle = ((180 / 90) % 4) * 90;

    //0 : flip vertical; 1 flip horizontal
    int flip_horizontal_or_vertical = angle > 0 ? 1 : 0;
    int  number = Math.abs(angle / 90);
    for(int i = 0; i != number; ++i){
        cvTranspose(grayImage, DstImage);        
        cvFlip(grayImage,DstImage,flip_horizontal_or_vertical);
    }

But couldnt get anything

What if i use javacv layer or face recognition example in android .. It working but getting some problem sometime

Same issue I found in android while using javacv. Any suggestion to get rid of it in java way

did u find any solution for the problem ?