Will OpenCV be useful for my situation?

asked 2017-07-27 15:10:53 -0500

DavevH gravatar image


I've been looking on Google for something that can help me with recognizing specific images, and every time I kept seeing OpenCV come up on top, so I thought I'd look on the site for a bit if it was what I needed. There's an astounding amount of information, and I'm having some trouble trying to figure out if what I need is listed under it.

Basically, me and a few others are trying to figure out the droprates of items and patterns of it in a game. So far we've been just manually entering all the information in a spreadsheet, but since we expect to need well over a few thousand entries, doing this all by hand will be quite the pain. The game conveniently shows a loot interface so you always know what you got exactly. (ex. https://gyazo.com/6baadbcec0c1599bb9d...)

So what I'm looking for is the following; a piece of software that with the click of a button or a hotkey can recognize images within a certain region on screen and log what it has found in a .txt file so that it can easily be exported to a spreadsheet. Not only does it need to recognize the images of the objects themselves, but also recognize the associated quantity that is listed in the top left of that object. I can find all the raw images (with a transparent background) and the font type without any problem, so it really only is about the recognition part. It also would be nice if this software could be compiled into an .exe file so that whoever wants to use it to help, doesn't need to install OpenCV to make it work.

If this is possible, I'd highly appreciate if you could give me a few links with reading material to help me on my way. I don't mind tackling some projects that might be bigger than I imagined them, but I do struggle with finding the information I need in a sea of other information :-)

edit retag flag offensive close merge delete


To recognize the text, what you are looking for is an optical character recognition engine (OCR). You can have a look at tesseract or the text module in OpenCV contrib.

Note that some text are "occluded" by the background and you should expect some failure.

You should make clearer that the template matching part is already done in the text ("I can find all the raw images (with a transparent background) and the font type without any problem") and in the first paragraph describe that what you are looking for is something to recognize text in images.

Eduardo gravatar imageEduardo ( 2017-07-28 04:54:05 -0500 )edit

Oh, my apologies. Seems I kind of made a mess of that sentence... What i meant is that I can pull those from a game wiki page to insert as images to look for, not that I actually have something working already that finds those images on screen.

DavevH gravatar imageDavevH ( 2017-07-28 06:39:43 -0500 )edit

See template matching:

Eduardo gravatar imageEduardo ( 2017-08-01 10:01:31 -0500 )edit