Hi,
I'm trying to use opencv to detect frets and strings on guitar fretboard and be able to index and display some kind of information on them, like on the attached screenshot.
Here are requirements I'd like to comply with:
- I'd like it to run it in realtime ( minimum 30fps ) on mobile
- The whole fretboard will be visible and will not be occluded in any way
- Neck and guitar body will be visible at least partially (I'm thinking about using them as corners)
- I don't want to use paper markers or anything like that
- I'd like to be able to display 3d objects on certain fret / string, for example, display a small box on fret 1, string 5
- Fretboard might be presented with a slight angle
Is something like that feasible ? Could you please point me an effective way to approach this problem ? Which algorithms methos will be best to approach this ?
Please check the attached screenshot to see exactly what I'm talking about.
