OpenCV can do that perfectly fine.
- Train cascade classifier detectors for the most common speed signs, only seperating them in different shape models.
- Use the detector to find shape regions.
- Apply local thresholding (which works perfectly fine on speed signs) to make a blob of the speed symbol.
- Apply shape based matching with a database shape.
How to do that is again your task, a good place to start is the search button on top of this forum...