OpenCV 4.5.x - Include additional Feature Detection Algorithms

We recently have gained the ability to use SIFT in addition to HaHOG, which is great.

From reading further on the OpenCV Documentation (https://docs.opencv.org/master/db/d27/tutorial_py_table_of_contents_feature2d.html), it looks like there may yet be other Feature Detection algorithms that may offer us further benefits over HaHOG/SIFT.

SIFT (Scale-Invariant Feature Transform):

SURF (Speeded-Up Robust Features):

ORB (Oriented FAST and Rotated BRIEF):

This paper highlights SIFT/SURF/ORB (among others that OpenCV doesn’t seem to expose):

My impression is that SIFT/SURF/ORB are all quite good, with SURF being faster and less computationally intense than SIFT, and ORB being the most efficient with the lowest computational cost, as well as having the highest number of detected features.

Another article showing some examples:

Looks like SIFT might be the most robust overall in difficult conditions, though ORB matches it in noisy conditions.

SIFT distributes features randomly across the frame/images, ORB concentrates on the middle.

I think for possible defaults, ORB could be used for situations like mapping buildings and solar panels/etc, as it sounds like this is ORB’s jam (constructing edges/corners).

2 Likes