what is feature detection and extraction?

feature detection is the process of identifying specific points or patterns in an image that have distinctive characteristics.

feature extraction involves describing these detected features in a way that can be used for various computer vision tasks.

together, these steps allow computers to understand and interpret visual data more effectively.

types of features

we can categorize features into three different types as shown below −

edges: these are boundaries where the image brightness changes sharply. they represent the contours of objects within an image.
corners: points where two or more edges meet. they are often found at the intersections of different shapes or objects.
blobs: regions in the image that differ in properties, such as brightness or color, compared to surrounding regions.

following are some frequently used techniques for feature detection and extraction −

edge detection
corner detection
blob detection
feature descriptors

edge detection

edge detection identifies points in an image where the brightness changes sharply. this helps in highlighting the boundaries of objects within the image.

the common edge detection methods are as shown below −

sobel operator: computes the gradient of the image intensity at each pixel, resulting in edges being highlighted.

import cv2
import numpy as np

# load image in grayscale
image = cv2.imread('image.jpg', cv2.imread_grayscale)
# apply sobel operator
sobel_x = cv2.sobel(image, cv2.cv_64f, 1, 0, ksize=5)
sobel_y = cv2.sobel(image, cv2.cv_64f, 0, 1, ksize=5)
sobel_combined = cv2.sqrt(sobel_x**2 + sobel_y**2)

canny edge detector: a multi-stage algorithm that detects a wide range of edges in images.

edges = cv2.canny(image, 100, 200)

corner detection

corner detection identifies points in an image where two or more edges intersect. corners are useful for tracking and matching objects between different images.

the common corner detection methods are as shown below −

harris corner detector: uses the differential of the corner score with respect to direction to find corners.

corners = cv2.cornerharris(image, 2, 3, 0.04)

shi-tomasi corner detector: an improved version of harris corner detector that selects the strongest corners.

corners = cv2.goodfeaturestotrack(image, 100, 0.01, 10)
corners = np.int0(corners)
for corner in corners:
   x, y = corner.ravel()
   cv2.circle(image, (x, y), 3, 255, -1)

blob detection

blob detection identifies regions in an image that are significantly different in properties compared to surrounding regions. blobs can represent objects, shapes, or areas of interest.

the common blob detection methods are as shown below −

laplacian of gaussian (log): detects blobs by finding zero-crossings in the laplacian of the image.
difference of gaussians (dog): approximation of log, detects blobs by subtracting two blurred images.
simpleblobdetector: a built-in method in opencv that detects blobs based on parameters like area, circularity, and convexity.

params = cv2.simpleblobdetector_params()
detector = cv2.simpleblobdetector_create(params)
keypoints = detector.detect(image)
im_with_keypoints = cv2.drawkeypoints(image, keypoints, np.array([]), (0,0,255), cv2.draw_matches_flags_draw_rich_keypoints)

feature descriptors

once features are detected, feature descriptors describe these features in a way that can be used for matching or recognition. descriptors encode the appearance and shape of features into numerical vectors.

the common feature descriptors are as shown below −

scale-invariant feature transform (sift): detects and describes local features in images, invariant to scale and rotation.

sift = cv2.sift_create()
keypoints, descriptors = sift.detectandcompute(image, none)

speeded-up robust features (surf): similar to sift but faster and less accurate.

surf = cv2.surf_create()
keypoints, descriptors = surf.detectandcompute(image, none)

oriented fast and rotated brief (orb): a fast alternative to sift and surf, combining the fast keypoint detector and brief descriptor.

orb = cv2.orb_create()
keypoints, descriptors = orb.detectandcompute(image, none)

applications of feature detection and extraction

feature detection and extraction are used in various computer vision applications, such as −

object recognition: identifying and classifying objects within an image.
image matching: finding similar images or matching features between different images.
motion tracking: tracking the movement of objects across a sequence of images.
3d reconstruction: building a 3d model from multiple 2d images.

Save or share this article