Feature detection is very important to image processing area. In this paper we compare and analyze some characteristics of image processing algorithms for corner and blob feature detection. We also analyze the simulation results through image matching process. We show that how these algorithms work and how fast they execute. The simulation results are shown for helping us to select an algorithm or several algorithms extracting corner and blob feature.
In computer vision, a feature can be defined as an interesting part or point of an image, as in
. A feature contains some information which apart from its neighborhood. It means that the feature is considered distinctiveness within a certain range. These features could be shape, texture, color, edge, corner and blob etc. Features have high informative contents and appear over and over again in different images. They may be described by the shape, edge or color of objects, or the correlations between two or more images or objects. Until now, many image processing algorithms are based on image feature such as photo stitching, self-localization of robot, objects recognition, object tracking and 3D reconstruction.
, image feature detection refers to methods to compute abstraction of image. Tuytelaars and Mikolajczyk
addressed an overview of invariant interest point detectors, how they evolved over time, how they work, and what their respective strengths and weaknesses are. The three robust feature detection methods scale invariant feature transform (SIFT), principal component analysisSIFT and speeded up robust features (SURF) were summarized in
, blob feature detection is defined as one of feature detection. The blob detection is a mathematical method which detects regions or points in a digital image. The regions or points have noticeable difference with their neighborhood. Additionally, a blob is a region or point in which some properties are invariant within a prescribed range of values. Kim and Seo
introduced genetic programming based corner detectors for an image processing. In
, some applications for image processing were presented.
In this paper, we present that how some existed corner and blob feature detection algorithms work and how long they execute for an analysis of some different algorithms. And we also discover the application context for each algorithm. The related works are presented in Section 2. In Section 3, the overview of the corner and blob feature detection algorithms are discussed. Some experiments and simulation results are shown in Section 4. We describe some discussions and future works in Section 5. We here see that Harris corner detection can detect a large number of interest points, but they contain less information for interest point region. Difference of Gaussian (DoG) and determinant of the Hessian (DoH) have similar results in interest point detection, but DoH has faster than that of DoG.
2. Some Algorithms for Feature Detection
In 1988, Harris and Stephens
proposed a method to detect a corner of an image, which is later called Harris Corner Detector. The method is based on the eigenvalues of the second-moment matrix. The Harris Corner can detect robust corner of an image. However, the algorithm only detects the location of corner, and avoids the interest points which not belong to the corner.
In 1997, a new algorithm called features from accelerated segment test (FAST) was proposed for corner detection. The most contribution of FAST is its computational efficiency. Comparing with other well-known feature detection algorithms such as Harris Detector, smallest univalue segment assimilating nucleus and DoG, it is so faster. So, FAST has been applied in many real time applications such as cleaning robot.
Laplacian of the Gaussian (LoG) is one of the first and also most common blob detectors. The blob feature can be detected from different scale. In comparison with corner algorithms, the scale-space theory is leaded into for detecting interest point of image and a blob contains more information than a corner feature. It means that the point can be described by its neighborhood around it. The feature detection is performed to blob detection from corner detection. In 1999, Lowe used DoG to replace LoG for detecting the interest point with rapid calculation.
Because Hessian matrix has a good performance in accuracy, DoH was also used for detection of the blob feature. In 2006, Bay and Tuytelaars used the scale-normalized DoH from Haar wavelets to detect the interest point. From their experiment results, DoH has similar effect in the interest point detection with DoG, but it is three times faster than that of DoG.
In order to detect image features which are invariant through image affine transformation, Mikolajczyk and Schmid
proposed Harris affine detector in. Harris affine detector identifies initial blob using Harris-Laplace detector and then normalizes the blob using affine shape adaption. And the blob is estimated iteratively. The algorithm can identify similar regions between images. However, the algorithm expends a great of time.
3. Blob Feature Detection
For the comparison of several algorithms, we describe the implementation of the detection methodology by step
- 3.1 Harris Corner Detector
Let the image be given by
stands for a Harris matrix,
is weighted window,
is the partial derivatives of
(x, y, σ) is Gaussian matrix and expressed in Eq. (5).
For each pixel, Harris and Stephens used Eq. (2) to compute corner response for the computational efficiency,
is a tunable sensitivity parameter. If the
of the point is greater than the given threshold, the point is considered to be a corner.
Kanade and Tomasi
computed directly the
are the eigenvalues of
A large number of experiments have approved that the method is better results because the corner is more stable for tracking.
- 3.2 FAST
The FAST uses a circle of 16 pixels to determine whether the center of circle is a corner, like
1) Assume that the intensity of the center of the circle isIp. Set a threshold intensity valueT.
2) For fast computing,Ipis first compared to the intensity of pixelsI1,I5,I9, andI13. If at least three pixels of these four pixels are all brighter thanIp+Tor darker thanIp–T, the corner will exist. If not, it will be quit.
Set of N contiguous pixels to be determined as a corner (using FAST). p is a center of circle. FAST, features from accelerated segment test.
Discrete approximations to the Laplacian filter.
3) If a set of N contiguous pixels out of the 16 needs to be either above or belowIpby the valueT, thenIpis a corner.
- 3.3 LoG
The Laplacian is a 2D isotropic measure of the second order derivative of an image. The Laplacian
(x, y) of the original image
is given as follows.
Because the original image is represented as a set of discrete pixels, the Laplacian can be approximated by using a discrete convolution kernel as shown in
Because the Laplacian filter is very sensitive to a noise, it is common to smooth image using a Gaussian kernel of Eq. (5) before applying the Laplacian filter.
So, the two-step process is called LoG operation. The overall process for LoG is as follows:
In order to detect the blob features which are invariant in different environment, a multi-scale σ is used to filter the original image. A scale-normalized approach is necessary to obtain a multi-scale blob detector with automatic scale selection as the following Eq. (7).
The points are considered as the interest points (blob feature) which are local maxima or minima of Δ
- 3.4 DoG
Similar to LoG, the image I is first smoothed by convolution with Gaussian kernel of a certain widthσ. Then a different Gaussian kernel σ + Δσ is used to smooth the original image again. The difference of these two Gaussian smoothed images is called DoG, as the following Eq. (9).
In fact, DoG is a band-pass filter, which can remove high frequency components representing noise and some low frequency components representing the homogeneous areas.
The DoG is one of applicants for edge detection and blob detection in image processing algorithm. The best known application is a keypoint detection proposed by Lowe
For fast computing in , DoG is defined as an operator or a convolution kernel like the following Eq. (10).
- 3.5 DoH
The Hessian matrix is a square matrix of the second partial derivatives of the function and it could be described by the local curvature of an image as mentioned in
Similar to LoG, DoH considers scale-space to detect the interest points.
The interest points are selected using the following function to find maxima in scale-space.
DoH was used in SURF
, the detection effect of the interest points is similar with SIFT. However, the detection time is three times faster than that of the SIFT through integral image used.
- 3.6 Harris Affine Region Detector
According to affine-invariant theory and multi-scale Harris corner points detection theory, Harris affine detector uses following iterative methods to detect interest points.
1) Initialize the search space through Harris-Laplace detector.
Identity Matrix E
2) Normalize ellipsoid region to circle region using the shape adaptation matrix which generated in pervious iteration
, center in
3) Select the integration scale, σ
. The σ
is determined as the scale that maximizes the LoG.
4) Select the derivation scale, σ
. The derivation scale istaken to be related to the integration scale through a constant factor: σ
∈ [0.5, ⋯ , 0.75], and
is the second moment matrix, and λ
are the Maximum and Minimum eigenvalues of the matrix
is also defined as
5) Spatial localization: select the point
that computes the Harris corner measure (cornerness) within an 8-point neighborhood around
. Find the maximum in the neighborhood,
is as follows:
where the window
is the set of 8-nearest neighborhood of the pervious point.
Compute the location of interest point
6) Update the shape adaptation transformation matrix
7) Compute the stopping criterion. Sufficiently close implies the following stopping condition.
Mikolajczyk and Schmid had good result with
Meanwhile, a detection algorithm called Harris affine region detector are proposed. The Harris affine detector relies on the combination of corner points detected thorough Harris corner detection, Gaussian scale space, and affine shape adaptation algorithm. And like the Harris affine algorithm, the Hessian affine replaces Harris matrix using Hessian matrix for detecting affine interest points.
4. Simulation and Analysis
In this Section, some simulation results of corner and blob detection algorithm will be presented. For comparison, two sets of images are selected for simulation. The images were captured in different view perspectives as shown in
Capture images in different viewpoints.
Simulation results of Harris corner detection algorithm.
- 4.1 Harris Corner Detector
According to the method in Section 3, we use four images for the simulation. The simulation results are shown as followings.
From two set of images in
, a large number of corners are detected. In the same position of two images, the same corners were detected.
Interest points by Laplacian of the Gaussian detection algorithm.
- 4.2 LoG
Scale-space has been led to detect interest points. The interest point not only contains the coordinate, but also the scale which descripts an effect of interest point to its neighbor.
, the detected interest points are less than that of Harris corner detection algorithm and its computation speed is also slower.
- 4.3 Harris-Laplace
Because of similar results between LoG and DoG, the scalespace has been used for Harr corner detection, which is called Harris Laplace detection.
, the results have a smller number of interest points. The computing time is similar to that of LoG.
- 4.4 DoH
In DoH, integral image has been led to fast detection of interest points. The computing time is also three times faster than that of LoG.
shows interest points detected by DoH algorithm. The great advantage of DoH is computing time. If scale-space
Interest points by Harris-Laplace detection algorithm.
Interest points by DoH detection algorithm.
is not particularly large, DoH can be used for real-time interest points detection.
Simulation results of Harris affine detection algorithm.
- 4.5 Harris Affine Region Detection
For the affine transformation and denser descript object, affine shape adaptation is used. The feature of images is not descripted by a circle such as those of LoG and DoH, but an ellipse.
, each interest point contains an ellipse region. We could see that the ellipses have similar pixels and similar orientations by the comparison of two sets of images. This provides great convenience for more accurate matching in two images. However, the iterative time for learning is equally vast.
In this paper, a comparative analysis for some corner and blob detection algorithms has been done. Harris corner detection can detect a large number of interest points and has good performance in interest point’s robust and computing time. These points can reflect texture of objects. However, these points contain less information for interest point region. Through scale-space has led to detect interest points of image, the interest points have been replaced by blobs. The blob is easier to reflect the feature of interest point region in different environment change such as illumination, rotation and scale of images. For simulation results in DoG and DoH, both have similar result in interest point detection, but DoH has faster than that of DoG. Harris affine region detection algorithm added affine shape adaptation for region normalization. The blob detection satisfies image affine transformation. However, the computing time and complexity are much increased by the iteration.
- Conflict of Interest
No potential conflict of interest relevant to this article was reported.
“Feature detection (computer vision)”
“Local invariant feature detectors: a survey”
Foundations and Trends in Computer Graphics and Vision
DOI : 10.1561/0600000017
“A comparison of SIFT, PCA-SIFT and SURF”
international Journal of Image Processing
Kim Y. K.
Seo K. S.
“Automated generation of corner detectors using genetic programming”
Journal of Korean Institute of Intelligent Systems
DOI : 10.5391/JKIIS.2009.19.4.580
Boo C. J.
Kim H. C.
Kang M. J.
“Image reconstruction of subspace object using electrical resistance tomography”
international Journal of Fuzzy Logic and Intelligent Systems
DOI : 10.5391/IJFIS.2006.6.1.047
Byun O. S.
Moon S. R.
“A study on fuzzy wavelet basis function for image interpolation”
international Journal of Fuzzy Logic and Intelligent Systems
DOI : 10.5391/IJFIS.2004.4.3.266
Choi B. J.
Lee M. H.
“Design of a recognizing system for vehicle’s license plates with english characters”
international Journal of Fuzzy Logic and Intelligent Systems
DOI : 10.5391/IJFIS.2009.9.3.166
“A combined corner and edge detector”
in Proceedings of the 4th Alvey Vision Conference
August 31-September 2
“An affine invariant interest point detector”
Computer VisionECCV 2002, Lecture Notes in Computer Science
DOI : 10.1007/3-540-47969-4_9
“Good features to track”
in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
DOI : 10.1109/CVPR.1994.323794