Joint transform correlator (JTC) has been the most suitable technique for real time pattern recognition. This paper proposes a new phase adjustment which adopts two steps of random phase adjustment in the spatial domain and additional phase adjustment in the Fourier domain. Simulated results are presented to show the optimum condition of the phase adjustment and the effect on the correlation peaks, the peak signaltonoise ratio and the level of discrimination.
I. INTRODUCTION
Joint transform correlator (JTC) has shown remarkableachievements and is a useful alternative to the other opticalsystems [13] for pattern recognition and target trackingapplications. The typical advantages of the JTC is that ituses a type of real time optical system which quantitativelycompares images by measuring correlation peaks andpeak signaltonoise ratios (PSNR). However, it has someproblems on nonlinearity of the optical component such asa digital camera and on weak correlation discriminationcaused by noise.
Recently, many kinds of methods for solving such problems in the JTC have been studied. Among them, the nonlinear joint transform correlator (NJTC) and the binary NJTC which can solve a problem of the nonlinear and digital components in the JTC system may be the most typical [47]. In spite of such efforts, a weak correlation peak and noise problems still remain. The weak correlation peak and noise problems originate from the interference fringes constructed with Fourier transformed reference and sample images in the Fourier transform plane. Some useful work has been done to solve these problems. Phase and amplitude threshold and fringe adjustment in the spatial or Fourier domains are the most typical methods
[8

11]
.
Unlike the phase threshold technique, which uses thephase information multiplied by a simple phase functionand adds a binarization step in the Fourier plane [9], wepropose a new method of random and additional phaseadjusted binary NJTC. The proposed new method utilizesa random phase adjustment in the first step to adjust thephase difference between the reference and input signal,and also an additional phase adjustment in the second stepto minimize the total phase error. This new method showsconsiderably increased correlation peaks and PSNR comparedwith the former techniques of phase threshold multipliedby a simple phase function. Simulated results are presentedto show the optimum condition of adjusting the phasefunction to minimize the total phase difference, and finallyits effects on the correlation peaks, noise reduction and thelevel of discrimination.
In the following sections, the proposed new method ofrandom and additional phaseadjusted binary NJTC systemis described in detail. Section III describes simulationresults and discusses the pattern recognition enhancement,and finally some comments are contained in the conclusionsection.
II. NEW RANDOM AND ADDITIONAL PHASE ADJUSTMENT
Figure 1
shows the optical structure of the new random and additional phaseadjusted binary NJTC system which phase compensates to produce the enhanced performance compared to the conventional binary NJTC. Generally, the
Basic architecture of random and additional phaseadjusted binary NJTC system.
JTC has a twostage process. In both stages the image ofa coherently illuminated input passes through a lens totake its Fourier transform. In the first stage of the JTC thebasic operation is to get the information of the object Fouriertransformed by Fourier transform lens L1 onto Fourierplane. Let us call the reference image r(x, y) and the inputimage s(x, y) and assume that those two inputs areseparated by 2xo. Then, the input joint images g(x, y) canbe expressed as
The information acquired on the Fourier plane is shownas mutually interfered fringe pattern between the Fouriertransformed value R(u, v) of the reference image r(x, y)and the Fourier transformed value S(u, v) of the inputimage s(x, y). The Fourier transformed signal of the inputjoint images can be expressed as
The intensity of this interference fringe pattern is calledthe joint power spectrum (JPS) and can be expressed as
Here, * is the phase conjugate, u and v are independent spatial frequency variables scaled by a factor of 2π/λ, where λ is the wavelength of input collimated light and f is the focal length of the Fourier transforming lenses L1 and L2. The first and second terms in Eq. (3) are DC components which degrade the correlated signal obtained on the output plane in the second stage. DC components reconstructing a strong zeroorder peak in the output plane are blocked and nonlinearity parameter k, compensating the nonlinear component problem such as a digital camera are included to obtain a wellcorrelated signal. Equation (4) indicates the JPS excluding the DC terms and including the nonlinearity parameter
k
.
Actually the JPS contains an amplitude and phaseinformation of the reference and the input signals. Thus,Eq. (4) can be expressed as involving the amplitude andthe phase of the Fourier transformed reference and inputsignals as
Here 'G(
u
,
v
)' and 'S(
u
,
v
)' are the amplitudes of the R(
u
,
v
) and S(
u
,
v
), respectively, and φ
_{R}
(
u
,
v
), φ
_{S}
(
u
,
v
)are the phases of the
R(u, v)
and
S(u, v)
, respectively. Now, in this paper a random phase multiplication for phase adjustment was done in the spatial domain, thus Eq. (5) can be expressed as
Here,
ρR(u, v)
and
ρS(u, v)
are the adjusted random phase of the Fourier transformed reference and input signals, respectively. In this paper, the random phase adjustment filter F1 is inserted to compensate the phase error caused by the phase difference of the reference and input images in the spatial domain. The phase error may be assumed to be caused by slight differences between the matched images and the speckle components originating from the picture of the images and the input devices, such as the LCD. These factors of the phase error have to be considered individually, but we integrated all of these factors together for developing the concepts of this paper. Now, in the case of JPS between two identical images, namely the reference and the input images are identical, the phase terms in Eq. (6) become zero. Thus, Eq. (6) can be rewritten as
Here, the adjusting random phase of the reference andthe input signal are assumed to be equal. Thus in the caseof two identical images, the correlation output in theoutput plane, namely the inverse Fourier plane, shows onlytwo strong impulse signals separated by a distance of 4x0.On the other hand, in the case of two different images, thecorrelated output shows two weak impulse signals causedby the phase difference shown in Eq. (6).
However, in the case of two identical images it is notobvious that the correlation peaks are a maximum value inspite of the random phase adjustment as expressed in Eq.(7). Thus, the components of the phase difference expressedin Eq. (6) must be considered to calculate the correlationoutput. Let’s consider first Eq. (4) excluding the DCterms. The output, inverse Fourier transform of Eq. (4),can be expressed as
Here, ⓧ is the correlation operator. If the reference image perfectly matches the input image and there is no phase error between the reference image and the input image, the output can be expressed as
Thus, if we use the phase terms as shown in Eq. (6),Equation (8) can be expressed as
Here,
Δ
φ(
u, v
) = φ
_{R}
(
u, v
)  φ
_{S}
(
u, v
) and
Δ
ρ(
u, v
) = ρ
_{R}
(
u, v
)  ρ
_{S}
(
u, v
). If the reference image perfectly matches the input image and there is no phase error between the reference image and the input image, the output also can be expressed as Equation (9). However, in general, there is some remaining phase error between the reference image and the input image, thus the phase terms involved in Eq.(10) would be inverse Fourier transformed, and would appear in the output plane as sidelobe noise factors around the two strong impulse signals. Therefore, in this paper another additional phase adjustment filter F2 for additional phase
Δ
φ
_{add}
(
u, v
) is added to reduce the remained phase error to zero and to determine its effects on the correlation peaks, noise and PSNR. Thus, the total phase in Eq. (6) can be rewritten as
The purpose of this paper is to minimize this totalphase difference to zero to obtain the maximum correlationpeaks and PSNR by reducing the phase noise involved inEq. (10) to zero. In the next section, we present the simulatedresults by using the mathematical model shown in Eq.(10) and (11).
III. COMPUTER SIMULATIONS
To evaluate the performance of the proposed new technique of random phase adjustment in the spatial domain and additional phase adjustment in the Fourier plane, we prepared two types of 256 × 256 gray images of an airfield. Figure 2 shows input joint images of the reference and the input sample image. In Fig. 2, the upper part is for the matched case and the bottom part is for the mismatched case. In this paper, we introduced two widely used parameters; the correlation peaks and PSNR. Correlation peak
256×256 gray input joint images ; (a) matched case (b)mismatched case.
is defined as the peak magnitude of the correlated signal and PSNR is defined as the ratio of correlation peaks to the average noise around the correlation peaks. If we let the correlation peaks equal '
_{P}
(x,y)', then the PSNR can be defined as.
Where μ represents the mean value, and represents the standard deviation around the peak in the correlation output plane.
Table 1
shows the comparison of the simulation results for correlation peaks and PSNR, where k=0.5. The comparison was done between the conventional binary JTC and our new random phase and additional phase adjusted binary JTC. First, Table 1 indicates the correlation peaks and PSNR in the case of using the conventional binary NJTC. When the reference image is identical with the input image, namely for the matched case, the value of the correlation peaks and PSNR are 2.50×10
^{7}
and 7.08×10
^{3}
, respectively. In contrast, when the two images are different each other, namely for the mismatched case, the value of the correlation peaks and PSNR are 1.74×10
^{6}
and 6.26×10
^{2}
, respectively.
Second, concerning about using the proposed random phase adjustment in the spatial domain, Table 1 indicates that the whole of the correlation peaks and PSNR increased considerably when the random phase adjustment was used in place of the conventional binary NJTC. When the two images are identical each other, the value of the correlation peaks and PSNR are 8.56×10
^{8}
and 8.40×10
^{5}
, respectively. In contrast, when the two images are different each other, the value of the correlation peaks and PSNR are 5.99×10
^{8}
and 3.34×10
^{5}
, respectively.
Next, concerning using the additional phase adjustment in the Fourier domain in addition to the random phase adjustment in the spatial domain, Table 1 indicates that all of the correlation peaks and PSNR increased. When the two images are identical to each other, the value of the correlation peaks and PSNR are 1.24×10
^{9}
and 8.49×10
^{5}
, respectively. In contrast, when the two images are different fromeach other, the value of the correlation peaks and PSNR are 7.84×10
^{8}
and 4.72×10
^{5}
, respectively. Let us pay attention to the values obtained for the correlation peaks and PSNR. From the results obtained we can find that if the conventional binary NJTC is modified with a random phase adjustment and even more with the additional phase adjustment, the correlation output shows highly improved amplitude and phase characteristics. Therefore, this result greatly improves the interference fringe pattern, and finally the correlation peaks and PSNR show more rapidly increased values. In addition, we can say finally that the noise contained in the interference fringe pattern are reduced considerably through the random and additional phase adjustment process.
Table 2
proves these facts more strongly by comparing the ratio of the correlation peaks and PSNR obtained by using both the conventional binary NJTC and the random and additional phase adjusted binary NJTC. First, in the case of the random phase adjustment, when the two images are identical, the ratio of the correlation peaks and PSNR are 35.04 and 118.64, respectively. In contrast, when two images are different from each other, the ratio of the correlation peaks and PSNR are 344.25 and 533.55, respectively. These results reveal that PSNR shows better improvement than the correlation peaks, thus it is clear that the sidelobe noise around the correlation peaks is reduced considerably. Again, these results reveal that the discrimination ratio,
Correlation peak and PSNR for the conventional binary NJTC, random phase and additional phase adjusted binary NJTC
Correlation peak and PSNR for the conventional binary NJTC, random phase and additional phase adjusted binary NJTC
Ratio of the correlation peaks and PSNR for the conventional binary NJTC, random phase and additional phase adjustedbinary NJTC
Ratio of the correlation peaks and PSNR for the conventional binary NJTC, random phase and additional phase adjustedbinary NJTC
by which is meant the mismatching decision, was improved considerably. Second, in the case of the additional phase adjustment, when the two images are identical, the ratio of the correlation peaks and PSNR are 49.60 and 119.92, respectively. In contrast, when two images are different each other, the ratio of the correlation peaks and PSNR is 450.57 and 753.99, respectively. These results reveal the important fact that although the total phase difference of the JPS expressed in Eq. (6) is reduced to zero as expressed in Eq. (7), there still remain some phase problems. Therefore, this kind of remaining phase problem can be removed by additional phase adjustment, and thus finally it brings an additional improvementto the correlation peaks and PSNR.
Correlation peaks variation according to theadditional phase adjustment.
Figure 3
shows these results from a graphical point of view. In this paper, the optimum additional phase adjustment for the maximum correlation peaks is π/4 for both matched and mismatched case. Figure 4, Fig. 5 and Fig. 6 show the two and three dimensional pictures of the correlation peaks of the matched and mismatched cases, respectively, for the conventional binary NJTC, random and additional phase adjusted binary NJTC. Two dimentional pictures in these figures represent only one of two correlation peaks separated by the distance of 4x
_{0}
.
IV. CONCLUSION
In this paper, we presented a new technique of modificationof the binary NJTC by adopting the random phaseadjustment in the spatial domain and additional phase adjustmentin the Fourier domain. Experimental results were presentedto show that the proposed phase adjustment technique cansuccessfully increase the correlation peaks, PSNR. In addition,final results reveal that PSNR shows more improvement thanthe correlation peaks, thus it is clear that the sidelobe noisearound the correlation peaks is reduced considerably by usingthe two steps of the newly proposed phase adjustment.
2D and 3D pictures of the correlation peaks for the conventional binary NJTC (a) matched (b) mismatched.
2D and 3D pictures of the correlation peaks for the random phase adjusted binary NJTC (a) matched (b) mismatched.
2D and 3D pictures of the correlation peaks for the additional phase adjusted binary NJTC (a) matched (b) mismatched.
Weaver C.J
,
Goodman J.W
1966
A technique for optically convolving two functions
Appl Opt
5
1248 
1249
DOI : 10.1364/AO.51248
Mu G.G
,
Wang X.M
,
Wang Z.Q
1988
Amplitudecompensated matched filtering
Appl Opt
27
3461 
3463
DOI : 10.1364/AO.273461
Javidi B
,
Wang J
1991
Binary nonlinear joint transform correlation with median and subset median thresholding
Appl Opt
30
967 
976
DOI : 10.1364/AO.300967
Javidi B
,
Li J
,
Fazollahi A.H
,
Horner J
1995
Binary nonlinear joint transform correlator performance with different thresholding methods under unknown illumination conditions
Appl Opt
34
886 
890
DOI : 10.1364/AO.340886
Alam M.S
,
Awwal A.A.S
,
Karim M.A
1991
Improved correlation discrimination using joint Fourier transform optical correlator
Microwave Opt Technol Lett
4
103 
106
DOI : 10.1002/mop.4650040305
Jeong M.H
2009
Analysis of fingerprint recognition characteristics based on new CGH direct comparison method and nonlinear joint transform correlator
J Opt Soc Korea
13
445 
450
DOI : 10.3807/JOSK.2009.13.4.445
Alam M.S
,
Chen X.W
,
Karim M.A
1997
Distortioninvariant fringeadjusted joint transform correlation
Appl Opt
36
7422 
7427
DOI : 10.1364/AO.367422
Michel H.E
,
Awwal A.A.S
1998
Joint Fourier transform correlation with phase thresholding in the Fourier domain
Opt Eng
37
33 
37
DOI : 10.1117/1.601852
Alam M.S
,
Khan J
,
Bai A
2004
Heteroassociative multipletarget tracking by fringeadjusted joint transform correlation
Appl Opt
43
358 
365
DOI : 10.1364/AO.430358