Performance Evaluation of MTF Peak Detection Methods by a Statistical Analysis for Phone Camera Modules

Journal of the Optical Society of Korea.
2016.
Feb,
20(1):
150-155

- Received : December 12, 2015
- Accepted : February 02, 2016
- Published : February 25, 2016

Download

PDF

e-PUB

PubReader

PPT

Export by style

Share

Article

Metrics

Cited by

TagCloud

To evaluate the autofocusing performance of recent mobile phone cameras, it is necessary to determine the peak position of the center field MTF (Modulation Transfer Function), -known as the through focus MTF- of the module. However, the MTF peak position found by conventional methods deviates from the ideal position due to the focus scanning resolution of mobile phone cameras. This inaccurate peak position results in false judgements of the optical performance, leading to yield losses or customer complaints. An increase in the focus scanning resolution can address this problem, but the manufacturing UPH (Unit per Hour) level will also unfortunately increase as well, resulting in a loss of manufacturing capabilities. In this paper, several fitting models are studied to find an accurate MTF peak position within a short period of time. With an analysis of a large amount of manufacturing data, it is demonstrated that the fitting methods can reduce false judgements and simultaneously increase the capabilities of the manufacturing system.
For example, a phone camera consisting of a 1/3” size image sensor with 12 mega pixel and an F/1.8 lens has a depth of focus of only 3.6 μm. Given that the smart phone camera market demands higher resolutions (smaller pixel sizes) and brighter lenses (a short focal length), the depth of focus is becoming shorter with the development of technology. The depth of focus is the amount of the distance between the nearest and farthest objects that appear at an acceptable sharpness, meaning that the image sensor cannot distinguish the resolution performance within the depth of focus
[1]
. Therefore, the scanning resolution of an actuator to find the focal point should be less than the depth of focus. It is also necessary to establish a proper focusing scan range.
Figure 1
depicts the through focus MTF data of an F/1.8 lens at the Nyquist/4 frequency. In order to ensure that the MTF peak is located within a scanning range, the defocus range should be at least ± 30 μm, but a longer range than the simulation data is required (generally twice as long in industry) due to the level of manufacturing tolerance to cover the initial focus position error. The number of focus scanning steps without any optimization will exceed 30, necessitating a long time to evaluate the MTF for each phone camera module. Some customers want to evaluate the MTF of the phone camera module in the low frequency area; in such a case, it will take more time to find the focal point with a longer focus scanning range.
(a) Field information [10] , (b) Through focus MTF data. An F/1.8 lens at the Nyquist/4 frequency requires a scanning range of at least 60 μm.
To reduce the number of focus scanning steps, the double-scan method was introduced. In this method, the initial coarse scan roughly finds the approximate MTF peak position and the second fine scan is repeated around the approximately estimated peak position. This previous MTF peak search method is depicted in
Fig. 2
. In general, the resolution of the first coarse scan is 16 DAC (Digital to Analog Conversion) while the resolution of the second fine scan is 4 DAC, meaning that the resolution of the fine scan is four times better than that of the coarse scan. Given that the sensitivity of the actuator used in this study was 0.5 μm/DAC, the resolutions of the coarse and fine scans were 8 μm and 2 μm respectively, which is less than the depth of focus.
Previous MTF peak searching method.
The number of scanning steps of the previous double-scan method is approximately 20 on average, representing a severe limitation of the manufacturing UPH (Unit per Hour). Moreover, the accuracy of the previous method is still not ideal despite the fact that the resolution of the fine scan is within the depth of focus.
Figure 3
illustrates an inaccurate center MTF peak position as detected by the previous method. The discrete through focus MTF data causes a false MTF evaluation. The amount of the difference between center field MTFs 1 and 2 is negligible; however, the difference in the off-axis MTF between positions 1 and 2 is significant enough to affect the judgement. For example, the off-axis MTF at field position 3 satisfies a criterion associated with the center peak 2 case, whereas it is not in the criterion associated with the center peak 1 case. In order to avoid this mismatched situation, the number of focus scanning steps should increase, but the manufacturing UPH will increase as well. On the other hand, if we reduce the autofocusing resolution to increase the UPH, it will be difficult to find an ideal MTF peak position, leading to false judgements. The goal of this paper is to suggest a reliable means of finding within a short period of time an accurate MTF peak position by a method which can be applied in industrial fields through discrete data fittings. A large amount of manufacturing data was analyzed to demonstrate that the suggested method was safe enough to be implemented in the production processes.
(a) Field information [10] , (b) MTF variation with an inaccurate center peak detection.
Fitting models
Fitting models with five points of discrete MTF data.
The Gaussian model has three parameters: the amplitude ‘a
_{1}
’, peak position ‘a
_{2}
’, and full width at half maximum of the Gaussian function ‘a
_{3}
’. With this function, it is convenient to find the MTF peak position and value because the parameter ‘a
_{2}
’ represents the MTF peak position itself and the amplitude ‘a
_{1}
’ is the MTF value at the peak positon. The polynomial interpolation method was tested with the second degree because high order polynomials yield results similar to those of the spline method as long as instability due to Runge’s phenomenon is eliminated
[2]
. Commercial optical design software, Code-V and Zemax, were used for the spline fitting. The Weibull model was also tested to verify the asymmetric condition of the through focus MTF curve, as shown in
Fig. 4 (d)
[3
,
4]
. Only five data points from the coarse scan were used around the MTF peak position to compare the performances of these four fitting methods, as described in
Fig. 5
.
The method used to avoid the asymmetric through focus MTF curve. Five points of discrete MTF data were used.
The MTF test environment followed ISO-12233, except for the replacement of a reflection chart with a transmittance chart
[5]
. The back light level was controlled such that it exceeded 200 cd/m
^{2}
, with 10% uniformity across the entire chart. The test chart was designed as a seven degree slanted edge checker box, as shown in
Fig. 6
.
MTF test system layout. (a) Overall design of MTF test system. (b) Slanted edge checker box chart.
MTF calculation also referred to ISO-12233. The calculation sequence and algorithm are described in
Fig. 7
.
MTF calculation sequence. (a) Select region of interest, (b) Get edge profile, (c) Project ESF and binning, (d) 4x super sampling ESF, (e) Derivative of ESF → LSF → Hamming window, (f) DFT and normalization.
The SFR (Spatial Frequency Response) was obtained from the normalized DFT (Discrete Fourier Transform) of the LSF (Line Spread Function), as expressed by Eq. (2)
[6
,
7]
.
In Eq. (2), k represents the normalized spatial frequency. Before the DFT, the hamming window W was multiplied by the LSF to reduce the effects of noise by reducing the influence of pixels at the extremes of the window, which had some response due to noise but little response due to the image edge located at the center for the window
[5]
. The LSF was calculated from the derivative of the ESF (Edge Spread Function), as shown below
In Eq. (4), a four-fold super-sampling scheme with binning was adopted to estimate the ESF to increase its accuracy
[8]
.
Normality test of the DAC for each fitting model and discrete DAC.
According to
Table 2
, especially considering the Anderson-Darling result and p-value, the MTF peak position found by the coarse scan was not normal because the p-value was less than 0.05, establishing the validity of the alternative hypothesis, whereas the remaining five methods satisfied the normality test. It should be note that the Anderson-Darling results and the p-value of the previous double-scan method were acceptable but relatively worse than those of the fitting methods, meaning that the result of this study suggests the possibility of the elimination of the second fine scan through the use of the fitting models on the first coarse scan data in order to find the MTF peak position. Normally, it took an average of 526 ms for each focusing step. Calculating 1,400 instances of log data of the samples (phone camera modules), the number of steps in the coarse scan was 10 in average value, while for the fine scan the average was 11. As a result, 21 in total autofocusing steps were required for the previous double-scan method, indicating that it took 11.05 s per phone camera module. With the fitting models, however, the fine scan time could be reduced. The calculation time for data fitting was negligible compared to the fine scan time. Of course, the off-axis MTF at the new focusing position should be considered. In actual experiments, the fitting methods could reduce 2.7 s per phone camera module, while the manufacturing UPH value was improved from 310 to 404. Moreover, the individual plot and histogram shows that the peak position determined by the previous double-scan method remains discontinuous, whereas the fitting methods can find a more accurate MTF peak position between discrete data instances, as shown in
Fig. 9
.
Normality result and basic statistics
Histogram and individual plot for the 1,400 MTF peak position.
One sample was selected and tested 23 times repeatedly. The results shown in the descriptive statistics reach similar conclusion. The standard error of the mean and the standard deviation of each method are displayed in
Table 3
. All four fitting methods showed no significant differences between them, also showing a slightly better score than the previous double-scan method. The coarse scan only case showed relatively poor score in our study, as shown in
Fig. 10
. By comparing the MTF value (not the MTF peak position) for each approach, differences between 6 methods did not appear, as described in
Table 4
.
Descriptive statistics for repeatability of the MTF peak position
Box plot with individual symbol of the repeatability of the MTF peak position.
Descriptive statistics for repeatability of the MTF value at the peak position
Color versions of one or more of the figures in this paper are available online.

I. INTRODUCTION

At present, the smart phone camera industry requires a highly precise optical module which consists of a high resolution image sensor and lenses with small F-number. In addition, the depth of focus of the optical module is very short because it is proportional to the focal length of the phone camera lens set and the pixel size of the image sensor, as described in Eq. (1).
PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

II. FITTING MODELS

In this paper, four types of fitting models were considered and applied to through focus MTF data, as shown in
Table 1
and
Fig. 4
.
Fitting models

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

III. EXPERIMENTAL RESULTS AND STATISTICAL ANALYSIS

A statistical analysis was conducted to demonstrate the feasibility of our study with a sampling number of 1,400 modules. The experimentally obtained MTF peak position was expressed with the DAC (Digital to Analog Conversion) value, as shown in
Fig. 8
, because the DAC was directly determined from the driver IC (Integrated Circuit) signal for the autofocusing actuator of the phone camera module
[9
,
10]
. Normality tests of the peak position were performed for all six methods: the four fitting methods, the coarse scan only, and the previous double-scan (coarse + fine) case. At this time, based on the central limit theory, there was no reason to check the degree of normality because the sample size was large enough. Therefore, 50 random samples were selected to perform the Anderson-Darling normality test
[3
,
4]
.
PPT Slide

Lager Image

Normality result and basic statistics

PPT Slide

Lager Image

PPT Slide

Lager Image

Descriptive statistics for repeatability of the MTF peak position

PPT Slide

Lager Image

PPT Slide

Lager Image

Descriptive statistics for repeatability of the MTF value at the peak position

PPT Slide

Lager Image

IV. CONCLUSIONS

In a manufacturing system, it is hard to satisfy both performance and capability at the same time. To overcome this limitation, four fitting methods were tested with 1,400 phone camera modules, and we suggest a way of increasing both capability and performance (more accurate MTF peak position than the previous double-scan method). By analyzing numerous instances of mass production log data, we verified that all four fitting models were reliable enough to be applied to mass production processes.
Acknowledgements

This work was supported by LG Innotek and Korea Research Council of Fundamental Science & Technology - Grant funded by the Korean Government (KRCF-2015-CAP-1345194477).

Conrad J.
(2006)
“Depth of field in depth,”
www.largeformatphotography.info

Heath M. T.
2001
Scientific Computing in Introductory Survey
2nd ed.
McGraw-Hill
New York, USA
“Interpolation,” Chapter 7

Bohm G.
,
Zech G.
2010
Introduction to Statistics and Data Analysis for Physicists
Deutsches Elektronen-Synchrotron
Hamburg
“Probability distributions and their properties,” Chapter 3

Razali N. M.
,
Wah Y. B.
(2011)
“Power comparisons of Shapiro-Wilk, Kolmogorov-Smirnov, Lilliefors and Anderson-Darling tests,”
Journal of Statistical Modeling and Analytics
2
21 -
33

(2011)
ISO12233:2000, “Photography-Electronic still-picture cameras-Resolution measurements,”
International Standard
Geneva
7 -
16

Burn P. D.
2000
“Slanted-edge MTF for digital camera and scanner analysis,”
Proc. IS&T 2000 PICS Conference
Portland, OR, USA
135 -
138

Citing 'Performance Evaluation of MTF Peak Detection Methods by a Statistical Analysis for Phone Camera Modules
'

@article{ E1OSAB_2016_v20n1_150}
,title={Performance Evaluation of MTF Peak Detection Methods by a Statistical Analysis for Phone Camera Modules}
,volume={1}
, url={http://dx.doi.org/10.3807/JOSK.2016.20.1.150}, DOI={10.3807/JOSK.2016.20.1.150}
, number= {1}
, journal={Journal of the Optical Society of Korea}
, publisher={Optical Society of Korea}
, author={Kwon, Jong-Hoon
and
Rhee, Hyug-Gyo
and
Ghim, Young-Sik
and
Lee, Yun-Woo}
, year={2016}
, month={Feb}