Three?dimensional Binocular Holographic Display Using Liquid Crystal Shutter
Three?dimensional Binocular Holographic Display Using Liquid Crystal Shutter
Journal of the Optical Society of Korea. 2011. Dec, 15(4): 345-351
Copyright ©2011, Optical Society of Korea
  • Received : July 14, 2011
  • Accepted : September 27, 2012
  • Published : December 25, 2011
Export by style
Cited by
About the Authors
Hyun-Eui Kim
Hee-Seung Kim
Kyeong-Min Jeong
Jae-Hyeung Park

We present a novel approach to the holographic three?dimensional display using a liquid crystal shutter for binocular display applications. One of the difficult problems in implementing a binocular holographic three?dimensional display is the extremely narrow viewing angle. This problem is attributed to the spatial light modulator pixel number which restricts the maximum spatial bandwidth of the spatial light modulator. In our proposed method, a beam splitter and liquid crystal shutter are used to present two holograms of a three?dimensional scene to the corresponding eyes. The combination of holographic display and liquid crystal shutter can overcome the problem of the extremely narrow viewing angle, presenting three-dimensional images to both eyes with correct accommodation depth cues.
Three-dimensional (3D) displays can enable us to see natural scenery as it is. Much research has been carried out concerning 3D displays [1 - 8] . Among them, stereoscopic displays with special glasses or autostereoscopic multi-view displays with a few viewpoints are the representative 3D display technologies being deployed on a commercial scale. These technologies deliver binocular depth cues such as binocular disparity and convergence. However, they do not provide correct accommodation, thus resulting in visual fatigue due to the accommodation-convergence mismatch.
To get around this problem, the holographic 3D display was proposed. The holographic display provides almost perfect depth information by reconstructing the wavefront of the light field [9] . Therefore, the holographic display is free from the above-mentioned problems of conventional stereoscopic and autostereoscopic displays [10] . In spite of its great potential, the current holographic display has many limitations mainly due to the insufficient resolution of the spatial light modulator (SLM). An SLM can modulate the phase of the beam by controlling transparency. Therefore, an SLM can produce the desired wavefronts that eventually produce the desired shape of the object. In order to reconstruct a more complete wave field, the spatial resolution of the SLM should be increased. However, current device technology cannot realize the ultra high resolution SLM required for the holographic 3D display. Due to the insufficient SLM resolution, studies to realize an electro-holographic display face some difficulties such as the narrow viewing angle and small image size.
Various techniques have been proposed to overcome these problems [11] . One common method is to use a horizontal parallax only (HPO) hologram to relieve the SLM resolution requirement. This approach was developed by S. Benton et al. [12] . Their system improves the horizontal viewing angle up to 24 degrees by using an acousto-optic modulator (AOM) and a horizontal scanner array. Y. Takaki et al. enlarge the horizontal viewing angle to 14.6 degrees by using anamorphic projection and a horizontal scanner [13] . Another idea is to arrange multiple SLMs in an array. C. Slinger et al. configured 4 channel active tiling units, delivering 10 8 pixels in an active area [14] . B. Lee et al. arranged multiple SLMs in a circular arc, extending the viewing angle to 22 degrees [15] . Although these previous studies provide a wider viewing angle, they usually require multiple SLMs or a high speed scanning mechanism with high bandwidth light modulators, which makes the overall system complicated and expensive.
In this paper, we propose a binocular holographic 3D display system using only one SLM. The proposed system configures two optical paths directed to the observer’s eyes using a beam splitter. Holograms of the left and right eyes are sequentially presented by SLM, while the liquid crystal (LC) shutters located in two optical paths operate in synchronicity to deliver the displayed holographic 3D image to the corresponding eye. Therefore, the proposed system provides binocular 3D images without causing the accommodation-convergence mismatch problem. Note that the proposed method is different from the previous stereoscopic binocular holographic display techniques [16] . While the previous technique presents a different twodimensional (2D) image to each eye such that the observer feels depth from binocular disparity, the proposed method presents a different 3D image to each eye such that each eye of the observer sees a 3D images with correct accommodation. Hence, in the proposed method, not only the binocular disparity but also correct accommodation can be presented to the observer. Also note that the proposed method is distinguished from other holographic techniques in that the holograms are used as an image splitting means in place of the parallax barrier or the lenticular lens in conventional multiview autostereoscopic displays [17 - 18] . In addition, a technique of enhancing the horizontal viewing angle of the holographic 3D display using only a single SLM has been reported [19] . In this technique, the SLM pixels are spatially reconfigured using specialized optics, sacrificing the vertical bandwidth of the SLM. In contrast, the proposed method uses time multiplexing to present different holographic 3D images to each eye without causing vertical bandwidth reduction. Next, we describe the proposed system and present the experimental results. II.
- 2.1. Configuration of the Proposed System
The proposed binocular holographic system is configured as shown in Fig. 1 . A light source illuminates the SLM that is sequentially loaded with two holographic patterns of different perspectives of a 3D scene, and the reflected light is decoded by a Fourier transform lens. Next to the SLM, two lenses adjust the scale of magnification of the reconstructed 3D image. The light passing through the lenses is divided into two paths by a beam splitter before reaching the image plane where the final 3D image is located. Each split light is
Lager Image
Schematics of the proposed binocular holographic display.
controlled via a time-multiplexing technique using an LC shutter. Therefore, each reconstructed 3D image containing different perspective is sequentially presented to the corresponding eye.
- 2.2. Viewing Angle and Image Size of the Reconstructed 3D Image
The viewing angle and size of the image reconstructed by the holographic 3D display are fundamentally limited by the number of pixels of the SLM. Figure 2 shows the optical system used in the proposed display configuration. With a pixel pitch p of SLM, the maximum spatial frequency fx,max that can be represented without aliasing is given by fx,max = 1/2 p . Since the spatial frequency corresponds to the propagation angle θ and the lateral image location in the Fourier hologram geometry, the maximum image size Lξ that can be displayed in the aperture plane is
Lager Image
where λ is the wavelength, and f is the focal length of the Fourier transform lens (Lens B in Fig. 2 ). The viewing angle of the reconstructed image in the aperture plane is determined by the numerical aperture of the system as
Lager Image
where Lx and N are the size and number of pixels of SLM, respectively. From Eqs. (1) and (2), it can be seen that the product of the viewing angle with the maximum image size is limited by 2 φ = .
In our configuration, the initial reconstructed image in the aperture plane is magnified by another imaging lens (Lens C
Lager Image
Optical system of holography reconstruction for a single eye.
in Fig. 2 ). The size and viewing angle of the final image located in the image plane are given by
Lager Image
Lager Image
where a and b are distances around the imaging lens. Again, Eqs. (3) and (4) show that the product of image size and viewing angle does not change due to the additional imaging process. In our experimental setup, the final image size and viewing angle are given by Lξ ’ = 9.98 mm, 2 φ ’ = 0.49° for 532 nm wavelength, which is sufficient for covering each eye.
- 2.3. Active LC Shutter Control
The proposed method uses a binocular holographic system for presenting a left holographic image and a right holographic image. Figure 3 shows configuration of the binocular system setup. An active LC shutter control structure is used to deliver the left and right holographic 3D images to the corresponding eyes of the viewer. Figure 4 shows the synchronized operation of the LC shutters and SLM.
The two active LC shutter lenses can be either transparent or opaque by controlling the electrical voltage. The left and right holographic patterns are alternatively displayed on SLM and are synchronized with the electrical voltage of the LC shutter lenses. When SLM is loaded with the hologram pattern of the left eye, the right lens is controlled to be opaque while the left lens is controlled to be transparent. When SLM displays the right image, the glasses lenses are controlled oppositely. Thus, the observer’s left or right eye only sees a 3D image reconstructed from the hologram pattern of the corresponding eye on SLM. When the left and right 3D images are switched fast enough, the observer will feel natural single 3D image via the after image effect.
Lager Image
Schematics of the time division multiplexing system using active LC shutter.
- 2.4. Rotation Geometry for Left and Right Eye Holography
In the proposed system, two light beams containing the reconstructed 3D image are directed in different directions, i.e., left eye direction and right eye direction. Thus, for a given 3D image, holography for each eye should be created considering the beam direction difference, which eventually results in reconstruction of different perspectives of the 3D image.
Figures 5 and 6 show the geometry of the beam path for the left and right eyes, respectively. Global coordinates (X G , Y G , Z G ) are set as shown in Figs. 5 and 6 with the origin located at the crossing point in the image plane of two beams for the left and right eyes. Each point of a desired 3D image is represented by the global coordinates. In the left eye case, the coordinates ( X , Y , Z ) on SLM are transformed to ( XL , YL , ZL ) in the image space as shown in Fig. 5 . Angle β in Fig. 5 is given by the converging angle of two eyes of the observer. From the geometry, a point in global coordinates
Lager Image
Active LC shutter control timing.
Lager Image
Rotation of image coordinates for the left eye.
( XG , YG , Z G ) is represented by the ( XL , YL , ZL ) coordinates by
Lager Image
Similarly, from the geometry of the right eye beam shown in Fig. 6 , the point in the same global coordinates ( XG , YG , ZG ) is given by the right eye beam coordinates ( XR , YR , ZR ) by
Lager Image
Lager Image
Rotation of image coordinates for the right eye.
Note that since the coordinates ( XR , YR , ZR ) are left-handed, the sign of XR value is reversed in Eq. (6). In summary, the points of the 3D image represented in global coordinates are first transformed to left beam coordinates ( XL , YL , ZL ) or right beam coordinates ( XR , YR , ZR ) using Eqs. (5) and (6), and the left and right holograms are then calculated using data represented by the corresponding coordinates ( XL , YL , ZL ) or ( XR , YR , ZR ).
- 2.5. Holography Computation
In the proposed method, the optical configuration of each of the left and right eye beams is that of the Fourier holography [20 - 21] . Therefore, for a 3D image U( xG , yG , zG ), the holography of each eye is calculated by
Lager Image
where ( u,v,w ) is a scaled version of either of ( XL , YL , ZL ) or (XR, YR, ZR), which are transformed from ( XG , YG , ZG ) by Eqs. (5) and (6). The phase Φ ( u,v,w ) is set to be random for each point for higher efficiency.
Figure 7 shows the experimental setup. The SLM used in the experiment is a reflective type phase SLM. The resolution of the SLM is 1920×1080 and the maximum refresh rate is 60Hz. SLM was tested using a Michelson interferometric setup under various input-output polarization states, and the optimum condition was obtained before the SLM was used in the experiment. The LC shutter system used in the experiment has a refresh rate of 120 frames per second (120Hz), so that each eye sees 60 frames per second. Note that the proposed method can be implemented using two discrete LC shutters located in the two beam paths and hence there is no need to wear LC shutter glasses to see the 3D images in the proposed method. In the experiment, we used glasses-type LC shutters as a LC shutter system only because they can be easily obtained. Since the SLM is limited to 60 frames per second (60Hz), the final refresh rate of the implemented binocular holographic system is 30Hz.
The 3D scene used in the experiment is shown in Fig. 8 . Note that two holograms for the 3D scene represented in the global coordinates as shown in Fig. 8 (a) are calculated after they are transformed to the left and right beam coordinates as shown in Figs. 8 (b) and (c). Hence, each hologram reconstructs the same 3D scene but with different perspectives.
First, we verified the optical operation of the LC shutter. Figures 9 (a) and (b) show the pictures taken through an LC shutter that is controlled to close and open, respectively. It can be confirmed that the LC shutter transmits or blocks the view as desired. Figure 9 (c) shows the picture taken with a different focal plane of the camera, while the LC shutter is maintained open. By comparing Figs. 9 (b) and (c), it can be seen that the different part of the displayed 3D image is focused, which confirms that LC layer of the shutter does not destroy the 3D nature of the displayed image in its transparent state.
Then, we verified that accommodation and binocular disparity of the 3D image displayed via the proposed method. The 3D
Lager Image
The experimental setup.
Lager Image
3D scene used in the experiment (a) in global coor-dinates, (b) in coordinates for the left eye, (c) in coordinates for the right eye.
scene shown in Fig. 8 is displayed and two reference objects A' and B' are located where two parts A and B of the 3D scene are displayed. Figures 10 (a) and (b) show the pictures taken with different camera focal planes for the right eye view. It can be seen that the 3D images A and B and the reference objects A' and B' are focused at different focal distances as expected. The same result can be observed for the left eye views as well, as shown in Figs. 10 (c) and (d). From this observation, it is confirmed that the proposed system can correctly provide the accommodation. Moreover, it can also be observed by comparing Figs. 10 (a) and (c) that the displayed 3D images A and B are exactly above the reference objects A' and B', though the viewing direction is altered from right to left view. This means that the location of displayed 3D images in the global coordinates is maintained in the reconstruction of left and right view holograms. Hence,
Lager Image
Transmission of the displayed 3D image in different LC shutter states (a) opaque state, (b) transparent state, (c) trans-parent state with a different camera focal distance.
binocular disparity is also correctly delivered by the proposed method. From the above observations, it can be confirmed that the proposed method can correctly provide both of the accommodation and binocular disparity, eliminating accommodation- convergence mismatch problem of the conventional 3D displays.
In this paper, a novel binocular holographic 3D display
Lager Image
Reconstruction result of a 3D scene. Right eye view with the camera focal plane at (a) ZG = 10mm, and (b) ZG = -10mm. Left eye view with the camera focal plane at (c) ZG = 10 mm, and (d) ZG = -10mm.
system is proposed. We have combined a time division multi-plexing system using an LC shutter with a holographic 3D display system in order to deliver 3D images to both eyes of the observer. Binocular holographic reconstruction ensures that both of the accommodation and binocular disparity are provided, relieving the accommodation-convergence mismatch problem of the conventional 3D displays. The time multiplexing scheme enables the implementation of the system using only one SLM by eliminating the necessity to enlarge the static viewing angle of the holographic reconstruction.
This research was partly supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (2011-0003395). This work was also partly supported by the IT R&D program of MKE/KEIT. [KI001810035337, A development of interactive wide viewing zone SMV optics of 3D display] REFERENCES
Travis A. R. L. (1990) “Autostereoscopic 3-D display” Appl. Opt. 29 4341 - 4342    DOI : 10.1364/AO.29.004341
Lee B. , Park J.-H. , Min S.-W. 2006 “Three-dimensional display and information processing based on integral imaging” in Digital Holography and Three-dimensional Display T.-C. Poon, ed. Springer New York, USA 333 - 378
Kubota A. , Smolic A. , Magnor M. , Tanimoto M. , Chen T. (2007) “Multiview imaging and 3DTV” IEEE Signal Pro-cessing Magazine 24 10 - 21
Benzie P. , Watson J. , Surman P. , Rakkolainen I. , Hopf K. , Urey H. , Sainov V. , von Kopylow C. (2007) “A survey of 3DTV displays: techniques and technologies” IEEE Trans. Circuits Syst. Video Technol. 17 1647 - 1658    DOI : 10.1109/TCSVT.2007.905377
Min S.-W. , Javidi B. , Lee B. (2003) “Enhanced three-dimen-sional integral imaging system by use of double display devices” Appl. Opt. 42 4186 - 4194    DOI : 10.1364/AO.42.004186
Park J.-H. , Hong K. , Lee B. (2009) “Recent progress in three-dimensional information processing based on integral imaging” Appl. Opt. 48 H77 - H94    DOI : 10.1364/AO.48.000H77
Kim T.-G. , You Y.-S. (2010) “Extraction of a distance para-meter in optical scanning holography using axis transfor-mation” J. Opt. Soc. Korea 14 104 - 108    DOI : 10.3807/JOSK.2010.14.2.104
Jeon S.-H. , Gil S.-K. (2010) “Qpsk modulation based optical image cryptosystem using phase-shifting digital holography” J. Opt. Soc. Korea 14 97 - 103    DOI : 10.3807/JOSK.2010.14.2.097
Kim H. , Hahn J. , Lee B. (2008) “Mathematical modeling of triangle-mesh-modeled three-dimensional surface objects for digital holography” Appl. Opt. 47 D117 - D127    DOI : 10.1364/AO.47.00D117
Reichelt S. , Haussler R. , Futterer G. , Leister N. (2010) “Depth cues in human visual perception and their realization in 3D displays” Proc. SPIE 7690 7690 0B -
Yaras F. , Kang H. , Onural L. (2010) “State of the art in holo-graphic displays: a survey” J. Display Technology 6 443 - 454    DOI : 10.1109/JDT.2010.2045734
Nwodoth T. A. , Benton S. A. (2000) “Chidi holographic video system” Proc. SPIE 3596 167 - 167
Takaki Y. , Hayashi Y. (2008) “Increased horizontal viewing zone angle of a hologram by resolution redistribution of a SLM” Appl. Opt. 47 D6 - D11    DOI : 10.1364/AO.47.0000D6
Stanley M. , Smith M. A. , Smith A. P. , Watson P. J. , Coomber S. D. , Cameron C. D. , Slinger C. W. , Wood A. D. (2004) “3D electronic holography display system using a 100 mega-pixel spatial light modulator” Proc. SPIE 5249 297 - 308    DOI : 10.1117/12.516540
Hahn J. , Kim H. , Lim Y. , Park G. , Lee B. (2008) “Wide viewing angle dynamic holographic stereogram with a curved array of spatial light modulators” Opt. Express 16 12372 - 12386    DOI : 10.1364/OE.16.012372
Lee S.-H. , Kim E.-S. (1998) “Stereoscopic display based ona volume holographic storage” Japan J. Appl. Phys. 37 L1193 - L1194    DOI : 10.1143/JJAP.37.L1193
Lee S.-H. , Yang H.-G. , Son K.-C. , Kim E.-S. (2000) “Multiviewpoint autostereoscopic display system based on volume hologram” Proc. SPIE 3957 208 - 214    DOI : 10.1117/12.384444
Su W.-C. , Chen C.-Y. , Wang Y.-F. (2011) “Stereogram imple-mented with a holographic image splitter” Opt. Express 19 9942 - 9949    DOI : 10.1364/OE.19.009942
Kang H.-J. , Ohmura N. , Yamaguchi T. , Yoshikawa H. , Kim S.-C. , Kim E.-S. (2009) “Method to enlarge the hologram viewing window using a mirror module” Opt. Eng. 48 075801-1 - 075801-7    DOI : 10.1117/1.3180869
Park J. H. , Kim M. S. , Baasantseren G. , Kim N. (2009) “Fresnel and Fourier hologram generation using ortho-graphic projection images” Opt. Express 17 6320 - 6334    DOI : 10.1364/OE.17.006320
Kim M. S. , G. Baasantseren , N. Kim , Park J. H. (2008) “Hologram generation of 3D objects using multiple ortho-graphic view images” J. Opt. Soc. Korea 12 269 - 274    DOI : 10.3807/JOSK.2008.12.4.269