Analysis of Factors Affecting Performance of Integrated INS/SPR Positioning during GPS Signal Blockage

Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography.
2014.
Dec,
32(6):
599-606

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http:// creativecommons.org/licenses/by-nc/3.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

- Received : November 28, 2014
- Accepted : December 22, 2014
- Published : December 31, 2014

Download

PDF

e-PUB

PubReader

PPT

Export by style

Article

Metrics

Cited by

TagCloud

Since the accuracy of Global Positioning System (GPS)-based vehicle positioning system is significantly degraded or does not work appropriately in the urban canyon, the integration techniques of GPS with Inertial Navigation System (INS) have intensively been developed to improve the continuity and reliability of positioning. However, its accuracy is degraded as INS errors are not properly corrected due to the GPS signal blockage. Recently, the image-based positioning techniques have been started to apply for the vehicle positioning for the advanced in processing techniques as well as the increased the number of cars installing the camera. In this study, Single Photo Resection (SPR), which calculates the camera exterior orientation parameters using the Ground Control Points (GCPs,) has been integrated with the INS/GPS for continuous and stable positioning. The INS/GPS/SPR integration was implemented in both of a loosely and a tightly coupled modes, based on the Extended Kalman Filter (EKF). In order to analyze the performance of INS/SPR integration during the GPS outage, the simulation tests were conducted with a consideration of factors affecting SPR performance. The results demonstrate that the accuracy of INS/SPR integration is depended on magnitudes of the GCP errors and SPR processing intervals. Additionally, the simulation results suggest some required conditions to achieve accurate and continuous positioning, used the INS/SPR integration.
Diagram of INS/GPS/SPR integration algorithm
The eighteen states EKF for the INS/GPS/SPR integration algorithm are designed when the state vector is composed of errors in the orientation, the velocity towards North-East- Down (NED) coordinates system and the position towards the World Coordinate System 1984 (WGS84), bias in the gyroscope and the accelerometer, and scale factor in the gyroscope. The white noise is composed of the gyroscope and accelerometer random-walk.
where xi is the state vector of navigation error(
x_{i}
= [
δα δβ δγ δV_{n} δV_{e} δV_{d} δφ δλ δh
]
^{T}
), and it consists of attitude, velocity, and positon error, xf is the state vector of sensor error (
x_{f}
= [
δψ_{n} δψ_{e} δψ_{d} δf_{n} δf_{e} δf_{d} δs_{n}
), and it consists of gyroscope bias, accelerometer bias, and gyroscope scale factor,
F_{11}
and
F_{12}
are the dynamic matrix of navigation and system error respectively,
ω_{i}
is the white noise (
ω_{i}
= [
W_{g} W_{g} W_{g} W_{a} W_{a} W_{a}
]
^{T}
).
The vectors of GPS observations (
z_{GPS}
) consist of difference between the latitude, longitude, and ellipsoidal height
estimated from GPS and INS in WGS84
Eq. (4) shows the design matrix (
H_{GPS}
) which explain the relationship between the vectors of GPS observation and the state vector, and Eq. (5) is the variance-covariance matrix.
where 0 is the zero matrix, I is the identity matrix
are the variance of estimated latitude, longitude, and ellipsoidal height.
where (
x_{a,} y_{a}
) is the image coordinate of point A, (
x_{p}, y_{p}
) is the calibrated principal point coordinate,
c
is the focal length of camera,
r
_{11}
,
r
_{12}
,
r
_{13}
,... ,
r
_{33}
are the elements of the rotation martrix, (
X_{A}, Y_{A}, Z_{A}
) is the object coordinate of point A, (
X
_{0}
,
Y
_{0}
,
Z
_{0}
) is the coordinate of the perspectibe center.
The observation equation using the image coordinates produced by SPR processing is given in Eq. (7), and it update the state vector.
The vector of SPR obsevations (
z_{SPR}
) consist of difference between the measured coordinates and the newly predicted coordinates of image points. If the coordinates of object and image point corresponding to the object are know, the new coordinate of image point can be predicted from the collinearity equation using the initial exterior orientation parameters from INS.
where
is the coordinate of image point predicted from the collinearity equation,
is the coordinate of image point measured from the image.
The design matrix (HSPR) which explain the relationship between the vector of SPR observations and the state vectors in given in Eq. (9), and Eq. (10) shows the variance-covariance matrix
The design matrices (
A_{att}, A_{pos}
) in Eq. (9) are the partial differential martices for the attitude and position, respectively, of SPR design martix derived from linearization of collinearity equation as given in Eq. (12) and (13). The rotation matrix from ECEF (Earth- Centered-Earth-Fixed) to NED coordinate system
and the partial differential matrix for ECEF coordinate system
are given in Eq. (14) and (15). Please refer detailed equation for Eq. (15) in
Kim . (2006)
where α, β, γ are the roll, pitch, yaw angles, respectively, of the body frame with respect to the navigation frame,
φ, λ, h
are the latitude, longitude, and ellipsoidal height estimated by INS.
z_{GPS/SPR}
), the design matrix (
H_{GPS/SPR}
), and variance-covariance matrix (
R_{GPS/SPR}
) are given in Eq. (17), Eq. (18), and Ep. (19).
MEMS-IMU specification (Model : Xsens MTi-G 700 INS/GPS)
Camera specification (Model : GEViCAM GD- 155000C)
The SPR performance is affected by the accuracy of input data, such as the initial exterior orientation parameters, the interior orientation parameters, the image coordinates, GCP coordinates, and the geometry of GCPs. The interior orientation parameters can be precisely determined by the camera calibration. Also, the accuracy of image coordinates does not have crucial effects on SPR performance (
Kang ., 2014
). Therefore, we consider those GCPs coordinate errors, the distance between GCPs in the driving direction, the constellation of GCPs on the image, and the SPR processing interval for the GCP and initial exterior orientation parameters.
The test parameters for simulation are given in the following; 1) GCPs coordinate errors vary from 0.05m to 0.4m with 0.05m interval, 2) the distances between GCPs in the driving direction are changing in 5m, 3m, and 1m, 3) SPR processing interval varies from 1 to 5 seconds, 4) the constellations of GCPs on the image are considered in 2 types, that is, the 4 GCPs are widespread over the image or the 4 GCPs are crowed on center of the image (
Fig. 2
). The simulation tests are proceeded for 3 factors, which are from 1) to 3) and the 4) constellation types on the image for each simulation test.
Table 3
show the test parameters.
Constellations of GCPs on the image
Summary of the test parameters
Simulation conditions for the GCPs coordinate error
In the
Fig. 3
, as errors in GCPs coordinate increase, especially for geometry type 1 and 2, the Root Mean Square Error (RMSE) of position is also increased because an error in INS is corrected inaccurately by the SPR. When the geometry type 1 image is used, the RMSE is 1.53m towards the longitude direction. In fact, this is better than the goal accuracy, although the error in GCPs coordinate reaches up to 0.04m. On the other hand, the RMSE is 4.92m in longitude direction, if we apply geometry type 2 and 0.15m for GCP coordinates error. When the error in GCP coordinate is more than 20m, it becomes diverged. The reason for the RMSE in longitudinal direction is larger than the other direction is that all GCPs are located in the driving direction, and is hard to compensate the error in the direction.
Compared RMSE of position depend on the GCP coordinate error for geometry type1 and 2
The distance between GCPs in driving direction
Simulation conditions for the distance between GCPs in driving direction
As a result, the RMSE of position is increased respect to decreasing the distance between GCPs from 5m to 1m (
Fig. 5
). Since the distance between GCPs gets shorter, the GCPs geometry in 3D space becomes unstable as well as the accuracy of SPR performance is degraded. The geometry type1 results out the stable outcome, 0.64m, which is the largest error in every direction, but the distance between GCPs is 1m. On the other hand, positioning RMSE is larger than the goal accuracy, if the type2 geometry is applied and the distance between GCPs becomes shorter than 3m.
Compared RMSE of position depend on the distance between GCPs in driving directionfor geometry type1 and 2
Simulation conditions for the SPR processing interval
As the SPR processing interval is increased, the position RMSE of INS/SPR integration is increased for both the geometry type 1 and 2 as shown in
Fig. 6
. The RMSE of position is 0.68m, if the interval is 5seconds and the geometry type1 is used. When applied the geometry type2, the accuracy of car position satisfy the goal accuracy within 2 seconds interval, but it is unlikely diverged, if the interval becomes 3seconds. Since the updated position by the SPR is located at the point passed by the GCPs, there are no available GCPs for the next SPR processing (
Fig. 7
) and the position diverges at 3 seconds.
Compared RMSE of position depend on SPR processing interval for geometry type1 and 2
The car position estimated at the point passed by the GCPs

1. Introduction

The Global Positioning System (GPS) has been dominantly used in the car navigation systems, but does not appropriately operate in the urban canyon when its signals are blocked by the buildings. In this case, however, the accuracy of vehicle positioning is significantly degraded (
Skog and Handel, 2009
), or the positioning is even impossible. The GPS has been integrated with the Inertial Navigation System (INS) to improve the accuracy and continuity of GPS-based positioning system over the last two decades (
Godha and Cannon, 2007
;
Zhou ., 2010
;
Leung ., 2011
). Although the INS/GPS integration is applied for the vehicle positioning, if GPS signals are blocked for long time, the accuracy and reliability of positioning are degraded so as the divergent of INS navigation solution. Therefore, other sensors, attached on the vehicle or camera, have been considered to provide an additional position and attitude information.
The vehicle-sensors, such as the Steering Angle Sensor (SAS) and the odometer, also provide additional position or attitude of the car to correct the INS navigation solution. There have been a great number of researches developing the vehicle positioning, based on integrating INS, GPS, and vehicle-sensors (
Yang and Farrell, 2003
;
Gao ., 2008
;
Georgy ., 2011
;
Jo ., 2012
). However, the results of positioning based on the integration between vehicle-sensor and INS/GPS have errors up to several tens of meters because the vehicle-sensors provide inaccurate and deficient data for correcting the INS navigation solution.
Image-based positioning techniques, such as the visual odometry, vision system, and the Single Photo Resection (SPR), can determine position and attitude more accurately compared with to the other vehicle- sensors. Recently, as the image processing techniques have been well-developed, the image-based positioning has been applied for the vehicle positioning. The video black box is widely used application following developments in image processing techniques.
Nister . (2004)
has developed and applied the visual odometry, which estimates a relative position and attitude between two consecutive frames by using the conjugate points, for the vehicle positioning. In fact, the visual odometry has positioning errors that are increased as the number of image frames and the driving distance are increased.
Vu . (2012)
calculated the relative distance between the car and the known point using the vision system and corrected the error in INS solution.
Park(2013)
estimated the relative attitudes of car with the displacements of vanishing point, detected on the image. Since the image-based positioning of the vanishing point only provide relative attitude, it is not enough to sufficiently correct the errors of INS solution.
Han . (2014)
has developed the vehicle positioning algorithm based on the loosely coupled approach using the integration of GPS, INS and SPR, which determined the position and attitude of camera using coordinates of Ground Control Points (GCPs) and image points, and verified its performance depending on the geometric constellation of GPS satellite and GCP on the image. It can be analyzed the positioning accuracy of INS/GPS/SPR integration was less than 1m and irrelevant to GPS signal environment if the SPR worked properly, however, it did not consider the various factors affecting on SPR performance.
In this paper, we implement the INS/GPS/SPR integration algorithm, where the INS is combined with the GPS in loosely coupled approach and integrated with the SPR in tightly coupled one. Also, the performance of INS/SPR integration is analyzed with the consideration of factors affecting the SPR under the GPS signal blockage environment. The target accuracy of positioning by INS/SPR integration set to 2.5m. At section two, the INS/GPS/SPR integration algorithm, based on the Extended Kalman Filter (EKF) technique, is introduced. The section three describes results of performance analysis of the INS/SPR integration under the GPS blockage environments with a consideration of magnitudes of GCP errors, distances between GCPs in the driving direction and SPR processing intervals. The section four finally summarizes all the results and proposes for future researches.
2. INS/GPS/SPR Integration Algorithm

The INS/GPS/SPR integration algorithm can estimate the stable and reliable positions and attitudes because the algorithm reduces the navigation solution errors of the INS with the GPS, or the SPR.
Fig. 1
is a diagram of the INS/ GPS/SPR integration algorithm. To estimate the position and attitude, we firstly solve the navigation equation with an acceleration and angular velocity, obtained from inertial sensors. The position and attitude are updated by EKF with the 3D position information that has determined by GPS. If more than 4 satellites are available, or use SPR solution, if GCPs are obtained enough to conduct SPR.
PPT Slide

Lager Image

PPT Slide

Lager Image

- 2.1 Compensating errors of INS navigation solution using GPS

Since the GPS-based navigation system, mounted in the car, does not generally provbide raw data, a loosely coupled approach is applied for the INS/GPS integration. If it is available to receive GPS signals from more than four satellites, the state vector is updated using 3D position information determined from the GPS. Eq.(2) is the observation equation usinkg the GPS in order to update the state vector.
PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

- 2.2 Correcting the error of INS navigation solution using SPR

The integration of INS and SPR is developed by a tightly coupled approach, as it is much easier and more efficient in this case than the loosely coupled approach, which independently generates solutions from each sensor and need another filter to integrate them. The SPR is a photogrammetry technique which determines the position and the attitude of camera from the collinearity equation using the coordinates of objective points and image points, the interior orientation parameters, and the initial exterior orientation parameters. The collinearity equation is based on the conditions that the perspective center, the image point, and the object point must lie on a straight line, and it is given in Eq. (6).
PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

- 2.3 Correction the error of INS navigation solution using both GPS and SPR

If the state vector is updated using 3D position information determined by GPS and image coordinates produced by the SPR processing. An observation equation for updating state vector is given in Eq. (16). The vector observations (
PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

3. Simulation Tests

- 3.1 Overview

Under the loss of GPS signals, the accuracy of INS/SPR integration depends on SPR because INS navigation solution is updated by only SPR results. Therefore, we assumed that the GPS signal is perfectly blocked and analyzed the performance of INS/SPR integration with consideration of factors that affecting to the SPR. The targeted accuracy is set up to be 2.5m for the positioning because it is the general accuracy value of the vehicle positioning based on L1/CAcode of GPS. The driving trajectory heads to the longitudinal direction and drives continuously 200 seconds with the speed of 10m/s. Also, it is assumed that the image including 4 GCPs is obtained in every second, and the camera coincide with axis heads the longitudinal direction. The MEMS-IMU of Xsens MTi-G 700 INS/GPS model was selected with consideration of the size, price, and accuracy for vehicle positioning satisfying the goal accuracy. The camera model for simulation is the GEViCAM GD-155000C camera, which is easy to integrate with the INS, so as similar specification with the video black box camera.
Table 1
and
2
show the detailed specification of sensors.
MEMS-IMU specification (Model : Xsens MTi-G 700 INS/GPS)

PPT Slide

Lager Image

Camera specification (Model : GEViCAM GD- 155000C)

PPT Slide

Lager Image

PPT Slide

Lager Image

Summary of the test parameters

PPT Slide

Lager Image

- 3.2 Results

- 3.2.1 Impact of GCPs accuracy

The GCPs coordinate can be observed directly, or extracted from the digital map, so we set up the maximum errors of the GCPs coordinate as 0.4m by considering 0.4m accuracy of 1:1000 digital maps. The errors in the coordinate and constellation types of GCPs are set up as variables, when others are fixed; 1) the distance between GCPs in the driving direction is 5m, 2) SPR processing interval is 1second. The summary of test conditions is shown in
Table 4
.
Simulation conditions for the GCPs coordinate error

PPT Slide

Lager Image

PPT Slide

Lager Image

- 3.2.2 Impact of the distance between GCPs in driving direction

If the distance between GCPs in driving direction is changed, the geometries in 3D space is also transformed, although these are projected onto the image at the same location. We test about that the geometry of GCPs in the 3D space affect to SPR performance. Every image has 4 GCPs, which is grouped into 2 sets. Each set has same distance from the car in the driving direction, and the distance between 2 sets are varying as 5m, 3m, and 1m.
Fig. 4
explains the distance between GCPs in the driving direction. The test conducts in the geometry type 1 and 2, same as tested in 3.2.1, and others are fixed as: 1) the GCPs coordinate error is 0.1m, 2) the SPR processing interval is 1 second. The test summary is given in
Table 6
.
PPT Slide

Lager Image

Simulation conditions for the distance between GCPs in driving direction

PPT Slide

Lager Image

PPT Slide

Lager Image

- 3.2.3 Impact of SPR processing interval

If the SPR processing interval becomes longer, it continuously cumulates the error of INS navigation solution, but also affects to SPR following to use the INS navigation solution as the initial exterior parameters. Therefore, we test the SPR processing interval in order to find the optimal interval to satisfy targeted accuracy. In test, the SPR processing interval varies from 1 to 5 seconds, so as needs to consider in the geometry types, while others are fixed as: 1) GCPs coordinate error is 0.05m, 2) the distance between GCPs in longitudinal direction is 5m.
Table 6
summarizes the test parameters.
Simulation conditions for the SPR processing interval

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

4. Conclusion

The INS/SPR integration, which corrected errors of INS navigation solution with results fom SPR processing, was implemented from the tightly coupled EKF. Its performance has been tested based on the simulation tests under the assumption of only available observations with MEMS-IMU, camera sensor, not GPS. Since the accuracy of INS/SPR integration depends on the SPR, we tested parameters, such as errors in GCP coordinate, distances between GCPs, and SPR processing intervals, determining the accuracy of SPR. Additionally, the simulation tests has been considered the geometric constellation of GCPs on the image with the goal accuracy of 2.5m. From the results, we can achieve the positioning accuracy less than 1m through the INS/SPR integration with the following conditions; 1) the GCPs should be distributed on the image like geometry type1, 2) the SPR should be done within every 5 seconds, 3) the accuracy of GCPs coordinates should be less than 0.05m, 4) the distance between GCPs in the driving direction should be longer than 1m.
In conclusion, the interval, density, and constellation of GCPs should be considered for the accurate positioning with the SPR. If the suggested conditions are applied, the collecting of GCPs for the INS/SPR integration can be properly done in the aspects of efficiency and accuracy. In the future, we will conduct the additional performance analysis for the INS/GPS/SPR integration algorithm under similar environments with the real road. Furthermore, the driving test will be performed in the test bed, which is constructed from the additional performance analysis.
Gao J.
,
Petovello M.
,
Cannon M.E.
2008
Integration of steering angle sensor with global positioning system and micro-electro-mechanical systems inertial measurement unit for vehicular positioning
Journal of Intelligent Transportation Systems
12
(4)
159 -
167
** DOI : 10.1080/15472450802448138**

Georgy J.
,
Karamat T.
,
Iqbal U.
,
Noureldin A.
2011
Enhanced MEMS-IMU/odometer/GPS integration using mixture particle filter
GPS Solutions
15
(3)
239 -
252
** DOI : 10.1007/s10291-010-0186-4**

Godha S.
,
Cannon M.E.
2007
GPS/MEMS INS integrated system for navigation in urban areas
GPS Solutions
11
(3)
193 -
203
** DOI : 10.1007/s10291-006-0050-8**

Han J.
,
Kang B.Y.
,
Kwon J.H.
2014
Development of GPS/IMU/SPR integration algorithm and performance analysis for determination of precise car positioning
Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
(in Korean with English abstract)
32
(2)
163 -
171
** DOI : 10.7848/ksgpc.2014.32.2.163**

Jo K.
,
Chu K.
,
Sunwoo M.
2012
Real-time computer vision/DGPS-aided inertial navigation system for lane evel vehicle navigation
IEEE Transactions on Intelligent Transportation Systems
13
(2)
899 -
913
** DOI : 10.1109/TITS.2012.2187641**

Kang B.Y.
,
Han J.
,
Kwon J.H.
2014
Positioning accuracy analysis of GPS/INS/SPR integration with measurement error of ground control points and image points
KAGIS
Proceedings of the Korean Association of Geographic Information Studies Spring Conference 2014
Seoul, Korea
24-25 April
(in Korean)
84 -
85

Kim K.
,
Park C.G.
,
Yu M.J.
,
Park Y.B.
2006
A performance comparison of extended and unscented kalman filters for INS/GPS tightly coupled approach
Journal of Control, Automation, and Systems Engineering
(in Korean with English abstract)
12
(8)
780 -
788
** DOI : 10.5302/J.ICROS.2006.12.8.780**

Leung K.T.
,
Whidborne J.F.
,
Purdy D.
,
Barber P.
2011
Road vehicle state estimation using low-cost GPS/INS
Mechanical Systems and Signal Processing
25
(6)
1988 -
2004
** DOI : 10.1016/j.ymssp.2010.08.003**

Nister D.
,
Naroditsky O.
,
Berfen J.
2004
Visual odometry
IEEE
Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Washington D.C., USA
27 June-2 July
1
652 -
659

Park J.H.
2013
Estimation for Displacement of Vehicle Based on GPS and Monocular Vision Sensor, Master’s thesis
Korea Aerospace University
Goyang-si, Gyeonggi-do, Korea
(in Korean with English abstract)
101 -

Skog I.
,
Handel P.
2009
In-car positioning and navigation technologies-a survey
IEEE Transactions on Intelligent Transportation Systems
10
(1)
4 -
21
** DOI : 10.1109/TITS.2008.2011712**

Vu A.
,
Ramanandan A.
,
Chen A.
,
Farrell J.A.
,
Barth M.
2012
Real-time computer vision/DGPS-aided inertial navigation system for lane-level vehicle navigation
IEEE Transactions on Intelligent Transportation Systems
13
(2)
899 -
913
** DOI : 10.1109/TITS.2012.2187641**

Yang Y.
,
Farrell J.A.
2003
Magnetometer and differential carrier phase GPS-aided INS for advanced vehicle control
IEEE Transactions on Robotics and Automation
19
(2)
269 -
282
** DOI : 10.1109/TRA.2003.809591**

Zhou J.
,
Edwan E.
,
Knedlik S.
,
Loffeld O.
2010
Low-cost INS/GPS with nonlinear filtering methods
IEEE
Proceeding of the 2010 13th Conference on Information Fusion (FUSION)
Edinburgh, Scotland
26-29 July
1 -
8

Citing 'Analysis of Factors Affecting Performance of Integrated INS/SPR Positioning during GPS Signal Blockage
'

@article{ GCRHBD_2014_v32n6_599}
,title={Analysis of Factors Affecting Performance of Integrated INS/SPR Positioning during GPS Signal Blockage}
,volume={6}
, url={http://dx.doi.org/10.7848/ksgpc.2014.32.6.599}, DOI={10.7848/ksgpc.2014.32.6.599}
, number= {6}
, journal={Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography}
, publisher={Korean Society of Surveying, Geodesy, Photogrammetry and Cartography}
, author={Kang, Beom Yeon
and
Han, Joong-hee
and
Kwon, Jay Hyoun}
, year={2014}
, month={Dec}