# An integrated aircraft navigation system with optical horizon sensor.

1. IntroductionBecause of weight, size or cost requirements, integrated inertial satellite navigation systems (ISNS) based on low-cost MEMS sensors are often used for unmanned air vehicles (George, Sukkarieh 2005; Plekhanov et al. 1998). Such navigation systems mostly provide medium or low accuracy of navigation parameters. A trouble spot of such systems is that the inertial part is the only source of information about an object's angular attitude. It is therefore necessary to improve the accuracy of ISNS by introducing additional sensors based on physical principles other than the primary system (Winkler et al. 2004).

A lot of modern UAVs are used to obtain real-time images of the environment. For this purpose, optical equipment is installed on board. The image from the onboard camera carries enough information for estimation of aircraft attitude. The displacement and angle of the horizon line in a video frame from an on-board video camera can inform us about the attitude of the camera and hence of the aircraft relative to the surface of the ground. Some difficulties arise during the automation of this process, for example, detecting exactly the horizon line from numerous lines on an image. Such a problem requires the use of computer vision methods further adapted to specific conditions.

Some research uses various computer vision techniques for horizon line recognition for the purpose of partial micro air vehicle attitude determination (Ettinger et al. 2002; Dusha et al. 2007; Malysheva 2008; Zbrutsky et al. 2012). Another study (Cornall, Egan 2005) also has practical results under certain weather conditions. In this paper, the application of a horizon line recognition algorithm via computer vision technique is also considered. This self-contained algorithm can be used in the airborne computer. The research concerns the use of this recognition algorithm for the development of an optical horizon sensor. This paper also discusses the development of the main features of an algorithm for the integration of strapdown inertial navigation system (SINS) and optical horizon sensor.

2. Horizon formation by the optical sensor

Let us consider the initial image in figure 1. Investigation of the colour components of an RGB image shows that the horizon line can be identified in all three colour channels. Processing is therefore applied in parallel to each of the colour channels of the initial image to obtain more information about the position of the horizon line.

[FIGURE 1 OMITTED]

As the first step of processing, an edge detection procedure via a predefined set of morphological operators and then the Sobel operator are performed (Gonzalez, Woods 2002). The advantage of using morphological operators over linear low-frequency filters is that they better preserve the magnitude and position of the various edges. This is an essential condition to ensure accurate edge estimation. Figure 2 shows the corresponding view of all three image channels after the first step of processing.

[FIGURE 2 OMITTED]

Examination of the camera lens distortion model shows that the pixels in the image corners are distorted the most. To eliminate this effect, a binary circular mask is added when the results of the first step are combined by means of a logical AND operation (Fig. 3). It should be noted that it is not the image centre but the lens optical centre projected on the image plane that is selected as the circular mask centre.

[FIGURE 3 OMITTED]

Line extraction from the processed image is carried out via the Hough transform (Gonzalez, Woods 2002).

Figures 4-6 show the result of applying the recognition algorithm to the initial image and two other test images that present a different weather condition and view of the sky. One can see that the algorithm has sufficient accuracy to detect the horizon line.

[FIGURE 4 OMITTED]

[FIGURE 5 OMITTED]

[FIGURE 6 OMITTED]

Real-time estimation of two aircraft attitude angles, i.e. roll and pitch, by means of a web camera and the horizon recognition algorithm implemented in MatLab Simulink is demonstrated in figure 7. Information from the on-board camera installed on a moving object enters the airborne computer, which determines the roll and pitch values.

3. Integrated navigation system

The aircraft navigation algorithm is based on optimal error estimation of the subsystems, such as SINS, GPS receiver, an optical horizon sensor, and a magnetometer. The purpose of this feature is to compensate the errors of the subsystems in an integrated system (Fig. 8). The SINS is considered the main navigation system. It consists of three accelerometers and three single-component angular rate sensors.

The algorithm of integrated navigation data processing is based on the generation of difference measurements. In such measurements, the navigation parameters are excluded. Thus the problem of gauges error estimation can be solved. As an invariant estimation algorithm, the optimal Kalman filter is applied.

Let us describe the system dynamics by the differential equations in matrix form (Matveev, Raspopov 2009):

[??](t) = A x X(t) + G x U(t) + B x W(t); Y(t) = C x X(t) + V(t), (1)

where X(t) is the system state vector; U(t) is the known input vector (including control signals); W(t) is the random input vector; A(t), B(t),G(t) are the state matrix, the control matrix, and the input matrix respectively; Y(t)is the measurement vector; C(t)is the transition matrix of X(t) and Y(t); and V(t) is the random measurement noise vector.

[FIGURE 7 OMITTED]

[FIGURE 8 OMITTED]

The state vector:

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] (2)

includes SINS and its sensor errors: [DELTA][xi], [DELTA][eta], [DELTA][zeta] are the object coordinate estimation errors in an inertial frame [O.sub.1][xi][eta][zeta] with origin at the centre of the Earth (the axis [O.sub.1][zeta] along the axis of the Earth's rotation axis is directed); [DELTA][V.sub.[xi]], [DELTA][V.sub.[eta]], [DELTA][V.sub.[zeta]] are the object rate estimation errors; [DELTA][[phi].sub.x], [DELTA][[phi].sub.y] are the SINS vertical line analytical modelling errors; [DELTA][[phi].sub.z] is the meridian direction estimation error; and [m.sub.ai], [m.sub.[omega]i] are slowly varying random components of the accelerometers zero offset and angular rate sensors drift.

The measurement vector Y (t) for the optimal Kalman filter is generated from the differences in the coordinate, rate and rotation angle measurements provided with the SINS on the one hand and the GPS-receiver, optical sensor, and magnetometer on the other. Taking into account expression (2), we obtain:

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII], (3)

Such a system is completely observable and controllable.

The optimal Kalman filter application allows the problem of state vector recovery from noisy measurements Y(t) to be solved in real time, providing an estimation of minimum mean square error of the state variables [x.sub.i](t).

[FIGURE 9 OMITTED]

The state vector estimation algorithm by optimal Kalman filter equation is described (Brammer, Siffling 1982):

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] (4)

where [??](t), [??](t) are the estimations of state and measurement vector respectively.

To reduce SINS errors, the influence of the slowly varying random components of the accelerometers zero offset and angular rate sensors drift is compensated by the estimations of zero offset [[??].sub.ai] and drift [[??].sub.ui].

4. Simulation results of the integrated navigation system with a horizon optical sensor

Simulation is carried out in the MatLab Simulink software environment. The assumption of object immobility relative to the Earth is considered. Figure 9 demonstrates an aircraft attitude estimation error. The optical horizon sensor and magnetometer integration decreases the SINS vertical line analytical modelling errors [DELTA][[phi].sub.x], [DELTA][[phi].sub.y] and the meridian direction estimation error [[DELTA][phi].sub.z] respectively. Thus the object attitude error estimation is about 2.16 x [10.sup.-4] rad in course, 2.05 x [10.sup.-5] rad in pitch, and 3 x [10.sup.-7] rad in roll.

Other simulation results show that the coordinate determination errors of a moving object in all three coordinates is less than 1 m, and the error standard deviation of the determination of object linear rates is on average 0.0052 m/s.

5. Conclusions

It can therefore be concluded that the proposed SINS and optical horizon sensor integration algorithm enable the improvement of determining the accuracy of aircraft motion parameters and provide the utilisation of SINS based on MEMS sensors during an unlimited period of time as long as the horizon is in the field of view.

In this research, a self-contained horizon recognition algorithm for video sequence is developed. It allows real-time aircraft attitude relative to the horizon line to be determined.

A scaled-down simulation of system operation confirmed its high accuracy and reliability and also showed the high efficiency of SINS, GPS, optical sensor, and magnetometer integration via the Kalman filter to create intelligent UAV on-board systems.

doi: 10.3846/16487788.2012.753681

References

Brammer, K.; Siffling, G. 1982. Kalman-Bucy Filters. Moscow: Nauka. 200 p. (in Russian).

Cornall, T.; Egan, G. 2005. Heaven and Earth: how to tell the difference, in Australian International Aerospace Congress, March, 2005, Melbourne, Australia, WC0055.

Dusha, D.; Walker, R.; Boles, W. 2007. Fixed-wing attitude estimation using vision based horizon detection, in 22nd International Unmanned Air Vehicle Systems Conference, 16-18 April, 2007.

Ettinger, S. M.; Nechyba, M. C.; Ifju, P. G., et al. 2002. Vision-guided flight stability and control for micro air vehicles, in IEEE International Conference on Intelligent Robots and Systems, October, 2002.

George, M.; Sukkarieh, S. 2005. Tightly coupled INS/GPS with bias estimation for UAV applications, in ACRA05: Proceedings of the Australian Conference on Robotics and Automation, Sydney, Australia.

Gonzalez, R. C.; Woods, R. E. 2002. Digital Image Processing. 2nd ed. Upper Saddle River, NJ: Prentice Hall.

Malysheva, J. 2008. A computer vision technique implementation for a horizon recognition algorithms designing, in Intelligence, Integration, Reliability: Proceedings of the 1st International Student And Young Scientists Conference, Kiev: Politechnika. 17 p.

Matveev, V. V.; Raspopov, V. Y. 2009 Osnovy postroeniia besplatformennykh inertsial'nykh navigatsionnykh sistem. Saint Petersburg: CSRI Electropribor. 280 p. (in Russian).

Plekhanov, V. E.; Tikhonov, V. A.; Veremeenko, K. K. 1998. Integrated inertial and satellite navigation system based on micromechanical module, in 5th Saint Petersburg International Conference of Integrated Navigation Systems. Saint Petersburg: CSRI Elektropribor. 95-101.

Winkler, S.; Schulz, H.-W.; Buschmann, M., et al. 2004. Visual aided low-cost GPS/INS integration for autonomous MAV navigation, Gyroscopy and Navigation 47: 36-48.

Zbrutsky, A.; Kanchenko, V.; Karnaushenko, R., et al. 2012. Investigation of the characteristics of the sensor unit of the PA-2 horizontal stabilisation system, Aviation 16(1): 10-15. http://dx.doi.org/10.3846/16487788.2012.679836

Mohamed Rahmouni (1), Julia Malysheva (2)

(1) University of Saad Dahlab, Route De Soumaa BP 270, Blida, Algeria

(2) Kiev Polytechnic Institute, National Technical University of Ukraine, Prospect Peremogy 37, 03056 Kiev, Ukraine

E-mails: (1) rahmounim@hotmail.com; (2) julimal@mail.ru (corresponding author)

Received 07 May 2012; accepted 22 October 2012

Mohamed RAHMOUNI, PhD.

Education: 2003--PhD in control systems and navigation, National Technical University of Ukraine, Kiev Polytechnic Institute.

Research interests: navigation systems.

Present position: director of scientific research and probation, in Department of Mechanics at SAAD DAHLAB University, Blida, Algeria; chief of integrated navigation systems in aircraft laboratory, Algeria; team leader of national research projects on UAV control, Algeria.

Julia MALYSHEVA

Education: 2007--master's degree in Aviation and Cosmonautics, National Technical University of Ukraine, Kiev Polytechnic Institute.

Research interests: optical sensors for determination of aircraft attitude, aircraft navigation systems, computer vision.

Present position: junior researcher in the Department of Aircraft and Space Systems, National Technical University of Ukraine Kiev Polytechnic Institute.

Printer friendly Cite/link Email Feedback | |

Author: | Rahmouni, Mohamed; Malysheva, Julia |
---|---|

Publication: | Aviation |

Article Type: | Report |

Geographic Code: | 4EXUR |

Date: | Dec 1, 2012 |

Words: | 1931 |

Previous Article: | Reliability of fleet of aircraft taking into account information exchange about the discovery of fatigue cracks and the human factor. |

Next Article: | A numerical study of parachute inflation based on a mixed method. |

Topics: |