Intelligent System based on Command Fusion and Fuzzy Logic Approaches - Application to mobile robot navigation
Intelligent System based on Command Fusion and Fuzzy Logic Approaches - Application to mobile robot navigation
Journal of the Korea Institute of Information and Communication Engineering. 2014. May, 18(5): 1034-1041
Copyright © 2014, The Korea Institute of Information and Commucation Engineering
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License( which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • Received : March 28, 2014
  • Accepted : April 30, 2014
  • Published : May 31, 2014
Export by style
Cited by
About the Authors
태석 진
Dept. of Mechatronics Engineering, Dongseo University, Busan Korea
현덕 김
Department of Electronics Engineering, Gyeongnam National University of Science and Technology, Jinju 660-758, Korea

This paper propose a fuzzy inference model for obstacle avoidance for a mobile robot with an active camera, which is intelligently searching the goal location in unknown environments using command fusion, based on situational command using an vision sensor. Instead of using "physical sensor fusion" method which generates the trajectory of a robot based upon the environment model and sensory data. In this paper, "command fusion" method is used to govern the robot motions. The navigation strategy is based on the combination of fuzzy rules tuned for both goal-approach and obstacle-avoidance. We describe experimental results obtained with the proposed method that demonstrate successful navigation using real vision data.
Ⅰ. Introduction
Autonomous mobile robot is intelligent robot that performs a given work with sensors by identifying the surrounded environment and reacts on the state of condition by itself instead of human. Unlike general manipulator in a fixed working environment [1] , it is required intelligent processing in a flexible and variable working environment. And studies on a fuzzy-rule based control are attractive in the field of autonomous mobile robot. Robust behavior in autonomous robots requires that uncertainty be accommodated by the robot control system. Fuzzy logic is particularly well suited for implementing such controllers due to its capabilities of inference and approximate reasoning under uncertainty [2] .
This requires formulation of a large and complex set of fuzzy rules. In this situation a potential limitation to the utility of the monolithic fuzzy controller becomes apparent. Since the size of complete monolithic rule bases increases exponentially with the number of input variables [2 , 3] , multi-input systems can potentially suffer degradations in real-time response. This is a critical issue for mobile robots operating in dynamic surroundings. Hierarchical rule structures can be employed to overcome this limitation by reducing the rate of increase to linear [4] .
First, this paper briefly introduces the operation of each command and the fuzzy controller for navigation system in chapter 2. Chapter 3 explains about behavior hierarchy based on fuzzy logic. In chapter 4, experimental results to verify efficiency of system are shown. Finally, Section 5 concludes this research work and mentions possible future related work.
Ⅱ. Fuzzy Controller Design
The proposed fuzzy controller is shown as follows. We define three major navigation goals, i.e., target orientation, obstacle avoidance and rotation movement; represent each goal as a cost function. Note that the fusion process has a structure of forming a cost function by combining several cost functions using weights. In this fusion process, we infer each weight of command by the fuzzy algorithm that is a typical artificial intelligent scheme. With the proposed method, the mobile robot navigates intelligently by varying the weights depending on the environment, and selects a final command to keep the minimum variation of the cost function [5 , 6] .
PPT Slide
Lager Image
명령융합알고리즘의 구조 Fig. 1 Structure of command fusion algorithm
- 2.1. Command for navigation
Seeking Goal command of mobile robot is generated as the nearest direction to the target point. The command is defined as the distance to the target point when the robot moves present with the orientation, 𝜃, the velocity, v , the desired position, ( xd , yd ), the current position ( xc , yc ). Therefore, a cost function is defined as Eq.(1).
PPT Slide
Lager Image
where, v is v max −|𝜃 c −𝜃| and represents the reduction ratio of rotational movement.
Avoiding obstacle command is represented as the shortest distance to an obstacle based upon the sensor data in the form of histogram. The distance information is represented as a form of second order energy, and represented as a cost function by inspecting it about all 𝜃 as shown in Eq. (2).
To navigate in a dynamic environment to the goal, the mobile robot should recognize the dynamic variation and react to it.
PPT Slide
Lager Image
Maintain heading command is minimizing rotational movement aims to rotate wheels smoothly by restraining the rapid motion. The cost function is defined as minimum at the present orientation and is defined as a second order function in terms of the rotation angle, 𝜃 as Eq. (3).
PPT Slide
Lager Image
The command represented as the cost function has three different goals to be satisfied at the same time. Each goal differently contributes to the command by a different weight, as shown in Eq. (4).
PPT Slide
Lager Image
- 2.2. Fuzzy Inference
We infer the weights of the usual fuzzy if-then rule by means of fuzzy algorithm. The main reason of using fuzzy algorithm is that it is easy to reflect the human's intelligence into the robot control. Fuzzy inference system is developed through the process of setting each situation, developing fuzzy logic with proper weights, and calculating weights for the commands [6 , 7] .
Fig. 2 shows the structure of a fuzzy inference system. We define the circumstance and state of a mobile robot as the inputs of fuzzy inference system, and infer the weights of cost functions. The inferred weights determine a cost function to direct the robot and decide the velocity of rotation. For the navigation control of the mobile robot, the results are transformed into the variation of orientation and angular velocities by the inverse kinematics of the robot .
PPT Slide
Lager Image
퍼지추론시스템의 구조 Fig. 2 Structure of Fuzzy Inference System
Fig. 3 shows the output surface of the fuzzy inference system for each weight fuzzy subsets using the inputs and the output. The control surface is fuzzy logic controller of seeing goal (a), fuzzy logic controller of avoiding obstacle (b), fuzzy logic controller of minimizing rotation (c), and fuzzy output (d).
PPT Slide
Lager Image
가중치 추론시스템의 멥버쉽함수 (a) ω1의 멥버쉽함수 (b) ω2의 멥버쉽함수 (c) ω3의 멥버쉽함수 (d) 입력 멥버쉽함수 Fig. 3 Membership function of Weight Inference System (a) Membership function of ω1 (b) Membership function of ω2 (c) Membership function of ω3 (d) Membership function of output
Ⅲ. Local Map Building
A mobile robot moves by selecting a more secure path after recognizing the environment to navigate using image information. When we estimate the environments from the conditions of camera’s actuator [4 , 8] , there are many uncertainties. That is, environment informations estimated from the errors of camera angle 𝛼, 𝛽, link parameters l 1 , l 2 and l 3 of camera actuator, and calculating process, all of them have uncertain informations. In this paper, therefore, we propose the method of making probability map from image information, considering these uncertainties. Let j , k resulted in image processing have uncertainties(Δ j , Δ k ) of Eq. 5.
PPT Slide
Lager Image
where Δ j , Δ k are 2 jointly gaussian random variables with probability density function(PDF) as shown in Eq. 7. and 𝜎 Δj =𝜎 Δk =0, m Δj = m Δk =0, ρ Δjk =0.
PPT Slide
Lager Image
Image information j , k mapped real distance information x , y respectively by translation equation as follows
PPT Slide
Lager Image
Uncertainty of images, therefore, represented that of real distance information X, Y. PDF which presented uncertainty of X, Y about a transformation of Eq. 7 is given by
PPT Slide
Lager Image
Where fJ ( x , y ), fK ( x , y ) are the relation of transformation that represented mapping relation between real coordinate x, y and camera image. fJK ( x , y ) is the jacobian matrix as follows
PPT Slide
Lager Image
and | fJK ( x , y )| is the determinant of a jacobian matrix and is in the following form
PPT Slide
Lager Image
Fig. 4 shows the simulation results about uncertainties between image plane and real space plane on condition that 𝛼=15°, 𝛽=0°, j=160 and k=180. The longer X, Y image distance, PDF of x, y is lower. It meant that long distance information has lower trust.
PPT Slide
Lager Image
가중치 추론시스템의 멥버쉽함수 (a) 영상평면상의 불확실성 (b) 실제 영상평면상의 불확실성 Fig. 4 Uncertainties for position plane (a) Uncertainty of image plane (b)Uncertainty of real space plane
Ⅳ. Experimental Results
This navigation method that includes the proposed algorithm is applied for mobile robot named as TurtleBot that has been developed in the laboratory for Intelligent Robotics as shown in Fig, 5 .
PPT Slide
Lager Image
TurtleBot 이동로봇 Fig. 5 TurtleBot mobile robot
This modified TurtleBot robot had to be fast, flexible and offer real time image processing capabilities for navigation, so we applied Controller Area Network(CAN) to Pioneer-DX. CAN is a serial bus system especially suited for networking “intelligent” devices as well as sensors and actuators within a system or sub-system [9] .
With the proposed method, we make an experiment on building environmental map. Parameter values used for experiment are shown in Table 1 .
실험에 대한 파라미터 값Table. 1Parameter values used for experiment
PPT Slide
Lager Image
실험에 대한 파라미터 값 Table. 1 Parameter values used for experiment
Fig. 6(a) is the image used on the experiment; Width of corridor is 2m and Joint angle parameter α, β of active camera are 11° and 0° respectively. After capturing the image, The ‘LOG’ operator is utilized to extract the edge elements. It is suitable for detecting edge element at corridor that appear noises (e.g.: Patterns of the bottom, wall) sensitively because it is difficult for edge detection in case of other edge operators which has the characteristic of high-pass filter.
PPT Slide
Lager Image
영상시스템의 실험결과 (a) 입력영상 (b) 매칭결과 Fig. 6 Experimental result of the vision system (a) Input image (b) Result of matching
The essential information to map building is edge information that meets with the bottom in the edge information extracted from LOG operation. Fig. 6(b) shows the image that the points meet with the bottom through the matching after LOG operation. We construct probability map by this informations [10] .
Fig. 7(a) shows the map including the experimental environment. We exclude the information over 6m because that has low probability. Because we can estimate the reliability through the probability approach, the better map can be acquired.
PPT Slide
Lager Image
주행환경과 확률맵 Fig. 7 Navigation environment and probability map
Fig. 7(b) is the values resulted from matching after image processing which shows the estimated map over front 6m. The brightness presents the probability, and through the transformation, in case of having the area of the same distance in the image, the farther the point is, the smaller the probability is. Therefore the information which extracted image has low truth because it has wide probability density.
Fig. 7(b) shows that maximum matching error is within 4% of the dash-line area in Fig 7(a) . Therefore, it can be seen that above vision system is proper to apply to navigation. The mobile robot navigates along a corridor with 2m widths and without obstacles and with some obstacles, respectively, as shown in Fig. 8 . The real trace of the mobile robot is shown in Fig. 8(a) .
PPT Slide
Lager Image
실내환경에서의 로보주행 (a) 장애물 환경에서의 로봇주행 결과 (b) 주행경로 (c) 로봇주행에 따른 방향 및 속도값 Fig. 8 Navigation of robot in corridor environment (a) Result of robot navigation with obstacles (b) Navigation trajectory (c) Direction and velocity for robot navigation
Fig. 8 illustrates the navigation–obstacle avoidance strategy by proposed method. The experimental results exhibit that the mobile robot can start moving from an initial point, avoids the box-like obstacles, and reaches a goal point. Fig. 8(a) shows the case study of three obstacles. Based on the evaluation qualitative method of the obstacles configuration from the information of the vision sensor, the mobile robot succeeds to reach the goal point in an environment cluttered with obstacles.
It demonstrates that the mobile robot avoids the obstacles intelligently and follows the corridor to the goal. In Fig. 8(b) the mobile robot performs a wall following mission in a narrow dead-end corridor. In the extreme situation at the end of the corridor accurate control response is required to avoid collision. When approaching the two corners corridor, the frontal vision sensors detect the wall, doors and the mobile robot performs a fast right turn and left turn, respectively. The robot’s velocity is reduced accordingly (see Fig. 8(c) ).
Finally, it should be pointed out that command fusion based fuzzy inference prove to be a satisfactory control strategy and has shown a good degree of robustness face to a large variability and uncertainty in the parameters. Overall, this project this project has served as a platform of a whole work dealing with mobile manipulation, where separation of tasks is considered.
Ⅴ. Conclusions
A fuzzy control algorithm for both obstacle avoidance and path planning has been implemented in experiment so that it enables the mobile robot to reach to goal point under the unknown environments safely and autonomously.
First, a theoretical development of a navigation procedure of a mobile robot with active camera in unknown environment with obstacle has been described.
Second, we showed an architecture for intelligent navigation of mobile robot which determine robot's behavior by arbitrating distributed control commands, seek goal, avoid obstacles, and maintain heading. Commands are arbitrated by endowing with weight value and combining them, and weight values are given by fuzzy inference method. Arbitrating command allows multiple goals and constraints to be considered simultaneously. To show the efficiency of proposed method, real experiments are performed.
To show the efficiency of proposed method, real experiments are performed. The experimental results show that the mobile robot can navigate to the goal point safely under unknown environments and also can avoid moving obstacles autonomously.
This research was supported by Gyeongnam National University of Science and Technology Grant-2012 and Basic Science Research Program funded by Dongseo University.
진태석(Taeseok Jin)
2003년 부산대학교 전자공학과 공학박사
2006년~현재: 동서대학교 메카트로닉스공학과 교수
현재: 한국지능시스템학회 회원이사
현재: 한국정보통신학회 기획이사
※관심분야 : 센서융합, 이동로봇, 컴퓨터비젼, 지능제어
김현덕(Hyun-Deok Kim)
1996년 경남대학교 전자공학과 공학박사
1989년~현재: 경남과학기술대학교 전자공학과 교수
2007: 한국지능시스템학회 제5대 회장역임
현재: 한국정보통신학회 이사
※관심분야 : 디지털신호처리, 신경망
Er M.J. , Tan T.P. , Loh S.Y. 2004 “Control of a mobile robot using generalized dynamic fuzzy neural networks,” Microprocessors and Microsystems 28 491 - 498    DOI : 10.1016/j.micpro.2004.04.002
Nair D. , Aggarwal J.K. 1998 “Moving Obstacle Detection from a Navigation Robot,” IEEE Transaction on robotics and automation 14 (3) 404 - 416    DOI : 10.1109/70.678450
Beom H.R. , Cho H.S. 1995 “A sensor-Based Navigation for a Mobile Robot Using Fuzzy Logic and Reinforcement Learning,” IEEE Transaction on system, man, and cybernetics 25 (3) 464 - 477    DOI : 10.1109/21.364859
Ohya A. , Kosaka A. , Kak A. 1998 “Vision-Based Navigation by a Mobile Robot with Obstacle Avoidance Using Single-Camera Vision and Ultrasonic Sensing,” IEEE Transactions on Robotics and Automation 14 (6) 969 - 978    DOI : 10.1109/70.736780
Tunstel E. 2000 Fuzzy Logic Techniques for Autonomous 470 TUNSTEL, de OLIVEIRA, AND BERMAN Vehicle Navigation, Studies in Fuzziness and Soft Computing Springer-Verlag Heidelberg “Fuzzy-behavior synthesis, coordination, and evolution in an adaptive behavior hierarchy,”
Cherroun L. , Boumehraz M. 2012 “Intelligent systems based on reinforcement learning and fuzzy logic approaches-Application to mobile robotic,” Proceeding of 2012 International Conference on Information Technology and e-Services (ICITeS) 1 - 6
Leng G. , McGinnity T.M. , Prasad G. 2005 “An approach for on-line extraction of fuzzy rules using a self-organizing fuzzy neural network,” Fuzzy Sets and Systems 150 211 - 243    DOI : 10.1016/j.fss.2004.03.001
Nishina T. , Hagiwara M. 1997 “Fuzzy inference neural network,” Neurocomputing 14 (3) 223 - 239    DOI : 10.1016/S0925-2312(96)00036-7
Jin T.S. , Lee J.M. 2004 “Trajectory Generation of a Moving Object for a Mobile Robot in Predictable Environment,” International Journal of Precision Engineering and Manufacturing 5 (1) 27 - 35
Wang D.S. , Zhang Y.S. , Si W.J. 2011 “Behavior-based hierarchical fuzzy control for mobile robot navigation in dynamic environment,” Proceeding of 2011 Chinese Control and Decision Conference(CCDC) 2419 - 2424