A Robotic Pan and Tilt 3-D Target Tracking System by Data Fusion of Vision, Encoder, Accelerometer, and Gyroscope Measurements
This paper presents a vision-tracking system for mobile robots, which travel in a 3-dimentional environment. The developed system controls pan and tilt actuators attached to a camera so that a target is always directly in the line of sight of the camera. This is achieved by using data from robot wheel encoders, a 3-axis accelerometer, a 3-axis gyroscope, pan and tilt motor encoders, and camera. The developed system is a multi-rate sampled data system, where the sampling rate of the camera is different with that of the other sensors. For the accurate estimation of the robot velocity, the developed system detects the slip of robot wheels, by comparing the data from the encoders and the accelerometer. The developed system estimates the target position by using an extended Kalman filter. The experiments are performed to show the tracking performance of the developed system in several motion scenarios, including climbing slopes and slip cases.
KeywordsVision tracking system Sensor data fusion Kalman filter Slip detection
Unable to display preview. Download preview PDF.
- 6.Algrain, M.C., Quinn, J.: Accelerometer Based Line-of-Sight Stabilization Approach for Pointing and Tracking Systems. In: Second IEEE Conference on Control Applications, vol. 1, pp. 159–163 (1993)Google Scholar
- 8.Xie, S., Luo, J., Gong, Z., Ding, W., Zou, H., Fu, X.: Biomimetic Control of Pan-Tilt-Zoom Camera for Visual Tracking Based-on an Autonomous Helicopter. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2138–2143 (2007)Google Scholar
- 10.Hwangbo, M., Kim, J., Kanade, T.: Inertial-Aided KLT Feature Tracking for a Moving Camera. In: Intelligent Robots and Systems, pp. 1909–1916 (2009)Google Scholar
- 11.Hwang, W., Park, J., Kwon, H., Anjum, M., Kim, J., Lee, C., Kim, K., Cho, D.D.: Vision Tracking System for Mobile Robots Using Two Kalman Filters and a Slip Detector. In: International Conference on Control, Automation and Systems, pp. 2041–2046 (2010)Google Scholar
- 12.Park, J., Hwang, W., Kwon, H., Kim, K., Cho, D.D.: A Novel Line of Sight Control System for a Robot Vision Tracking System, Using Vision Feedback and Motion-Disturbance Feedforward Compensation. Robotica (accepted)Google Scholar
- 13.Kim, T., Bahn, W., Lee, C., Lee, T., Shaikh, M.M., Kim, K.: Vision System for Mobile Robots for Tracking Moving Targets, Based on Robot Motion and Stereo Vision Information. In: 2011 IEEE/SICE International Symposium on System Integration, pp. 634–639 (2011)Google Scholar