Open Access Open Access  Restricted Access Subscription Access

VILS: A Vision-In-The-Loop-Simulation Platform for Vision based Studies on UAVs

Debasish Ghose


Vision based systems are rapidly growing. However a simulator that can perform the required vision based simulation for verifying and validating algorithms is not common. Due to lack of such simulators, more often than not, the algorithms are frozen only after several trials on the actual prototype platform which is time consuming and expensive. The paper brings out the development of a Vision-in-the-Loop-Simulation platform (VILS) that facilitates vision based development studies on UAVs. The simulator is a self-contained, compact, low cost, PC/Laptop based set-up developed using Matlab and FlightGear software. The paper also develops a novel image processing algorithm for roll attitude determination using the Earth’s horizon in the presence of foreground objects by focusing on the central portion of the image. The Simulation results of testing the algorithm on the developed VILS is also presented.

Full Text:



Hill, J., Park, W.T., “Real-time control of a robot with a mobile camera,” Proceedings of 9th International Symposium on Industrial Robots, pp. 233-246, Washington D.C, March, 1979.

Saripalli, S., Montgomery, J.F., Sukhatme, G.S., “Visual Guided Landing of an Unmanned Aerial Vehicle.” IEEE Transactions on Robotics and Automation, Vol19, No3, pp. 371-380, 2003.

Sharp, C.S., Shakernia, O., Shankar, S.S., “A Vision System for Landing an Unmanned Aerial Vehicle.” IEEE International Conference on Robotics and Automation, pp. 1720-1727, 2001.

Zufferey, J.C., Floreano, D., “Toward 30-gram Autonomous Indoor Aircraft: Vision-based Obstacle Avoidance and Altitude Control.” IEEE International Conference on Robotics and Automation, 2005.

Shim, D.H., Huh, S., Min, B.M., “A Vision-based Automatic Landing System for Fixed-wing UAVs using an Inflated Airbag.” AIAA 2008-7450, AIAA Guidance, Navigation and Control Conference and Exhibit, 18-21

August, 2008.

Wagter, C.D., Proctor, A.A., Johnson, E.N., “Vision-Only Aircraft Flight Control.” AIAA Digital Avionics Conference, Indianapolis, October, 2003.

Johnson, E., Fontaine, S., “Use of Flight Simulation to complement flight testing of low-cost UAV’s.” Proceedings of AIAA Conference on Modelling and Simulation Technologies, 2001.

Gans, N.R., Dixon, W.E., Lind, R., Kurdila, A., “A hardware in the loop simulation platform for vision-based control of unmanned air vehicles.” Mechatronics 19(2009), pp. 1043-1056, 2009.

Stevens, B.L., Lewis, F.L., Aircraft Control and Simulation, 2nd ed., John Wiley and Sons, New York, 2003.

Nelson, R.C., Flight Stability and Automatic Control, 2nd ed., McGraw-Hill, Massachusetts, 1998.

Mor, J.J., “The Levenberg-Marquardt Algorithm: Implementation and Theory, Numerical Analysis, ed. G.A. Watson, Lecture Notes in Mathematics 630.” Springer Verlag, pp. 105-116, 1977.




Canny, J., “A Computational Approach to Edge Detection.” IEEE transactions on Pattern Analysis and Machine Intelligence, Vol. Pami-8, No 6, 1986.



  • There are currently no refbacks.