Open Access Open Access  Restricted Access Subscription Access

Automatic Vision-Based Forest Fire Detection Technologies for Unmanned Aerial Vehicles

Chi Yuan, Youmin Zhang, Zhixiang Liu

Abstract


Forest fires are a universal problem that destroy large amount of natural resources, but also wreaks general havoc on wildlife and their natural habitat, destroy ecosystems and creates environmental pollution. Firefighting is one of today’s most important events for natural and environmental resources protection and conservation. UAVs (Unmanned Aerial Vehicles) with remote sensing systems offer rapid and low-cost approaches and have great potential for forest fire detection which have attracted researchers’ attention worldwide. This paper reviews the existing vision-based automatic forest fire detection technologies for UAVs. The promising advantages and benefits of applying the UAVs tool in forests fire detection are assessed. Several forest fire detection systems using UAVs are listed and a general description of the UAVs based forest fire detection system is presented. Lots of papers referred to automatic vision-based forest fire detection methods/algorithms are identified. Some challenging issues and suggestion of future research directions in the area of vision-based forest fires detection through the use of UAVs are also addressed.

Full Text:

PDF

References


Martinez-de Dios, J.R., Arrue, B.C., Ollero, A., Merino, L., Gómez-Rodríguez, F., “Computer vision techniques for forest fire perception,” Image and Vision Computing, Vol. 26, No. 4, 2008, pp. 550–562.

Kolarić, D., Skala, K., Dubravić, A., “Integrated system for forest fire early detection and management,” Periodicum Biologorum, Vol. 110, No. 2, 2008, pp. 205–211.

Celik, T., and Demirel, H., “Fire detection in video sequences using a generic color model,” Fire Safety Journal, Vol. 44, No. 2, 2009, 147-158.

Vipin, V., “Image processing based forest fire detection,” Emerging Technology and Advanced Engineering, Vol. 2, No. 2, 2012, pp. 87–95.

Günay, O., Taşdemir, K., Uğur Töreyin, B., Enis Çetin, A., “Video based wildfire detection at night,” Fire Safety Journal, Vol. 44, No. 6, 2009, pp. 860-868.

Arrue, B.C., Ollero, A., Martinez-de Dios, J.R., “An intelligent system for false alarm reduction in infrared forest-fire detection,” IEEE Intelligent Systems, Vol. 15, No. 3, 2000, pp. 64–73.

Beard, R. W., McLain, T. W., Nelson, D. B., Kingston, D., Johanson, D., “Decentralized cooperative aerial surveillance using fixed-wing miniature UAVs,” Proceedings of the IEEE, Vol. 94, No.7, 2006, pp. 1306–1324.

Olsson, H., Egberth, M., Engberg, J. et al., “Current and emerging operational uses of remote sensing in Swedish forestry,” Proceedings of the 5th Annual Forest Inventory and Analysis Symposium, arranged by US Forest Service, Portland, USA, 2005, pp. 39–46.

Hunt Jr, E. R., Hively, W. D., Daughtry, C. et al. , “Remote sensing of crop leaf area index using unmanned airborne vehicles,” Proceedings of the Pecora 17 Symposium, Denver, USA, 2008.

Den Breejen, E., Breuers, M., Cremer, F., Kemp, R., Roos, M., Schutte, K., De Vries, J. S., “Autonomous forest fire detection,” Proceedings of the 3rd International Conference on Forest Fire Research, 1998, pp. 2003-2012.

Anderson, H.E., “Fire spread and flame shape,” Fire Technology, Vol. 4, No. 1, 1968, pp. 51-58.

Bradley, J. M. and Taylor, C. N., “Geo-referenced mosaics for tracking fires using unmanned miniature air vehicles,” Journal of Aerospace Computing, Information and Communication, Vol. 8, No. 10, 2011, pp. 295-309.

Lin, H., Liu, Z., Zhao, T., & Zhang, Y., “Early warning system of forest fire detection based on video technology,” Proceedings of the 9th International Symposium on Linear Drives for Industry Applications, Springer Berlin Heidelberg, Vol. 3, 2014, pp. 751-758.

Everaerts, J., “The use of unmanned aerial vehicles (UAVs) for remote sensing and mapping,” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 37. Part B1, Beijing, China, 2008, pp. 1187-1192.

Mahmoud, M., Jiang, J., and Zhang, Y. M., “Active Fault Tolerant Control Systems: Stochastic Analysis and Synthesis,” Springer, 2003.

Yu, C. Y., Fang, J., Wang, J. J., Zhang, Y. M., “Video fire smoke detection using motion and color features,” Fire Technology, Vol. 46, No. 3, 2010, pp. 651-663.

Mirzaei, M., Sharifi, F., Gordon, B. W., Rabbath, C. A., Zhang, Y. M., “Cooperative multi-vehicle search and coverage problem in an uncertain environment,” The 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC), IEEE, Orlando, Florida, USA, 2011, pp. 4140-4145.

Martínez-de-Dios, J. R., Merino, L., Ollero, A., Ribeiro, L. M., Viegas, X., "Multi-UAV Experiments: Application to Forest Fires," Multiple Heterogeneous Unmanned Aerial Vehicles, Springer Berlin Heidelberg, 2007, pp. 207-228.

HomChaudhuri, B., Kumar, M., “Optimal fireline generation for wildfire fighting in uncertain and heterogeneous environment,” American Control Conference, Baltimore, Maryland, USA, 2010, pp. 5638–5643.

Merino, L., Caballero, F., Dios, J. D., Ollero, A., “Cooperative fire detection using unmanned aerial vehicles,” Proceedings of the 2005 IEEE International Conference on Robotics and Automation (ICRA), IEEE, Busan, South Korea, 2005, pp. 1884-1889.

Martínez-de Dios, J.R., Ramiro, J., Merino, L., Ollero, A., “Fire detection using autonomous aerial vehicles with infrared and visual cameras,” Proceedings of the 16th IFAC World Congress, Vol. 16, Czech Republic, 2005, pp. 1379.

Chen, T. H., Yin, Y. H., Huang, S. F., Ye, Y.T., “The smoke detection for early fire-alarming system base on video processing,” Proceedings of the 2006 International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IEEE, 2006.

Ambrosia, V., “Remotely piloted vehicles as fire imaging platforms: The future is here,” Wildfire Magazine, Vol.11, No. 3, 2002, pp. 9-16.

Ollero, A., Lacroix, S., Merino, L., Gancet, J., Wiklund, J., Remuss, V., Gutierrez, L.G., Viegas, D.X., Gonzalez, M.A., Mallet, A., Alami, R., Chatila, R., Hommel, G., Colmenero, F.J., Veiga, I., Arrue, B., Ferruz, J., Martínez-de Dios, J. R., Caballero, F., “Multiple eyes in the skies,” IEEE Robotics & Automation Magazine, Vol. 12, No. 2, 2005, pp. 46-57.

Campbell, D., Born, W., Beck, J., Bereska, B., Frederick, K., Sun, H., “The airborne wildfire intelligence system: A decision support tool for wild land fire managers in Alberta,” AeroSense 2002, International Society for Optics and Photonics, 2002, pp. 159-170.

Çetin, A.E., Dimitropoulos, K., Gouverneur, B., et al., “Video fire detection–Review,” Digital Signal Processing, Vol. 23, No. 6, 2013, pp. 1827-1843.

Casbeer, D.W., Kingston, D.B., Bear, A.W., McLain, T.W., Li, S., Mehra, R., “Cooperative forest fire surveillance using a team of small unmanned air vehicles,” International Journal of Systems Science, Vol. 37, No. 6, 2006, pp. 351-360.

Zhou, G., Li, C., Cheng, P., “Unmanned Aerial Vehicle (UAV) real-time video registration for forest fire monitoring,” Proceedings of Geoscience and Remote Sensing Symposium, Vol. 3, IEEE, 2005, pp. 1803-1806.

da Penha O.S. Nakamura, E.F., “Fusing light and temperature data for fire detection,” IEEE Symposium on Computers and Communications, IEEE, Riccione, Italy, 2010, pp. 107–112.

Li, M., Xu, W., Xu, K., Fan, J., Hou, D., “Review of fire detection technologies based on video images,” Journal of Theoretical & Applied Information Technology, Vol. 49, No. 2, 2013, pp. 700-707.

Huseynov, J. J., Baliga, S., Widmer, A., Boger, Z., “Infrared flame detection system using multiple neural networks,” International Joint Conference on Neural Networks, Orlando, USA, 2007, pp. 608–612.

Gunay, O., Toreyin, B. U., Kose, K., Cetin, A. E., “Entropy-functional-based online adaptive decision fusion framework with application to wildfire detection in video,” IEEE Transactions on Image Processing, Vol. 21, No. 5,2012, pp. 2853-2865.

Gancet, J., Hattenberger, G., Alami, R., Lacroix, S. Task planning and control for a multi-UAV system: architecture and algorithms. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, 2005, pp. 1017-1022.

Lacroix, S., Alami, R., Lemaire, T., Hattenberger, G., Gancet, J., “Multiple Heterogeneous Unmanned Aerial Vehicles, Chapter Decision Making in Multi-UAV Systems: Architecture and Algorithms,” Springer, 2007.

Surit, S., and Chatwiriya, W., “Forest fire smoke detection in video based on digital image processing approach with static and dynamic characteristic analysis,” First ACIS/JNU International Conference on Computers, Networks, Systems, and Industrial Engineering, IEEE, Jeju Island, South Korean, 2011, pp. 35-39.

Zhang, D., Hu, A., Rao, Y., Zhao, J., Zhao, J., “Forest fire and smoke detection based on video image segmentation,” International Symposium on Multispectral Image Processing and Pattern Recognition, International Society for Optics and Photonics, 2007, pp. 67882H-67882H-7.

Karafyllidis, I., “Design of a dedicated parallel processor for the prediction of forest fire spreading using cellular automata and genetic algorithms,” Engineering Applications of Artificial Intelligence, Vol. 17, No. 1, 2004, pp. 19–36.

Hucaljuk, M., “Remote sensing of wild fires by an ultra-light Unmanned Aerial Vehicle,” The 24th EARSeL Symposium New Strategies for European Remote Sensing Dubrovnik, Dubrovnik, Croatia, 2004.

Merino, L., Caballero, F., Martínez-de-Dios, J. R., Maza, I., & Ollero, A., “An unmanned aircraft system for automatic forest fire monitoring and measurement,” Journal of Intelligent & Robotic Systems, Vol. 65, No.1-4, 2012, pp. 533-548.

Bosch, I., Serrano, A., Vergara, L., “Multisensor network system for wildfire detection using infrared image processing,” The Scientific World Journal, Vol. 2013, 2013, pp. 1-10.

Pastor, E., Águeda, A., Andrade-Cetto, J., Muñoz, M., Pérez, Y., Planas, E., “Computing the rate of spread of linear flame fronts by thermal image processing,” Fire Safety Journal, Vol. 41, No. 8, 2006, pp. 569-579.

Ononye, A.E., Vodacek, A., Saber, E. “Automated extraction of fire line parameters from multispectral infrared images,” Remote Sensing of Environment, Vol. 108, No. 2, 2007, pp. 179-188.

Martinez de Dios, J.R., André, J., Gonçalves, J.C., Arrue, B.C., Ollero, A., Viegas, D.X., “Laboratory fire spread analysis using visual and infrared images,” International Journal of Wildland Fire, Vol. 15, No. 2, 2006, pp. 179-186.

Rossi, L., Molinier, T., Akhloufi, M., Tison, Y., Pieri, A., “A 3D vision system for the measurement of the rate of spread and the height of fire fronts,” Measurement Science and Technology, Vol. 21, No. 10, 2010, pp. 1-12.

Rudz, S., Chetehouna, K., Hafiane, A., Sero-Guillaume, O., & Laurent, H., “On the evaluation of segmentation methods for wildland fire,” Advanced Concepts for Intelligent Vision Systems. Springer Berlin Heidelberg, 2009, pp. 12-23.

Ollero, A., Arrue, B.C., Martínez-de Dios, J.R., Murillo, J.J., “Techniques for reducing false alarms in infrared forest-fire automatic detection systems,” Control Engineering Practice, Vol. 7, No. 1, 1999, pp. 123-131.

Sharifi, F., Zhang, Y. M., and Aghdam, A. G., (2014), A distributed deployment strategy for multi-agent systems subject to health degradation and communication delays, Journal of Intelligent and Robotic Systems, Vol. 73, No. 1-4, 2014, pp. 623-633.

Merino, L., Caballero, F., Martínez-de Dios, J.R., Ferruz, J., Ollero, A., “A cooperative perception system for multiple UAVs: application to automatic detection of forest fires,” Journal of Field Robotics, Vol. 23, No. 3-4, 2006, pp. 165-184.

Chen, T., Wu, P., Chiou, Y., “An early fire-detection method based on image processing,” International Conference on Image Processing, vol. 3, IEEE, 2004, pp. 1707-1710.

Töreyin, B.U., Dedeoğlu, Y., Güdükbay, U., Çetin, A.E., “Computer vision based method for real-time fire and flame detection,” Pattern Recognition Letters, Vol. 27, No. 1, 2006, pp. 49-58.

Töreyin, B.U., Dedeoğlu, Y., Çetin, A.E., “Flame detection in video using hidden Markov models,” Proceedings IEEE International Conference on Image Processing, Vol. 2, IEEE, 2005, pp. 1230-1233.

Töreyin, B.U., Dedeoğlu, Y., Çetin, A.E., “Contour based smoke detection in video using wavelets,” European Signal Processing Conference, Florence, Italy, 2006, pp. 123-128.

Mahdipour, E., and Dadkhah, C., “Automatic fire detection based on soft computing techniques: review from 2000 to 2010,” Artificial Intelligence Review, 2012, pp. 1-40.

Byram, G.M., “Combustion of forest fuels”, Forest Fire: Control and Use, edited by Davis, K. P., New York, McGraw-Hill, 1959, pp. 61–89.

Martinez-de Dios, J.R., and Ollero, A., “A new training based approach for robust thresholding,” Proceedings of the World Automation Congress, Vol. 18, IEEE, Seville, Spain, 2004, pp.121-126.

Çelik, T., Özkaramanl, H., Demirel, H., “Fire pixel classification using fuzzy logic and statistical color model,” IEEE International Conference on Acoustic Speech Signal Processing (ICASSP), Vol. 1, Hawaii, USA, 2007, pp. I-1205–I-1208.

Li, Y., Vodacek, A., Zhu, Y., “An automatic statistical segmentation algorithm for extraction of fire and smoke regions,” Remote Sensing of Environment, Vol. 108, No. 2, 2007, pp. 171-178.

Alonso-Betanzos, A., Fontenla-Romero, O., Guijarro-Berdiñas, B., et al., “An intelligent system for forest fire risk prediction and firefighting management in Galicia,” Expert Systems with Applications, Vol. 25, No. 4, 2003, pp. 545-554.

Denham, M., Cortés, A., Margalef, T., Luque, E., “Applying a dynamic data driven genetic algorithm to improve forest fire spread prediction,” International Conference on Computational Science (ICCS), Springer Berlin Heidelberg , Vol. 5103, 2008, pp. 36–45.

Yu, C.Y., Zhang, Y. M., Fang, J., Wang, J.J., “Texture analysis of smoke for real-time fire detection,” Second International Workshop on Computer Science and Engineering, Vol. 2, Qingdao, China, 2009, pp. 511–515.

Olivas, J.A., “Forest fire prediction and management using soft computing,” IEEE International Conference on Industrial informatics, IEEE, 2003, pp. 338–344.

Abdalhaq, B., Cortés, A., Margalef, T., Luque, E., “Enhancing wild land fire prediction on cluster systems applying evolutionary optimization techniques,” Future Generation Computer Systems, Vol. 21, No. 1, 2005, pp. 61–67.

Fowler, A., Teredesai, A.M., De Cock, M., “An evolved fuzzy logic system for fire size prediction,” The 28th North American Fuzzy Information Processing Society Annual Conference, Cincinnati, Ohio, USA, 2009, pp. 1–6.

Yuan, F., “A fast accumulative motion orientation model based on integral image for video smoke detection,” Pattern Recognition Letters, Vol, 29, No, 7, 2008, pp. 925-932.

Ho, C.C., Kuo, T.H., “Real-time video-based fire smoke detection system,” IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Singapore, 2009, pp. 1845–1850.

Wendt, K., “Efficient knowledge retrieval to calibrate input variables in forest fire prediction,” MSc Thesis, Computational Science and Engineering, Universidad Autónoma de Barcelona, Barcelona, Spain, 2008.

Jaber, A., Guarnieri, F., Wybo, J. L., “Intelligent software agents for forest fire prevention and fighting,” Safety Science, Vol. 39, No. 1, 2001, pp. 3-17.




DOI: http://dx.doi.org/10.21535%2FProICIUS.2014.v10.297

Refbacks

  • There are currently no refbacks.