The 7th International Conference on Engineering and Technology ICET-2015, Phuket, June19-20, 2015 Prince of Songkla University, Faculty of Engineering Hat Yai, Songkhla, Thailand 90112 System for assistance during evacuation process Srdjan Tegeltija1, Nikola Djukic1, Branislav Tejic1, Gordana Ostojic1*, Stevan Stankovski1 1 University of Novi Sad, Faculty of Technical Sciences, Novi Sad, Serbia * Email of corresponding author: goca@uns.ac.rs Abstract: In this paper the system for assistance in evacuation of threatened people is described. System assists persons by guiding them to safe location using UAV. UAV regulates its speed using communication device which is dropped to the person. With continuous monitoring of threatened persons, panic, injuries and casualties could be avoided. Continuous monitoring of endangered area, provides real time corrections of evacuation route. Key Words: UAV, assistance, evacuation process 1. INTRODUCTION Unmanned aircraft is aircraft without the presence of the pilot. In the literature unmanned aircraft most often could be found as UAV (Unmanned Aerial Vehicle). UAV can be autonomous aircraft or aircraft controlled by the operator using remote controls. For this reason, these systems can be found in the literature as the RPV (Remotely Piloted Vehicle). In the literature there are other labels have been introduced for such systems, like the Drone, ROA (Remotely Operated Aircraft), UVS (Unmanned Vehicle System). Although originally designed and developed for military use, in recent years unmanned aircrafts have been used in the civil sector [1]. Today in the market there are UAVs designed for fun and can fit on the human palm [2], as well as commercially available unmanned aircraft that can carry large load and various equipment weight of few kilograms to a several tens of kilograms [3]. Equipment that can be mounted on UAVs is diverse such as: cameras, various sensors, clamps and many other components depending on the area of application. Examples of application of unmanned aircraft are monitoring and recording [4], the collection of data on pollution [5] [6], chemical protection and fertilization of agriculture crops (use of pesticides, herbicides, insecticides and fertilizers) [7]. UAVs are also used during natural disasters and accidents, such as monitoring the situation [8] [9], detection of persons in danger and delivery of first aid, food and water [10], mapping the terrain providing rescuers insight into the condition of the field [11]. Natural disasters or accidents caused by human error, such as floods, forest fires, or industrial accidents, often affect large populated areas, threatening the lives and well-being of the entire population. As one aspect of emergency response, evacuation can be defined as the removal of residents from the area that is considered dangerous to the security zone as quickly as possible and with the highest reliability [12]. Planning evacuation route is an important component of disaster management in order to reduce injuries and loss of life. Injuries are in this way reduced to a minimum. Aggravating circumstance that occur during the evacuation process is the panic in individuals who are in danger [13], [14]. Various studies have dealt with the two types of evacuation: evacuation of people in buildings and regional evacuation. The specificity of the evacuation of buildings is that the space for movement restricted, stairs must be used by rescuers and people in danger, various obstacles (walls, doors, smoke, fire, etc.). Papers [15] - [17] present analysis of evacuations in buildings. Specifics of regional evacuations are: it is performed on large areas, include a very large number of people (the problem of managing large crowds), weather conditions (night, rain, wind, smoke and toxic gases in case of large fires, etc.). Papers [18] - [21] present an analysis of regional evacuations. In this paper a system for assistance during evacuation process is presented. UAV leads people from the danger zone to a safe location. After arriving to a safe location, other participants in the evacuation process takes evacuees and transports them to the hospitals or shelters. In order to avoid panic reactions it is necessary to constantly monitor evacuees. In addition, it is necessary to adjust the movement speed of UAV to the persons movement speed, as well as giving a signal to people when they need to change their movement speed in case of need (to speed up due to the rise of water in case of flooding, or intensified wind and smoke in the case of fire). To enable communication between the persons and the UAV hardware device is realized by using XBee ZB PRO Series 2 communication module. 2. SYSTEM OVERVIEW System for assisstance during evacuation process is based on the usage of UAV. UAV leads people from the danger zone to a safe location. After arriving to a safe location, other participants in the evacuation process (medical services, military and firefighters) takes evacuees and transports them to the hospitals or shelters. Fig. 1. shows the algorithm of the system. After obtaining the information on which location are endangered people, in order to determine optimal and safe evacuation route it is necessary to carry out photographing or the mapping of the area [22]. For the determination of the evacuation route two approaches can be applied, manual routing and automated routing. In the case of manual routing operator, who controls UAV, have to manually determine evacuation route in the dedicated software (to determine the points through UAV should pass). In the case of an automated approach for determining evacuation route dedicated software would perform processing of images and terrain mapping results, in order to determine the safe and unsafe regions. Evacuation route would go through a safe regions (existing roads, meadows, etc), while the unsafe regions should be avoided (forests, water, fire and smoke) [23] [26]. The evacuation route could be determined by algorithms presented in [27] [28]. people, and if necesary UAV could deliver first aid kit, water, food and instructions on how UAV will guide people to safe location. To start an evacuation process UAV waits for communication confirmation (people must press button on communication device). Management of UAVs could be performed manually by the operator or automatically using dedicated flight controller. During the flight the UAV continuously measure the RSSI between communication devices, and on the basis measured RSSI value the distance between the UAV and the people is estimated. Depending on the estimated distance correction of the UAV flying speed is performed. The UAV at the same time sends a command to the communication device for required correction of people moving speed which is shown on LED indicators and emitted as sound signal on buzzer. During the evacuation process it is necessary to constantly monitor the situation in the area. In case of an larger area one UAV could be used to lead the people and other UAV, or more of them, would be responsible for monitoring the status of that area, so that in the event of unforeseen circumstances correction of evacuation route could be made. Examples for changes in the evacuation area can be: sudden occurrence of landslides, in case of fire changes in direction and strength of the wind that could direct the fire and smoke to the evacuation route. Fig. 2. Example of evacuation route Using FPV (First Person View) system, which presents surveillance system that sends video signal from camera mounted on the UAV to the display on the operator terminal, the operator can monitor the movement of people and could, at any moment, take control over UAV in the event of an unforeseen situation (people are slowing down due to difficult conditions), in case of automated flight. When UAV brings people to a safe location evacuation process if finished. If there are more groups of people that need to be evacuated, evacuation process can be repeated. 3. UNAMNNED AERIAL VEHICLES (UAVS) Fig. 1. Algorithm of the system After the automated determination of the evacuation route (points through UAV should pass), it is necessary that the operator make adjustments (if needed) and confirm the evacuation route. Fig. 2. shows an example of an evacuation route. Point A represents a danger zone, point B is a safe zone. The arrows shows the path in which UAV and persons should move. After confirming the evacuation route, UAV is positioned to the initial position. The initial position is the position where are people, who needs to be guided to a safe location, located. When came to the initial position UAV will deliver communication device to endangered "UVS International" [29] is an international association of manufacturers of unmanned aircraft, manufacturers of subsystems and key components and related equipment for unmanned aerial vehicles, as well as companies that provide services to or for unmanned aerial vehicles. International Organization "UVS International" conducted the categorization of unmanned UAV to the range, altitude, flight autonomy and weight [30]. Depending on the type of realizations there are fixed wing UAVs and rotary wing UAVs. The wings are shaped to make air move faster over the top of the wing. When air moves faster, the pressure of the air decreases. So the pressure on the top of the wing is less than the pressure on the bottom of the wing. The difference in pressure creates a force on the wing that lifts the wing up into the air [31]. A typical representative of UAV with fixed wings is plane. The air flow over the wings is caused by the movement of the UAVwhich is enabled by drive engine (a jet engine, the engine with the propeller). If there is no movement of the UAV there is no lift force. To fly, fixed wing UAV requires particular velocity that depends on the shape and surface of the wings, the maximum weight of the UAV, etc. For UAV with rotary wing air flow over the wing is caused by the rotating the wing (or propeller) powered by a drive engine. A typical representative of the UAV with rotary wings is a helicopter. To fly, rotary wing UAV requires a certain rotation speed of propeller, which depends on the weight of the UAV, shape and surface of propellers, etc. Both types of UAVs have certain advantages and limitations, which make them more or less suitable for different applications [32]. For this system we used rotary wing UAV, because they have possibility of vertical takeoff and landing, the ability to hover (maintain a fixed position in the air), to fly at very low speeds and perform agile maneuvering, a Tarot TL960 hexacopter is used (Fig. 3.) Fig. 3. Tarot TL960 hexacopter To be autonomous, it is necessary that UAV possess a dedicated flight controller. One of the most famous flight controller is "APM Autopilot Suite" [33]. "APM Autopilot Suite" is a platform that includes hardware and software used for managing unmanned aerial vehicles and vehicles on the ground. In addition to the "APM Autopilot Suite" platform, controllers for UAVs from company DJI have wide application too (Naza series, WooKong series, etc.) [34]. As flight controller Naza-M Light is used. 4. COMMUNICATION DEVICE In order to enable the connection between UAV and endangered people two communication devices are realized, one master and one slave communication device. Master communication device is mounted on UAV, connected to UAV control unit, and consists of microcontroller and communication module. Slave communication device is similar, but in addition it consists of command buttons, LED indicators and buzzer. Master communication device take power supply from UAV, while slave communication device has a battery power supply. Fig. 4. shows slave communication device. For powering the slave communication module a standard battery 6LR61 with nominal voltage of 9V has been used. A microcontroller is used for controlling communication modul, for reading states of buttons, for settings states of LED indicators, and to control a buzzer. For realization of communication devices a microcontroller Atmel ATmega 8 is used. Button are used for sending commands to master communication device (initial communication confirmation and start communication between master and slave device, stoping the UAV). LED indicators are used to inform people about speed of movement (speed is correct, people must speed up or people must slow down). Buzzer is used for emmiting audio signal which tells people if is speed of movement is correct, or if they must speed up or slow down. Fig. 4. Communication device As communication modul XBee Pro ZB Series 2 module is used. XBee Pro ZB Series 2 is based on ZigBee technology. ZigBee is a wireless technology developed as an open global standard to address the unique needs of low-cost, low-power wireless M2M (Machine to Machine) networks. The ZigBee standard operates on the IEEE 802.15.4 physical radio specification and operates in unlicensed bands including 2.4 GHz, 900 MHz and 868 MHz [35]-[37]. The specification is a packet-based radio protocol intended for low-cost, battery-operated devices. The protocol allows devices to communicate in a variety of network topologies and can have battery life lasting several years. XBee-PRO ZB ZigBee modules provide cost-effective wireless connectivity to devices in ZigBee mesh networks. Utilizing the ZigBee PRO Feature Set, these modules are interoperable with other ZigBee devices, including devices from other vendors. Programmable versions of the XBee-PRO ZB ZigBee Series 2 module make customizing ZigBee applications easy, even without wireless design expertise [38]. 5. CONCLUSION In this paper the system for assistance in the evacuation process of endangered people is presented. UAV would carry out photographing or mapping of the area, in order to determine the evacuation route. During the evacuation process UAV would lead endangered people to a safe location. Depending on the situation the person would follow the UAV on foot (inaccessible mountainous terrain) or using some vehicle (boat in case of flooded area). During the evacuation process people would be constantly monitored in order to respond in a timely manner (correction of UAV speed). In addition to constantly monitoring of area status will provide changing of evacuation route if necessary. In future work a further development of the system for assistance during evacuation process is planned. Different types of UAVs will be examined in order to realize which UAV would be optimal for evacuation process on the basis of flight speed, flight autonomy, max payload, etc. Different algorithms for image processing and segmentation for recognition of water, forest, fire, smoke, etc. will be examined, and different algorithms for routing in order to efficiently and reliably determine evacuation routes will be examined. 6. REFERENCES [1] http://tangosix.rs/2013/11/06/civilni-dronoviblagoslov-prokletstvo/ (accessed February 2015.). [2] https://droneflyers.wordpress.com/best-quadcoptersfor-2014-holiday-gift-giving/cheerson-cx-10-nanoquadcopter-review/ (accessed February 2015.). [3] http://www.schiebel.net/products/unmanned-airsystems/camcopter-s-100/system.aspx (accessed February 2015.). [4] N. Nigam, S. Bieniawski, I. Kroo and J. Vian, “Control of multiple UAVs for persistent surveillance: algorithm and flight test results,” IEEE Trans. Control Syst. Technol., vol. 20(5), pp. 12361251, 2012. [5] W. Zang, J. Lin, Y. Wang, and H. Tao, “Investigating small-scale water pollution with UAV remote sensing technology,” In World Autom. Congr. (WAC), pp. 1-4, 2012. [6] O. Trieschmann, “Oil spill issue and the capability of monitoring the problem by remote sensing,” Compend. of Summaries, pp. 169-176, 2008. [7] F. G. Costa, J. Ueyama, T. Braun, G. Pessin, F. S. Osório and P. A. Vargas, “The use of unmanned aerial vehicles and wireless sensor network in agricultural applications,” In IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), pp. 5045-5048, 2012. [8] S. M. Adams, and C. J. Friedland, “A survey of unmanned aerial vehicle (UAV) usage for imagery collection in disaster research and management,” In 9th Int. Workshop Remote Sens. Disaster Response, 2011. [9] G. Zhou, C. Li, and P. Cheng, “Unmanned aerial vehicle (UAV) real-time video registration for forest fire monitoring,” In IEEE Proc. Int. Geosci. Remote Sens. Symp. (IGARSS'05), vol. 3, pp. 1803-1806, 2005. [10] P. Doherty and P. Rudol, “A UAV search and rescue scenario with human body detection and geolocalization,” In AI 2007: Adv. Artif. Intell, pp. 1-13, 2013. [11] R. Hirokawa, D. Kubo, S. Suzuki, J. I. Meguro and T. Suzuki, T, “A small UAV for immediate hazard map generation,”, In AIAA2007-2725. AIAA Infotech@ Aerospace 2007 Conf. and Exhibit, pp. 710, 2007. [12] S. Shekhar, K. Yanga, V. M. Gunturia, L. Manikondaa, D. Olivera, X. Zhoua, B. Georgeb, S. Kimc, J. M. R. Wolffa and Q. Lua, “Experiences with evacuation route planning algorithms,” Int. J. Geogr. Inf. Sci., vol. 26(12), pp. 2253-2265, 2012. [13] D. Helbing, I. J. Farkas, P. Molnar and T. Vicsek, “Simulation of pedestrian crowds in normal and evacuation situations,” Pedestrian and evacuation dynamics, vol. 21, pp. 21-58, 2002. [14] G. A. Frank, C. O. Dorso, “Room evacuation in the presence of an obstacle,” Phys. A: Stat. Mech. Appl., vol. 390(11), pp. 2135-2145, 2011. [15] N. Pelechano and N.I. Badler, “Modeling crowd and trained leader behavior during building evacuation,” IEEE Comput. Graphics Appl., vol. 26(6), pp. 80-86, 2006. [16] N. Pelechano and A. Malkawi, “Evacuation simulation models: Challenges in modeling high rise building evacuation with cellular automata approaches,” Autom. Constr., vol. 17(4), pp. 377385, 2008. [17] N. Dimakis, A. Filippoupolitis and E. Gelenbe, “Distributed building evacuation simulator for smart emergency management,” Comp. J., vol. 53(9), pp. 1384-1400, 2010. G. Köster, D. Hartmann and W. Klein, “Microscopic pedestrian simulations: From passenger exchange times to regional evacuation,” In Oper. Res. Proc., 2010, pp. 571-576, 2011. [19] T. J. Cova and R. L. Church, “Modelling community evacuation vulnerability using GIS,” Int. J. Geogr. Inf. Sci., vol. 11(8), pp. 763-784, 1997. [20] Y. C. Chiu, H. Zheng, J. A. Villalobos, W. Peacock and R. Henk, ”Evaluating regional contra-flow and phased evacuation strategies for Texas using a largescale dynamic traffic simulation and assignment approach,” J. Homeland Secur. and Emergency Manage., vol. 5(1), 2008. [21] V. Pillac, P. Van Hentenryck, and C. Even, “A PathGeneration Matheuristic for Large Scale Evacuation Planning,” In Hybrid Metaheuristics, pp. 71-84, 2014. [Proc. 9th Int. Workshop, HM 2014, Hamburg, Germany, June 11-13, 2014.] [22] F. Remondino, L. Barazzetti, F. Nex, M. Scaioni and D. Sarazzi, “UAV photogrammetry for mapping and 3D modeling – current status and future perspectives,” Int. Arch. Photogramm. Remote Sens. and Spatial Inf. Sci., vol. 38(1), 2010. [23] G. J. Hay, G. Castilla, M. A. Wulder and J. R. Ruiz, “An automated object-based approach for the multiscale image segmentation of forest scenes,” Int. J. Appl. Earth Obs. Geoinf., vol. 7(4), pp. 339-359, 2005. [24] J. R. Martinez-de Dios, B. C. Arrue, A. Ollero, L. Merino and F. Gómez-Rodríguez, “Computer vision techniques for forest fire perception”, Image Vision Comput., vol. 26(4), pp. 550-562. 2008. [25] J. Smeeckaert, C. Mallet, N. David, N. Chehata and A. Ferraz, “Large-scale classification of water areas using airborne topographic lidar data”, Remote Sens. Environ., vol. 138, pp. 134-148, 2013. [26] P. Santana, R. Mendonça and J. Barata, “Water detection with segmentation guided dynamic texture recognition,” In IEEE Int. Conf. Rob. Biomimetics (ROBIO), pp. 1836-1841, 2012. [27] T. Lozano-Pérez and M. A. Wesley, “An algorithm for planning collision-free paths among polyhedral obstacles,” Commun. ACM, vol. 22(10), pp. 560570, 1979. [28] A. T. Rashid, A. A. Ali, M. Frasca and L. Fortuna, “Path planning with obstacle avoidance based on visibility binary tree algorithm,” Rob. Autom. Syst, vol. 61(12), pp. 1440-1449, 2013 [29] UVS International, http://uvs-international.org (accessed February 2015.). [30] http://www.insidegnss.com/auto/janfeb08-wp.pdf (accessed February 2015.). [31] http://www.grc.nasa.gov/WWW/k12/UEET/StudentSite/dynamicsofflight.html (accessed February 2015.). [32] http://www.uavinsider.com/rotary-wing-vs-fixedwing-uavs/ (accessed February 2015.). [33] http://ardupilot.com (accessed February 2015.). [34] http://www.dji.com/products/flight-controllers (accessed February 2015.). [35] http://www.digi.com/technology/rf-articles/wirelesszigbee (accessed February 2015.). [36] V. Brtka, D. Dobrilovic, Z. Stojanov, Z. Covic, and N. Bilinac, “Software application for analyses of ZigBee network performance designed for teaching and testing Wireless Sensor Networks,” In 12th IEEE Int. Symp. Intell. Syst. and Inf.(SISY), pp. 1-6, 2014. [37] D. Dobrilovic, Z. Stojanov and B. Odadzic, “Teaching application development for RFID/ZigBee networks using open source hardware,” In 10th IEEE Int. Symp. Telecommun. (BIHTEL), pp. 1-6, 2014. [38] http://www.digi.com/pdf/ds_xbeezbmodules.pdf (accessed February 2015.). [18]