VOL 2 . NO 1 e-ISSN : 2549-9904 ISSN : 2549-9610 INTERNATIONAL JOURNAL ON INFORMATICS VISUALIZATION Design and Develop an Autonomous UAV Airship for Indoor Surveillance and Monitoring Applications Hairol Nizam Mohd Shah#. Mohd Zamzuri Ab Rashid#. Zalina Kamis#. Mohd Shahrieel Mohd Aras#. Nursabillilah Mohd Ali#. Faizil Wasbari*. Mohd Nor Fakurazy Bin Abu Bakar# # Center for Robotics and Industrial Automation. Faculty of Electrical Engineering. Universiti Teknikal Malaysia Melaka. Malaysia * Faculty of Mechanical Engineering. Universiti Teknikal Malaysia Melaka. Malaysia E-mail: 1hnizam@utem. AbstractAi This project is about to develop an airship based on small size remotely controlled by human. The airship is one of Unmanned Airship Vehicle (UAV) which is can be apply in advertising. VIP security inspection, traffic monitoring and management and so on. The main purpose of this project is to design and develop an autonomous UAV airship for indoor surveillance and monitoring applications. The image will be captured from wireless camera where it mounted at a bottom of gondola. To determine the centroid points of the object are implemented in three phase edge detector, canny operator and threshold. The object will be display on Graphical User Interface (GUI) in 2D coordinated. In this project the systems able to detect only one object at one time. KeywordsAi canny operator, graphical user interface (GUI), object detection, edge detector monitoring applications. The airship was equipped with wireless camera and wireless transmission to allow basic navigation down the hallways. The monitoring and detection will be based on multi-input received from the intelligent and active vision implemented in the UAV airship. The feedback and monitoring output data from the control panel will be transmitted via wireless communication to the UAV. INTRODUCTION Today, the airship is capable to supporting terrestrial border protection as well as maritime and surveillance. The airships are designed to allow for operation flexibility. The mission need and operation concept will greatly determine the particular configurations of the individual airship and the overall fleet delivered. In order to effectively support the generals need to national border security system, our airship are designed to handle a made range of climatic conditions and payload demands. Unmanned Airship Vehicle (UAV) is an aircraft without human pilot onboard. It designed that can be controlled from a remote location by a human pilot on the ground, or it can fly autonomously based on the preprogrammed flight plans using the automations system. One of the basic characteristic of an UAV is that it must be equipped with the payload to carry out its target missions. Hence, if the aircraft equipped with a digital camera for taking aerial photos, then it can be considered an UAV. The UAV are often utilized for high risked mission or mundane Currently, most of the UAVAos are used for military purposed such as to performed reconnaissance as well as attack missions. In addition to that, they are also used in a small but growing numbers of civil applications such as fire fighting, crop dusting and aerial photography. In this project we propose to design and develop an autonomous UAV airship for indoor surveillance and II. LITERATURE REVIEW The previous research, . the project goal that they developed are provide a low speed aerial vehicle for environmental monitoring missions. Among the project objectives, one is to develop a realistic visual simulator of the airship from take off flight and landing. Flight simulator is systems that tries to copy, or simulate the experience of flying an aircraft. It is meant to be as realistic as possible. The different types of flight simulator range from computer based games up to full-size cockpit replicas mounted on hydraulic . r electromechanica. actuators, controlled by state of the art computer technology . They also make a priority to dynamic modeling and control system. Another previous make a research of the airship mostly focused on manual controller and they are also make a complete airship dynamic model based on body coordinated framed . The equation that they make to make a stability of dynamic model is given by : The added mass and inertia terms AA A are included in between the operator and the navigation system on the board of airship. The other method is used the external web interface (EWI) for the project . Figure 1 shows the example of possibilities of the web interface that they used. After logging on, the authorized user will be able to watch picture transmitted from web camera and to control the airship by means of several buttons or keyboard arrows. Moreover, it will be informed about the state of the battery. M add show in Eq. M add A A j i, j A 1,2. The kinetic energy (T) of inertia can be written as: 1 6 6 EuEu A j A iA j 2 i A1 j A1 The momentum (D) of the inertia can be written as: Di A CT CA i i A 1,2. The airship dynamic model is based on the body coordinated frame which is not inertia coordinated frame. the inertia force and momentum should be interconvert for coordinated gravity (CG) to coordinated vision (CV) . are show in Eq. 4 and 5. Fig. 1 Possibilities of the web interface E aE F1 A [ Fx A Fy A Fz ]T A AE A AxE E E dt M 1 A [M x A M y A M z ] E aK A AxK A VxE E E dT =AE In the years since the war, airships have seen a decline in popularity and usage. In present day, airships are typically used for advertising, sightseeing, surveillance, and research. Figure 2 shows a timeline of airship development starting in the 1850s with Henri GiffardAos first engine powered dirigible and ending in 1960s. The purpose of the project is to develop the system that able to recognized object that it detects by the camera. This project is dividing into two parts that is hardware and In the hardware part, a camera will be installing in a airship that it can capture the image from the driver view. The video information about the object that has been capture will be transmitted from camera to PC and it precedes the image analysis and recognition by the specific software. In the software part. MATLAB is used such as Image Acquisition Toolbox and Image Processing Toolbox. This toolbox is used as a library to select the suitable algorithms inside the toolbox which can be applied to recognize the object from the input images. The other research . also make a assumption for the dynamic modeling and control system to the airship that have been developed. The type of the airship dynamic modeling is given by this Eq. M v A Fd . A A. A G A P Where: M A Inertia matrix v = vector of linear and angular velocity Fd = vector of centrifugal forces A = vector of aerodynamical forces G = vector of gravitional forces They are many type that the graphical user interface that Graphical user interface is a type of user interface item that allows people to interact with programs in more ways than typing such as computers. For the examples, they used External Authoring Interface (EAI) . EAI is an interface that allow program written in Java and JavaScript to control the contents of a VRML world. The control available includes the object creation and removing, operation as rotation, translation, user point of view changing and also properties changing. This interface is difficult to apply because we need to understand the VRML world. There are also used the human-machine interface (HMI) to provides the communication and visualization mechanism Fig. 2 History of Airship Development . Rigid Airships . Semi-rigid Airships . Non-rigid Airships i. METHODOLOGY Image Processing Figure 3 shows the project implementation flow chart. The general step in project methodology, literature study is the first step that must be used and done to collect the data about the monitoring system. Then the programming software is identifying to developed algorithm and design the Graphical User Interface (GUI) to solve the monitoring Edge detector Edge detection that are commonly used to trace a certain object that have a partial part and the detector that use have a several function to its requirement . The basic edgedetection operator is a matrix area gradient operation that determines the level of variance between different pixels. The edge-detection operator is calculated by forming a matrix centered on a pixel is classified as an edge. Canny Operator Canny edge detection algorithm is known to many as the optimal edge detector . The Canny edge detector is a first smoothes the image to eliminate and noise. The operator finds the image gradient to highlight regions with high spatial derivatives. Then it detect the regions and suppresses any pixel that is not at the maximum . on maximum The gradient array is now further reduced by Hysteresis is used to track along the remaining pixels that have been suppressed. There are two threshold can be applied with three threshold condition. the magnitude is below that the first threshold, it is set to zero . ade a non edg. , . the magnitude is above the threshold, it is made an edge and . the magnitude is between the two thresholds, then it set to zero unless there is a path from this pixel to a pixel with a gradient above T2. Canny detector works in a multi-stage process. The first stage will start with the image itself, the image is smoothed by Gaussian convolution. Then a simple 2-D first derivatives operator is applied to the smoothed image to highlight regions of the image with high spatial derivatives. Edges give rise to ridges in the gradient magnitude image . Fig. 3 Flow of the Project Methodology Develop detection and tracking algorithm The first step in the detection and tracking algorithm is to recognize image objects captured by the camera. Then, determine the object from the image that has been captured by wireless camera. After detect the object, the centroid of this object is determined. This centroid is then compared with the center of the image to get the coordinate at x-axis and y-axis. Figure 4 shows the flowchart for the detection and tracking algorithm. Thresholding A simple and reliable method for image segmentation, thresholding is used to convert grayscale images to binary images by setting pixels with intensities values below or above the threshold value to black or white respectively . Figure 5 shows a visual example of thresholding. Fig. 5 Example of thresholding The threshold value can be determined by analyzing the imageAos histogram. A histogram is a graphical representation of the intensity distribution in a digital image. The normal way of obtaining the threshold value is to use the peak and valley method, where the two highest peaks are found and taking the intensity value of the deepest valley between the two peeks. Figure 6 shows an example of using this method on an image to get a segmented image. Fig. 4 Detection and tracking algorithm flowchart known as the pressure airship. The pressure of the lifting gas within maintains the hull profile. Shape of gas envelope The shape of the envelope has a major influence on its overall performance. Envelope weight is proportional to surface area and lift is proportional to the volume. In an ideal case, the surface area should be as small as possible relative to the volume. Air resistance is also determined primarily by the surface area. A spherical shape provides optimum lift Any deviation from this optimum should utilized shapes based on circular arc sections to minimize surface Shape of Gondola The shape must be of a streamline body as such drag is It must not have sharp corners or rough surface. This is to reduce both flow separation . esults in wake or turbulence formed, increasing the drag forc. and skin friction drag. It must be able to house all the components. meet the criteria. Figure 8 shows the shape of gondola where model A will be selected as the gondola for the airship. Fig. 6 Example of thresholding Integrated with PC ports MATLAB provides support to access parallel port . lso called as printer port or LPT por. and serial port . lso called COM por. of a PC . For this project, it used parallel port to connected PC and hardware. The parallel port is the most commonly used port for interfacing homemade This port will allow the input of up to 9 bits or the output of 12 bits at any one given time, thus requiring minimal external circuitry to implement many simpler tasks. The port is composed of 4 control lines, 5 status lines and 8 data lines. It's found commonly on the back of the PC as a D-Type 25 Pin female connector. Figure 7 shows the basic diagram of the parallel port. Fig. 8 Shape of Gondola Propulsion System and Surveillance System Propulsion System To fulfil the operation criteria, this design will require a minimum of three motors fixed with propellers. To allow reverse thrusting, 6-9 propellers are fixed to the rotating shaft of the motors. The line of thrust must be variable to produce the pitching motion. Surveillance System Wireless video camera with a built-in transmitter is to be installed into the system. The direct line of sight must be It is to have a visual capability of 300m Fig. 7 Basic diagram of the parallel port Main Components of the Airship The main components of the airship can be divided into 6 components which are gasbag (Envelop. , gondola (Console casin. , propulsion system, surveillance system, power source and empennage (Tail fins stabilizer. Empennage (Tail fins stabilizer. The bare hull of streamline form is directionally unstable, tending always to turn broadside on to the direction of motion. Tail fins are required to ensure the stability of the They also act as flow straighteners, arranged in a cross configuration. Control surfaces . levators, rudder. will not be installed on the tail fins, as they are not required to generate a pitching moment. Moving at a slow speed will also render the control surfaces ineffective. Figure 9 shows the position of gondola and motors. Structural category and shape of the gas envelope Structural Category Considering all factors, the non-rigid structure is chosen for the gas envelope. With this non-rigid structure, it is Fig. 9 Gondola and motors position Fig. 12 Test for other object IV. RESULT Thresholding for segmentation There are same images shown with two threshold value for this object. Figure 13 and 14 shows the different image but same object using two value of threshold. To get the best results, the threshold value was set manually. To quantify the prototype as a UAV surveillance airship, the resolution of the image transmitted back to ground operator need to be determined. With the resolution known, the user can foresee the smallest object that can be detected at a specific range. If the dimension of the object to be survey is known, the flight altitude of the airship can be controlled such that the object remains detectable at the operating flight altitude. The experimental setup for tabulating resolution is show in Figure 10. Range Developed Graphical User Interface (GUI) After segmenting out the object, the centroid of the object is determined. This centroid is used to determined whether the object is located based on the appeared x-axis and y-axis . Next, a graphical user interface was developed to support the live feed from the camera for real time processing and tracking. Figure 15 shows the GUI that Flight Altitu Targ Horizontal Distance Fig. 10 Experimental setup for tabulating resolution Object Detection To test the detection algorithm, two different objects with different threshold are used. The images contain different object likes triangular and other shape by using 1. The result for triangular and other object is shows in Figure 11 and 12. Fig. 13 Segmentation of image using threshold 0. Fig. 14 Segmentation of image using threshold 1 Fig. 11 Test for triangular object Fig. 15 GUI for real time processing and tracking DISCUSSION From the results obtain a segmentation consisting of Canny edge detection. The advantages of Canny edge detector is it using the probability for finding error rate, improving signal to noise ratio. The canny operators also make better detection especially in noise condition. Thresholding is the simplest method of image segmentation. From a grayscale image, thresholding can be used to create binary images. During the thresholding process, individual pixels in an image are marked as AuobjectAy pixels if their value is greater than some threshold value . ssuming an object to be brighter than the backgroun. and as AubackgroundAy pixels otherwise. This convention is known as threshold above. Typically, an object pixel is given a value of Au1Ay while a background pixel is given a value of Au0. Ay Finally, a binary image is created in each pixel white or black, depending on a pixel's label. VI. CONCLUSIONS As conclusion, the main goal of this project is to design and developed an autonomous UAV airship for indoor surveillance and monitoring applications. The system can recognized the object and display the object centroid in 2D coordinated at Graphical User Interface (GUI). The result show the system able to detect and determine the centroid object in x-y coordinated. ACKNOWLEDGMENT The authors are grateful for the support by Universiti Teknikal Malaysia Melaka (UTeM) in conducting this . REFERENCES