The purpose of this project is to gain experience through creating a project and being part of the research and development from its initiation until its end. This will allow us to gain real world experience while still in a classroom environment. The popularity of computer vision projects has grown recently, thanks to the availability and advancements in the technology of embedded systems and computer vision based algorithms. For our senior design project, we wanted to implement computer vision as well as automation. One application that will allow us to implement both of these features would be to design a robotic vehicle with a mission of tracking and pursuit. In addition, we wanted to make use of thermal imaging. Thermal cameras have usually been restricted for military and law enforcement use, but recently it has become easier for regular consumers to obtain. Although there are some restrictions as to what models a regular consumer can purchase, this has still allowed a large group of hobbyist to add thermal imaging to their projects.
The robotic vehicle will be equipped with multiple subsystems including cameras, control and mobility, and wireless communications. For the camera subsystem we will be utilizing a regular webcam as well as a thermal camera. The thermal camera will be primarily used in for tracking our targets, while the regular webcam will be primarily for relaying images to the user. For the control and mobility subsystem we would like for the robot to be autonomous. We will utilize OpenCV algorithms which will allow the robot to detect our targets. Once movement has been detected, OpenCV algorithms will be utilized to track a specific target and maneuver the vehicle across the room while avoiding any obstacles in the way. In addition to the vehicle being autonomous, we would like to allow the user to control the robot via a mobile application. The wireless communication subsystem will make it possible to stream a live video feed of what the robot is seeing via the mobile application. In addition, a text message and a snapshot will be sent as a notification for when any movement is detected.
All the mentioned subsystems will be combined to make a robotic “Watchdog” that can be used for home security purposes. We expect this experience will be both challenging and rewarding for each member of the group. This project will broaden our knowledge and skills by allowing us to work as a team consisting of members from two different disciplines of engineering to design, build, and test a unique piece of technology.
Project Description
The following sections will detail the motivation behind the project, as well as the goals and specification that we would like the project to attain.
2.1 Motivation
As a team we decided that we each wanted to put our individual skills to practice, while simultaneously learning new skills to put into practice as well. Since our team consists of half Computer Engineers and half Electrical Engineers, we wanted to use our senior design project as a chance to combine all of our experience and knowledge in these two related fields while pursuing new topics of interest for each team member. From the Computer Engineering side, algorithms are always a subject of interest and one where there is never enough practice. In addition, mobile applications are currently quite popular along with web services. From the Electrical Engineering side, implementation of hardware is a very important part of this project. The ability to design, implement, and integrate hardware are needed to become a successful Electrical Engineer.
In order to accommodate all the skills mentioned, we decided to use a robotic vehicle as the base of our project. By using a robotic vehicle as the base of our project, we are able to simply add separate subsystems to enhance its functionality, which will help us apply and gain the new skills desired. By combining all of our ideas, desired interests as a team, cost, and difficulty, we decided to make an autonomous vehicle that will track and follow a person based on their heat signature. In order for the software side of the team to gain experience with algorithms, we decided to use the OpenCV library. The OpenCV library is packed with many features, which makes it able to give any project endless possibilities. Another advantage is that it is free for both educational and commercial usage. In order to gain experience with mobile platforms, along with network communications, we decided to implement a mobile application for Android devices where the user will have the ability to control the vehicle and stream a video feed through the internet. As for the Electrical Engineering side, the hardware requirements of the vehicle (motor controllers, power systems, and sensors) will allow the Electrical Engineers a chance to apply skills that they have learned in theory, and gain general experience in fabrication.
Each year UCF students come up with many great ideas, most of which turn into great projects. As a team we wanted to do something different, something that will make our project stand out from all the other ones. Because of this, we decided to use a commercial grade thermal camera for our tracking sub system. These types of cameras are not new technology but are a technology that has not been used often in previous projects.
2.2 Objective and Goals
The goal for this project is to create an autonomous robotic vehicle that is able to alert a user when someone has gained access into their home. In addition, we would like for the user to be able to see what is actually occurring when an alert is received, as well as have the ability to control the vehicle. The project consists of the following objectives: Object Detection, Object Tracking, Object Avoidance, Autonomous Control, Remote Control, and Wireless Communication.
For the Object Detection, we would like for the vehicle to be stationary while scanning a specific area or room, with possible entrance points, for any movement or changes in the view. Once a movement is detected, the robot is to be taken out of its idle state and be ready to perform. Once the robot has been set to a “ready” state, the robot needs to follow the object that triggered the change of status. While the tracking is occurring, it must also avoid any objects that are on the way by utilizing proximity sensors that are equipped on the perimeter of the vehicle. If an object is blocking the robot’s path, the robot has to be able to find a different path to continue.
Another objective is for the robot to be autonomous, meaning it will not need any user interaction to be able to perform the tasks that it has been assigned to complete. Additionally, we would like to add an option where the user can take control of the vehicle by using a mobile app. If the user decides to use the mobile application, any commands from the user are to take priority and the robot is to follow the user’s commands.
The last objective is to have integrated wireless communications. By having wireless communications, we would be able to stream a live video feed of what the vehicle is seeing to the user via the mobile application. In addition, we would like for the user to be able to save snapshots from the vehicles camera, allowing the user to keep a copy on their device.
Share with your friends: |