Skip to content

Mobile robot control system, using gestures. System contains deep neural network to classify gesture captured by camera, comunication module (bluetooth 4.0 low energy) and Arlo - mobile robot (programable in C language)

License

Notifications You must be signed in to change notification settings

7bitcoder/Engineering-Thesis

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

65 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Using deep neural networks to recognize hand gestures to control a mobile robot using a camera.

The purpose of this project was to build a system that allows user to control the Arlo mobile robot using static hand gestures, with use of camera. The project consists of three parts, the first was to develop script that supposed to recognize the gestures controlling the robot. For this purpose author used convolutional neural network, which had to be properly trained. The next step was to create a robot program that had to properly react to application commands. The last step was to handle communication between programs, Bluetooth 4.0 Low Energy standard was used for this purpose. Unfortunately, during the final control test Bluetooth module has been damaged, in this case the author decided to use simple serial communication instead. The main assumptions of the project were to achieve real-time processing system and achieve high accuracy of hand gesture recognition.
Arlo: https://www.parallax.com/product/arlo-robotic-platform-system
Presentation: https://www.youtube.com/watch?v=j6qOpACT1z0

ytlink

Built With

This section should list any major frameworks that you built your project using. Leave any add-ons/plugins for the acknowledgements section. Here are a few examples.

Installation

  1. Clone the repo
  2. Install python 3
  3. Install python dependencies, such as: Pytorch, Bleak, PyQt
  4. Run script "mainAplication.py"

Usage

Gui interface:
gui gesty gesty

License

Distributed under the MIT License. See LICENSE for more information.

Author

Sylwester Dawida Poland AGH 2020

About

Mobile robot control system, using gestures. System contains deep neural network to classify gesture captured by camera, comunication module (bluetooth 4.0 low energy) and Arlo - mobile robot (programable in C language)

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published