|
| 1 | +<!-- |
| 2 | +*** Thanks for checking out this README Template. If you have a suggestion that would |
| 3 | +*** make this better, please fork the repo and create a pull request or simply open |
| 4 | +*** an issue with the tag "enhancement". |
| 5 | +*** Thanks again! Now go create something AMAZING! :D |
| 6 | +--> |
| 7 | + |
| 8 | + |
| 9 | + |
| 10 | + |
1 | 11 | # Using deep neural networks to recognize hand gestures to control a mobile robot using a camera.
|
2 |
| -Desktop aplication written in python 3 using Deep neural networks will calculate commands such as ride forward, turn right and send via wifi to mobile robot. Alro will execute command. </br> |
3 |
| -Arlo: https://www.parallax.com/product/arlo-robotic-platform-system |
4 |
| -Presentation: https://www.youtube.com/watch?v=j6qOpACT1z0 |
5 |
| -[](https://www.youtube.com/watch?v=j6qOpACT1z0 "Presentation") |
| 12 | +The purpose of this project was to build a system that allows user to control the Arlo mobile robot using static hand gestures, with use of camera. The project consists of three parts, the first was to develop script that supposed to recognize the gestures controlling the robot. For this purpose author used convolutional neural network, which had to be properly trained. The next step was to create a robot program that had to properly react to application commands. The last step was to handle communication between programs, Bluetooth 4.0 Low Energy standard was used for this purpose. Unfortunately, during the final control test Bluetooth module has been damaged, in this case the author decided to use simple serial communication instead. The main assumptions of the project were to achieve real-time processing system and achieve high accuracy of hand gesture recognition. </br> |
| 13 | +Arlo: https://www.parallax.com/product/arlo-robotic-platform-system </br> |
| 14 | +Presentation: https://www.youtube.com/watch?v=j6qOpACT1z0 </br> |
| 15 | + |
| 16 | +[](https://www.youtube.com/watch?v=j6qOpACT1z0 "Presentation") |
| 17 | + |
| 18 | +### Built With |
| 19 | +This section should list any major frameworks that you built your project using. Leave any add-ons/plugins for the acknowledgements section. Here are a few examples. |
| 20 | +* [Pytorch](https://pytorch.org/) |
| 21 | +* [PyQt](https://python101.readthedocs.io/pl/latest/pyqt/) |
| 22 | +* [Parallax](https://www.parallax.com/product/28966) |
| 23 | +* [Bleak](https://github.com/hbldh/bleak) |
| 24 | +* [PySerial](https://github.com/pyserial/pyserial) |
| 25 | +* [OpenCv](https://pypi.org/project/opencv-python/) |
| 26 | + |
| 27 | +### Installation |
| 28 | + |
| 29 | +1. Clone the repo |
| 30 | +2. Install python 3 |
| 31 | +3. Install python dependencies, such as: Pytorch, Bleak, PyQt |
| 32 | +4. Run script "mainAplication.py" |
| 33 | + |
| 34 | + |
| 35 | + |
| 36 | +<!-- USAGE EXAMPLES --> |
| 37 | +## Usage |
| 38 | + |
| 39 | + |
| 40 | + |
| 41 | +<!-- LICENSE --> |
| 42 | +## License |
| 43 | + |
| 44 | +Distributed under the MIT License. See `LICENSE` for more information. |
| 45 | + |
| 46 | + |
| 47 | + |
| 48 | +## Author |
| 49 | + |
| 50 | +Sylwester Dawida Poland AGH |
| 51 | +2020 |
| 52 | + |
| 53 | + |
| 54 | + |
0 commit comments