Gesture Based Input Device

It works as a wirelesss mouse based on Image Processing using MATLAB and Arduino UNo.
160 Downloads
Updated 27 May 2016

View License

'Gesture Based Input Device' is a glove-like structure. It acts as a wireless mouse with left and right clicks integrated on it along with 'Hotkeys' which acts as shortcut keys for launching any frequently used application like Notepad, E-mail, WMP, etc. It can also be used for switching between opened windows. It connects with the computer with the help of Bluetooth.
It works with the integration of MATLAB and Arduino Uno. Matlab helps us in Image Processing and Arduino helps us in giving commands to computer.
Steps to follow:-
1. Make connections in Arduino Uno with the PushButton Array
2. Upload the program 'Serialfinal.ino' to Arduino and open Serial Monitor.
3. Check for serial communication by pressing the connected push buttons.
*By pressing respective buttons, "A", "AA", "AAA", "AAAA" should be seen on serial monitor.
4. Open matlab code and Run.
5. Camera should work properly and pointer should move by tracking red object in front of it.
6.Try pressing buttons. They should perform task assign to them.
* You can change the code acc. to your need.
* Now, attaching Bluetooth.
7. First of all, goto "http://www.instructables.com/id/AT-command-mode-of-HC-05-Bluetooth-module/" and change BaudRate for your Bluetooth HC-05.
8. Connect Bluetooth to Arduino.(Except Rx and TX).
9. Upload the "Serialfinal.ino" to arduino board again.
10. Remove USB cable from computer, connect Rx and Tx of Bluetooth and pair it with your PC.
11. Change port in Arduino IDE, Open serial monitor just to check connectivity with bluetooth.
12. Open MATLAB and run the code.
I hope device works properly. Any queries will be answered ASAP.

Cite As

Rishabh Garg (2024). Gesture Based Input Device (https://www.mathworks.com/matlabcentral/fileexchange/57378-gesture-based-input-device), MATLAB Central File Exchange. Retrieved .

MATLAB Release Compatibility
Created with R2014a
Compatible with any release
Platform Compatibility
Windows macOS Linux
Acknowledgements

Inspired by: MATLAB And Arduino Interfacing

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!
Version Published Release Notes
1.0.0.0