Kinect Emulating Bluetooth Gamepad Controlling Fire TV Stick

This was a quick experiment I did with using a Kinect as a game controller for other systems. In this setup I wrote a Windows app that detects hand gestures via the Kinect and then sends them to an ESP32 which runs code emulating a Bluetooth gamepad. In the videos below I play 3 different games running on a Fire TV Stick with hand gestures recognized by the system I setup. This was just a proof of concept and other gestures including with other body parts could work just as well the same way.

playing Red Ball 4 w/ Kinect emulating a Bluetooth gamepad
playing Hill Climb Racing w/ Kinect emulating a Bluetooth gamepad
playing Brick Break Blitz w/ Kinect emulating a Bluetooth gamepad

I’ve uploaded the code for both the Windows app and the ESP32 firmware here: https://github.com/bobparadiso/KinectBLEController

Some directions this could be pushed further include assistive technology and video games as physical exercise.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s