This was a quick experiment I did with using a Kinect as a game controller for other systems. In this setup I wrote a Windows app that detects hand gestures via the Kinect and then sends them to an ESP32 which runs code emulating a Bluetooth gamepad. In the videos below I play 3 different games running on a Fire TV Stick with hand gestures recognized by the system I setup. This was just a proof of concept and other gestures including with other body parts could work just as well the same way.

I’ve uploaded the code for both the Windows app and the ESP32 firmware here: https://github.com/bobparadiso/KinectBLEController

Some directions this could be pushed further include assistive technology and video games as physical exercise.