This article contains information about the Kinect Version 1 device, for the newer Version 2 model see Kinect 2 article.
Microsoft Kinect1 can be used as an input device in TouchDesigner on Windows OS using the Kinect TOP and the Kinect CHOP.
Kinect is a motion sensor input device from Microsoft. The device includes an infrared depth sensing camera, a RGB color camera, and a microphone array for audio capture. The Microsoft Kinect SDK enables features such as skeleton tracking, hand interactions, and voice recognition.
The Kinect was originally released for Microsoft's Xbox360 gaming console in 2010. On Feb 1 2012, Microsoft released Kinect for Windows which included a Kinect SDK which works exclusively with new Kinect hardware for Windows operating systems.
Kinect Support in TouchDesigner
TouchDesigner has built-in support for Kinect using Microsoft's official Kinect for Windows SDK. As such, only Kinect for Windows hardware is supported by TouchDesigner's built-in Kinect operators. (See Tips below for information on Xbox 360 Kinect sensors)
- Kinect for Windows hardware device model 1517 (no 'official support' for Kinect for Xbox360 devices models 1414 and 1473, see below)
- Install the Kinect Runtime 1.8 or Kinect for Windows SDK 1.8
Ways to interface with Kinect in TouchDesigner
- Depth camera - Kinect TOP
- RGB camera - Kinect TOP
- Infrared camera - Kinect TOP
- Skeleton Point Tracking - Kinect CHOP NOTE: For joint orientation and bone hierarchy, see: Kinect Hierarchy
- Hand Interaction - Kinect CHOP
- Microphone Array Audio Capture - Audio Device In CHOP
- To control the tilt of the camera, use the Tscript
Tips for Working with Kinect Sensors
- Always connect the AC power supply that comes with the Kinect sensor. The green LED will light up under USB power, however the sensor will not function correctly unless the AC power supply is also connected.
- Kinect V1 can be less stable on USB3.0 ports, try USB2.0 ports if you are experiencing problems connecting tot he device or the connection drops out after some time.
- If using multiple Kinects, each Kinect sensor must be connected to its own USB controller. On some computers multiple USB ports will be on the same USB controller, this will cause problems if two Kinects are sharing that same controller. Refer to your computer's Device Manager to inspect which ports belong to each USB controller.
- If you require USB extenders, we have successfully used these extenders with Kinect sensors and other USB cameras. 25M USB Active Extenders Note that these extenders do not work if you connect two together.
- Xbox360 (models 1414 and 1473), although not officially supported, usually work by installing the Kinect for Windows SDK 1.8. The Kinect Runtime 1.8 will NOT work with the Xbox360 models and they will not be detected, the full SDK must be installed.
- For additional support and troubleshooting refer to the Kinect Support Community.
Kinect Example Files
File:Kinect.tox - This file uses the depth camera, color camera, and skeletal tracking features of Kinect.
An Operator Family that creates, composites and modifies images, and reads/writes images and movies to/from files and the network. TOPs run on the graphics card's GPU.
Each SOP has a list of Points. Each point has an XYZ 3D position value plus other optional attributes. Each polygon Primitive is defined by a vertex list, which is list of point numbers.