Kinect Azure CHOP

From TouchDesigner Documentation
Jump to: navigation, search


The Kinect Azure CHOP can be used to obtain body tracking information, including joint positions and rotations, and IMU sensor data from a Microsoft Kinect Azure camera.

NOTE: This TOP requries Microsoft Windows 10 April 2018 or newer. An NVIDIA GEFORCE GTX 1070 or better graphics card is required to obtain body tracking data from the camera. Kinect Azure System Requirements

This TOP requires a Kinect Azure TOP to connect to the camera and to configure the camera's settings. Not all configuration settings support body tracking e.g. Passive IR depth mode.

Use the Max Players parameter to determine how many players you would like the camera to track. The TOP will automatically assign any bodies that are discovered by the device to the available player spaces. Due to the system used to detect player skeletons from the depth camera image, body tracking data can lag multiple frames behind the image data. To more closely synchronize body and image data, use the 'Sync Body Tracking To Image' option on the primary Kinect Azure TOP that is controlling the device (synchronization will increase lag in the image capture).

For a diagram of the joints tracked and their heirarchy, visit Microsoft's Kinect Azure SDK.

Acceleration and rotation data from the camera's IMU sensor can be obtained by enabling the 'IMU Channels' parameter.


Parameters - Kinect Azure Page

Active active - Enable to disable the capturing of body tracking data. The primary Kinect Azure TOP must also be active to receive data.  

Kinect Azure TOP top - The name of the Kinect Azure TOP that is connected to the camera.  

Max Players maxplayers - The number of player skeletons that should be tracked by the device. If the camera does not find enough skeletons, then the extra channels will be set to zero.  

Relative Bone Rotations relbonerotations - Include rotation data for all bone in the skeleton. Rotation is measured in degrees around the XYZ axes relative to the bone's parent.  

Absolute Bone Rotations absbonerotations - Include absolute rotation data for all bone in the skeleton. Rotation is measured in degrees around the XYZ axes relative to the world.  

Bone Lengths bonelengths - Include channels for the length of each bone. A bone's length is the distance between a joint and its parent joint. See the Kinect Azure SDK for a diagram of the joint heirarchy.  

World Space Positions worldspace - Include channels for the bone's absolute world position in meters.  

Color Image Positions colorspave - Include channels for the skeleton positions in UV coordinates of the Color Image.  

Depth Image Positions depthspace - Include channels for the skeleton positions in UV coordinates of the Depth Image.  

Mirror U Positions flipskelu - Mirror's the U coordintate of Color Image Positions and Depth Image Positions above which is useful when those images have been flipped in U (x axis flip like a mirror).  

Bone Confidence confidence - The confidence that the sensor has that a joint's position and rotation is correct. It can be one of the following values:

  • 0 - The joint is out of range (too far from the camera)
  • 1 - The joint cannot be seen by the sensor and is predicted based on the neighbouring joints
  • 2 - Medium confidence. The sensor is reasonably confident of the joint's position/rotation. This is currently the highest level of confidence the sensor will produce.
  • 3 - High confidence. Reserved for future use.


IMU Channels imuchans - Include temperature, acceleration and rotation data from the camera's IMU sensor.  

Parameters - Common Page

Time Slice timeslice - Turning this on forces the channels to be "Time Sliced". A Time Slice is the time between the last cook frame and the current cook frame.  

Scope scope - To determine which channels get affected, some CHOPs use a Scope string on the Common page.  

Sample Rate Match srselect - - Handle cases where multiple input CHOPs' sample rates are different. When Resampling occurs, the curves are interpolated according to the Interpolation Method Option, or "Linear" if the Interpolate Options are not available.

  • Resample At First Input's Rate first - Use rate of first input to resample others.
  • Resample At Maximum Rate max - Resample to the highest sample rate.
  • Resample At Minimum Rate min - Resample to the lowest sample rate.
  • Error If Rates Differ err - Doesn't accept conflicting sample rates.

Export Method exportmethod - - This will determine how to connect the CHOP channel to the parameter. Refer to the Export article for more information.

  • DAT Table by Index datindex - Uses the docked DAT table and references the channel via the index of the channel in the CHOP.
  • DAT Table by Name datname - Uses the docked DAT table and references the channel via the name of the channel in the CHOP.
  • Channel Name is Path:Parameter autoname - The channel is the full destination of where to export to, such has geo1/transform1:tx.

Export Root autoexportroot - This path points to the root node where all of the paths that exporting by Channel Name is Path:Parameter are relative to.  

Export Table exporttable - The DAT used to hold the export information when using the DAT Table Export Methods (See above).  

TouchDesigner Build:

Ableton Link • Analyze • Angle • Attribute • Audio Band EQ • Audio Device In • Audio Device Out • Audio Dynamics • Audio File In • Audio File Out • Audio Filter • Audio Movie • Audio NDI • Audio Oscillator • Audio Para EQ • Audio Play • Audio Render • Audio Spectrum • Audio Stream In • Experimental:Audio Stream In • Audio Stream Out • Beat • Bind • BlackTrax • Blend • Blob Track • Bullet Solver • Clip Blender • Clip • Clock • Composite • Constant • Copy • Count • CPlusPlus • Cross • Cycle • DAT to • Delay • Delete • DMX In • Experimental:DMX In • DMX Out • Envelope • EtherDream • Event • Expression • Extend • Fan • Feedback • File In • File Out • Filter • Experimental:Filter • Experimental:FreeD • Function • Gesture • Handle • Helios DAC • Hog • Hokuyo • Hold • Import Select • In • Info • Interpolate • Introduction To CHOPs id • Inverse Curve • Inverse Kin • Join • Joystick • Keyboard In • Keyframe • Kinect Azure • Kinect • Lag • Laser • Leap Motion • Leuze ROD4 • LFO • Limit • Logic • Lookup • LTC In • LTC Out • Math • Experimental:Math • Merge • MIDI In • MIDI In Map • MIDI Out • Mouse In • Mouse Out • NatNet In • Noise • Null • Object • Oculus Audio • Oculus Rift • OpenVR • OSC In • OSC Out • Out • Override • Panel • Pangolin • Parameter • Pattern • Perform • Experimental:Phaser • Pipe In • Pipe Out • PosiStageNet • Pulse • RealSense • Record • Rename • Render Pick • Reorder • Replace • Resample • S Curve • Scan • Script • Select • Sequencer • Serial • Shared Mem In • Shared Mem Out • Shift • Shuffle • Slope • SOP to • Sort • Speed • Splice • Spring • Stretch • Stype • Switch • Sync In • Sync Out • Tablet • Time Slice • Timeline • Timer • TOP to • Touch In • Touch Out • Trail • Transform • Transform XYZ • Trigger • Trim • Warp • Wave • Experimental:WrnchAI • ZED

An Operator Family which operate on Channels (a series of numbers) which are used for animation, audio, mathematics, simulation, logic, UI construction, and many other applications.

An Operator Family that creates, composites and modifies images, and reads/writes images and movies to/from files and the network. TOPs run on the graphics card's GPU.

A Time Slice is the time from the last cook frame to the current cook frame. In CHOPs it is the set of short channels that only contain the CHOP channels' samples between the last and the current cook frame.

A parameter in most CHOPs that restricts which channels of that CHOP will be affected. Normally all channels of a CHOP are affected by the operator.

samples-per-second of a CHOP. Each CHOP in your network has a sample rate, whether it is used or not. The overall timeline has a "frame rate", which is the number of animation frames per second, generally your monitor display frequency.

Exporting is the connection of CHOP channels to parameters of operators. The output of each exporting CHOP is one or more channels, active only while the CHOP Viewer is on. The current value of a channel can be exported to a parameter of any operator, overriding that parameter's value. See Parameter.

An Operator Family that manipulates text strings: multi-line text or tables. Multi-line text is often a command Script, but can be any multi-line text. Tables are rows and columns of cells, each containing a text string.

The location of an operator within the TouchDesigner environment, for example, /geo1/torus1, a node called torus1 in a component called geo1. The path / is called Root. To refer instead to a filesystem folder, directory, disk file or http: address, see Folder.

Parameters in TouchDesigner are an operator's settings (numbers, menus, flags, strings, paths) which the user can alter. Parameters for any operator can be opened by right-clicking on the operator and selecting "Parameters..." A currently selected operator's parameters can be viewed in a Network Editor by pressing the keyboard shortcut 'p'.

TouchDesigner is a hierarchy of components. "root" is the top-most network in the hierarchy. The Path is simply /. A typical path is /project1/moviein1.