Kinect Azure CHOP

From Derivative
Jump to navigation Jump to search


The Kinect Azure CHOP can be used to obtain body tracking information, including joint positions and rotations, and IMU sensor data from a Microsoft Kinect Azure camera.

NOTE: This TOP requires Microsoft Windows 10 April 2018 or newer. An NVIDIA GEFORCE GTX 1070 or better graphics card is required to obtain body tracking data from the camera. Kinect Azure System Requirements

This CHOP requires a Kinect Azure TOP to connect to the camera and to configure the camera's settings. Not all configuration settings support body tracking e.g. Passive IR depth mode.

Use the Max Players parameter to determine how many players you would like the camera to track. The TOP will automatically assign any bodies that are discovered by the device to the available player spaces. Due to the system used to detect player skeletons from the depth camera image, body tracking data can lag multiple frames behind the image data. To more closely synchronize body and image data, use the 'Sync Body Tracking To Image' option on the primary Kinect Azure TOP that is controlling the device (synchronization will increase lag in the image capture).

For a diagram of the joints tracked and their hierarchy, visit Microsoft's Kinect Azure SDK.

Acceleration and rotation data from the camera's IMU sensor can be obtained by enabling the 'IMU Channels' parameter.

See also Kinect Azure TOP, Kinect Azure Select TOP.


Parameters - Kinect Azure Page

Active active - Enable to disable the capturing of body tracking data. The primary Kinect Azure TOP must also be active to receive data.

Kinect Azure TOP top - The name of the Kinect Azure TOP that is connected to the camera.

Max Players maxplayers - The number of player skeletons that should be tracked by the device. If the camera does not find enough skeletons, then the extra channels will be set to zero.

Relative Bone Rotations relbonerotations - Include rotation data for all bone in the skeleton. Rotation is measured in degrees around the XYZ axes relative to the bone's parent.

Absolute Bone Rotations absbonerotations - Include absolute rotation data for all bone in the skeleton. Rotation is measured in degrees around the XYZ axes relative to the world.

Bone Lengths bonelengths - Include channels for the length of each bone. A bone's length is the distance between a joint and its parent joint. See the Kinect Azure SDK for a diagram of the joint heirarchy.

World Space Positions worldspace - Include channels for the bone's absolute world position in meters.

Color Image Positions colorspace - Include channels for the skeleton positions in UV coordinates of the Color Image.

Depth Image Positions depthspace - Include channels for the skeleton positions in UV coordinates of the Depth Image.

Aspect Correct UVs aspectcorrectuv - Scale the image space positions to that they match the aspect ratio of the corresponding camera.

Mirror Image V Positions flipimagev - Flip the v coordinate of the image space positions so that 0,0 would be in the top-left corner. This was the default behaviour prior to version 2020.44130.

Mirror U Positions flipskelu - Mirror's the U coordintate of Color Image Positions and Depth Image Positions above which is useful when those images have been flipped in U (x axis flip like a mirror).

Bone Confidence confidence - The confidence that the sensor has that a joint's position and rotation is correct. It can be one of the following values:

  • 0 - The joint is out of range (too far from the camera)
  • 1 - The joint cannot be seen by the sensor and is predicted based on the neighbouring joints
  • 2 - Medium confidence. The sensor is reasonably confident of the joint's position/rotation. This is currently the highest level of confidence the sensor will produce.
  • 3 - High confidence. Reserved for future use.

IMU Channels imuchans - Include temperature, acceleration and rotation data from the camera's IMU sensor.

Color Image Positions colorspave - Include channels for the skeleton positions in UV coordinates of the Color Image.

Parameters - Common Page

Time Slice timeslice - Turning this on forces the channels to be "Time Sliced". A Time Slice is the time between the last cook frame and the current cook frame.

Scope scope - To determine which channels get affected, some CHOPs use a Scope string on the Common page.

Sample Rate Match srselect - - Handle cases where multiple input CHOPs' sample rates are different. When Resampling occurs, the curves are interpolated according to the Interpolation Method Option, or "Linear" if the Interpolate Options are not available.

  • Resample At First Input's Rate first - Use rate of first input to resample others.
  • Resample At Maximum Rate max - Resample to the highest sample rate.
  • Resample At Minimum Rate min - Resample to the lowest sample rate.
  • Error If Rates Differ err - Doesn't accept conflicting sample rates.

Export Method exportmethod - - This will determine how to connect the CHOP channel to the parameter. Refer to the Export article for more information.

  • DAT Table by Index datindex - Uses the docked DAT table and references the channel via the index of the channel in the CHOP.
  • DAT Table by Name datname - Uses the docked DAT table and references the channel via the name of the channel in the CHOP.
  • Channel Name is Path:Parameter autoname - The channel is the full destination of where to export to, such has geo1/transform1:tx.

Export Root autoexportroot - This path points to the root node where all of the paths that exporting by Channel Name is Path:Parameter are relative to.

Export Table exporttable - The DAT used to hold the export information when using the DAT Table Export Methods (See above).

TouchDesigner Build:

Ableton Link • Analyze • Angle • Attribute • Audio Band EQ • Audio Device In • Audio Device Out • Audio Dynamics • Audio File In • Audio File Out • Audio Filter • Audio Movie • Audio NDI • Audio Oscillator • Audio Para EQ • Audio Play • Audio Render • Audio Spectrum • Audio Stream In • Audio Stream Out • Beat • Bind • BlackTrax • Blend • Blob Track • Bullet Solver • Clip Blender • Clip • Clock • Composite • Constant • Copy • Count • CPlusPlus • Cross • Cycle • DAT to • Delay • Delete • DMX In • DMX Out • Envelope • EtherDream • Event • Expression • Extend • Face Track • Fan • Feedback • File In • File Out • Filter • FreeD • Experimental:FreeD Out • Function • Gesture • Handle • Helios DAC • Hog • Hokuyo • Hold • Import Select • In • Info • Interpolate • Introduction To s Vid • Inverse Curve • Inverse Kin • Join • Joystick • Keyboard In • Keyframe • Kinect Azure • Kinect • Lag • Laser • Leap Motion • Leuze ROD4 • LFO • Limit • Logic • Lookup • LTC In • LTC Out • Math • Merge • MIDI In • MIDI In Map • MIDI Out • Mouse In • Mouse Out • NatNet In • Ncam • Noise • Null • Object • Oculus Audio • Oculus Rift • OpenVR • OSC In • OSC Out • Out • Override • Panel • Pangolin • Parameter • Pattern • Perform • Phaser • Pipe In • Pipe Out • PosiStageNet • Pulse • RealSense • Record • Rename • Render Pick • Reorder • Replace • Resample • S Curve • Scan • Script • Select • Sequencer • Serial • Shared Mem In • Shared Mem Out • Shift • Shuffle • Slope • SOP to • Sort • Speed • Splice • Spring • Stretch • Stype • Experimental:Stype Out • Switch • Sync In • Sync Out • Tablet • Time Slice • Timeline • Timer • TOP to • Touch In • Touch Out • Trail • Transform • Transform XYZ • Trigger • Trim • Warp • Wave • WrnchAI • ZED