Audio Stream In CHOP

Summary

The Audio Stream In CHOP can stream audio into TouchDesigner from any rtsp server, or from a WebRTC peer. See Video Stream In TOP.

audiostreaminCHOP_Class

Parameters - Audio Stream In Page

Source Type srctype - ⊞ - Select the source type: either from a server URL, or a WebRTC peer.

• Server server - Server source type for RTSP.

• WebRTC webrtc - WebRTC peer source.

Server URL url - The URL address of the stream. E.g rtsp://localhost:554/tdaudio

Video Stream In TOP videostreamintop - Point to a Video Stream In TOP whose stream has audio embedded to extract the audio channels.

Play play - Turns the audio streaming on (1) or off (0).

Open Timeout opentimeout - The time (in milliseconds) TouchDesigner will wait attempting to open the audio stream.

Audio Sync Offset syncoffset - Offsets the audio playback of the movie. This can be used to get better sync between the audio and images in the stream when there is audio latency in the system (For example, audio latency from the Audio Device Out CHOP queue). A negative value plays audio that amount of time sooner, to counteract delay introduced by buffering such as in Audio Device Out CHOP.

Audio Sync Offset Unit syncoffsetunit - ⊞ - Specify which units to use for the Audio Sync Offset parameter.

• I samples -

• F frames -

• S seconds -

Volume volume - 0 = mute, 1 = full volume.

Parameters - WebRTC Page

WebRTC DAT webrtc - Set the WebRTC DAT (ie. peer) to get the audio stream from. Setting this will automatically populate the WebRTC Connection parameter menu with available connections.

WebRTC Connection webrtcconnection - Select the WebRTC peer-to-peer connection. Selecting this will automatically population the WebRTC Track parameter menu with available audio input tracks.

WebRTC Track webrtctrack - Select the audio input track that's a part of the WebRTC peer-to-peer connection.

Parameters - Common Page

Time Slice timeslice - Turning this on forces the channels to be "Time Sliced". A Time Slice is the time between the last cook frame and the current cook frame.

Scope scope - To determine which channels get affected, some CHOPs use a Scope string on the Common page.

Sample Rate Match srselect - ⊞ - Handle cases where multiple input CHOPs' sample rates are different. When Resampling occurs, the curves are interpolated according to the Interpolation Method Option, or "Linear" if the Interpolate Options are not available.

• Resample At First Input's Rate first - Use rate of first input to resample others.

• Resample At Maximum Rate max - Resample to the highest sample rate.

• Resample At Minimum Rate min - Resample to the lowest sample rate.

• Error If Rates Differ err - Doesn't accept conflicting sample rates.

Export Method exportmethod - ⊞ - This will determine how to connect the CHOP channel to the parameter. Refer to the Export article for more information.

• DAT Table by Index datindex - Uses the docked DAT table and references the channel via the index of the channel in the CHOP.

• DAT Table by Name datname - Uses the docked DAT table and references the channel via the name of the channel in the CHOP.

• Channel Name is Path:Parameter autoname - The channel is the full destination of where to export to, such has geo1/transform1:tx.

Export Root autoexportroot - This path points to the root node where all of the paths that exporting by Channel Name is Path:Parameter are relative to.

Export Table exporttable - The DAT used to hold the export information when using the DAT Table Export Methods (See above).

Info CHOP Channels

Extra Information for the Audio Stream In CHOP can be accessed via an Info CHOP.

Specific Audio Stream In CHOP Info Channels

• sample -

• true_sample -

• seconds -

• fraction -

• file_length -

• true_file_length -

• open -

• opening -

• open_failed -

Common CHOP Info Channels

• start - Start of the CHOP interval in samples.

• length - Number of samples in the CHOP.

• sample_rate - The samplerate of the channels in frames per second.

• num_channels - Number of channels in the CHOP.

• time_slice - 1 if CHOP is Time Slice enabled, 0 otherwise.

• export_sernum - A count of how often the export connections have been updated.

Common Operator Info Channels

• total_cooks - Number of times the operator has cooked since the process started.

• cook_time - Duration of the last cook in milliseconds.

• cook_frame - Frame number when this operator was last cooked relative to the component timeline.

• cook_abs_frame - Frame number when this operator was last cooked relative to the absolute time.

• cook_start_time - Time in milliseconds at which the operator started cooking in the frame it was cooked.

• cook_end_time - Time in milliseconds at which the operator finished cooking in the frame it was cooked.

• cooked_this_frame - 1 if operator was cooked this frame.

• warnings - Number of warnings in this operator if any.

• errors - Number of errors in this operator if any.

TouchDesigner Build: Latest\n2022.241402021.100002018.28070before 2018.28070

An Operator Family which operate on Channels (a sequence of numbers (Samples)) which are used for animation, audio, mathematics, simulation, logic, UI construction, and data streamed from/to devices and protocols.

An Operator Family that creates, composites and modifies images, and reads/writes images and movies to/from files and the network. TOPs run on the graphics card's GPU.

Each SOP has a list of Points. Each point has an XYZ 3D position value plus other optional attributes. Each polygon Primitive is defined by a vertex list, which is list of point numbers.

An Operator Family that manipulates text strings: multi-line text or tables. Multi-line text is often a python Script or GLSL Shader, but can be any multi-line text. Tables are rows and columns of cells, each containing a text string.

A Time Slice is the time from the last cook frame to the current cook frame. In CHOPs it is the set of short channels that contain the CHOP channels' samples between the last and the current cook frame.

A parameter in most CHOPs that restricts which channels of that CHOP will be affected. Normally all channels of a CHOP are affected by the operator. TOPs have Channel Mask, a similar feature.

samples-per-second of a CHOP. Each CHOP in your network has a sample rate. In contrast, the overall timeline has a Frame Rate, which is the number of frames to cook and display per second, generally your monitor display frequency, default 60.

Exporting is the connection of CHOP channels to parameters of operators. The output of each exporting CHOP is one or more channels, active only while the CHOP Viewer is on. The current value of a channel can be exported to a parameter of any operator, overriding that parameter's value. See Parameter.

The location of an operator within the TouchDesigner environment, for example, /geo1/circle1, a node called circle1 in a component called geo1. The path / is called Root. This path is displayed at the top of every Pane, showing which Component's network you are currently in. To refer instead to a filesystem folder, directory, disk file or http: address, see Folder.

Every operator in TouchDesigner has a set of Parameters that can be integer or floating point numbers, menus, binary toggles, strings, operator paths) which determine the output of the operator.

TouchDesigner is a hierarchy of components. "root" is the top-most network in the hierarchy. The Network Path or Path for root is simply /. A typical path is /project1/moviein1.