IOS and OSC

From TouchDesigner Documentation
Jump to: navigation, search

The Apple iPad, iPhone and iPod Touch can be used as an input devices to TouchDesigner.

Several iOS apps allow you to build control panels of sliders and buttons on the iPhone, or have available pre-existing control panels. When the panels are operated on the iPhone, it sends the slider/button data over wireless TCP/IP using the OSC protocol. It is received by the OSC In CHOP and the OSC In DAT.

This page is a compilation of knowledge accumulated about various applications. For many purposes, these iOS apps replace the function of MIDI input devices, if you don't mind the absence of physical tactile feedback.

Aside from the applications listed below that generally let you set up and use custom control panels of sliders and buttons on the iPhone, numerous others apps simply output application-specific data (such as game states) via OSC.

In the Apple App Store, search for "OSC" and "Open Sound Control".

See also Multi-Touch.

Common Setup[edit]

Setting it up with TouchDesigner is super-easy.

Each iOS app involves setting the wireless IP address of your TouchDesigner computer, and a port number (any number you choose).

First, get your wireless IP number in Windows Control Panel -> Network and Sharing Center -> Wireless Network Connection -> Details...

Enter that in the iOS app's settings.

Then on the TouchDesigner side, simply lay down an OSC In CHOP, change the Network Port parameter to the port number you chose above, and start using the iOS app control panels. Channels in the CHOP will be created as you press new controls.

You can also (at the same time) lay down an OSC In DAT to see the raw messages come in via a first-in first-out table.

iOS Apps[edit]

TouchOSC[edit]

http://hexler.net/touchosc

TouchOSC lets you define 1D and 2D sliders and toggle/momentary buttons in a text file. It also sends 3 accelerometer channels.

Aside from pre-made control panels, you can download a Windows or OSX editor to make custom panels.

Mrmr[edit]

http://mrmr.noisepages.com/

Mrmr (free) lets you define 1D and 2D sliders and toggle/momentary buttons in a text file. It also sends 3 accelerometer channels.

Mrmr is an ongoing open-source research project to develop a standardized set of protocols and syntax conventions to control live installations and multimedia performances via mobile devices.

  • create your own interface using only a text editor
  • multiuser by design / client peer-to-peer or client-server models supported

OSCemote[edit]

http://lux.vu/iphone/oscemote

A little difficult to decipher the messages. No layout editor.

Others Untested[edit]

A custom interactive control panel built within TouchDesigner. Panels are created using Panel Components whose look is created entirely with TOPs.

An Operator Family which operate on Channels (a series of numbers) which are used for animation, audio, mathematics, simulation, logic, UI construction, and many other applications.