Experimental:Lens Distort TOP

Summary

The Lens Distort TOP applies or removes lens distortion from an image using the Brown-Conrady model. This can be used to rectify images taken from a physical camera, to apply distortion to a rendering for use in augmented reality (AR), or as a visual effect.

The distortion algorithm used by the Lens Distort TOP can be broken down into three components: radial distortion, tangential distortion and the camera matrix.

Radial distortion shifts pixels in the output relative to their distance from the center of the image (defined by the Optical Center parameter). Radial distortion is controlled by the k1, k2 and k3 constants, with k1 having the greatest effect and k3 the least. Positive k values create a barrel or fisheye effect as if the image was wrapped around the surface of a sphere. Negative k values will bend the image inward to create a pincushion or pillow effect. The equations for radial distortion are:

x_distorted = x * (1 + k1 * r^2 + k2 * r^4 + k3 * r^6)

y_distorted = y * (1 + k1 * r^2 + k2 * r^4 + k3 * r^6)

where, 
  r = distance from center

Tangential distortion shifts pixels as if they were on a surface being tilted away from the camera and is controlled by the p1 and p2 parameters. p1 tilts the image up and down depending on the sign, and p2 tilts the image left and right. The equations for tangential distortion are:

x_distorted = x + (2 * p1 * x * y + p2 * (r^2 + 2 * x^2))

y_distorted = y + (p1 * (r^2 + 2 * y^2) + 2 * p2 * x * y)

where, 
  r = distance from center

The camera matrix is defined by the Optical Center and Focal Length parameters and is used to transform the image positions before the distortion is applied. The Optical Center values control where the center of the distortion effect is, while the Focal Length parameters act as a scale on the other effects. The camera matrix is usually represented as a 3x3 matrix:

fx 0  cx
0  fy cy
0  0  1

Distortion values for a camera lens can be determined using OpenCV calibration routines or through functions for a particular camera (see kinectazureTOP class).

• 

  Barrel or Fisheye Radial Distortion, k > 0

• 

  Pillow or Pincushion Radial Distortion, k < 0

• 

  Tangential Distortion, p1 < 0

• 

  Tangential Distortion, p2 < 0

lensdistortTOP_Class

Parameters - LensDistort Page

Invert Distortion invert - Reverse the lens distortion. This will *mostly* undo the distortion applied by another Lens Distort TOP with the same parameters and Inverse disabled. The lens distortion algorithm does not have a precise inverse solution, so an approximate method is used which may not match the original image precisely. The quality of the approximation varies depending on the magnitude of the distortion. Additionally, the approximation aglorithm does not use the k3 constant and any content that was lost outside the bounds of the image cannot be recreated.

K1 k1 - The first radial distortion constant. The k constants move pixels towards or away from the center of the image. Values greater than 0 produce a barrel or fisheye effect, while values less than zero produce a pillow or pincushion effect. k1 has a larger effect than k3.

K2 k2 - The second radial distortion constant. See K1.

P1 p1 - The first tangential distortion constant. Tilts the image up and down.

P2 p2 - The second tangential distortion constant. Tilts the image left or right.

K3 k3 - The third radial distortion constant (not used in the inverse distortion). See K1.

Optical Center center - ⊞ - The position in the image that should be the center of the distortion. Depending on the unit mode selected, the position can be entered as an absolute position measured from the bottom-left corner, or as a relative position measured from the center of the image. The unit mode also controls whether the position is measured in pixels or normalized coordinates.

• Optical Center center1 -

• Optical Center center2 -

Optical Center Units centerunit - ⊞ -

• R relative - The optical center is measured in normalized coordinates from -0.5 to -0.5 relative to the center of the image.

• A absolute - The optical center is measured in normalized coordinates (0 to 1) from the bottom-left corner of the image.

• RP pixelrel - The optical center is measured in pixel coordinates relative to the center of the image.

• AP pixelabs - The optical center is measured in absolute pixel coordinates from the bottom-left corner of the image.

Focal Lengths focallength - ⊞ - The focal length components of the camera matrix descibed either as normalized resolution-independent values or as pixels. The focal length acts as a scalar on the other distortion parameters. The normalized unit mode can be used for systems that use millimeters or other physical units. Often abbreviated as Fx and Fy. See OpenCV for details.

• Focal Lengths focallength1 -

• Focal Lengths focallength2 -

Focal Length Units focallengthunit - ⊞ -

• F fraction - The focal length is described in fractional or normalized coordinates.

• P pixels - The focal length is described in pixels.

Parameters - Layout Page

Layout layout - ⊞ - Determines how the transformed image is arranged inside the final output image space. This value can be useful to preserve the native pixel resolution of the input image, or ensuring a final output resolution and aspect ratio.

• Scale to Fit scale - The transformed image is scaled to fill the full resolution and aspect ratio of the output image. This mode is useful if you want a specific output resolution or aspect ratio.

• Native Resolution native - The transformed image is arranged in the output in a way that preserves its original resolution and aspect ratio. This may mean the image is cropped if the output resolution is smaller than the input resolution.

Extend Mode extendmode - ⊞ - Determines what values are used when the output image exceeds the bounds of the input image.

• Hold hold - Colors from the outside edge of the input image are extended to fill any gaps in the output image.

• Zero zero - Empty gaps in the output image are filled with zeroes in all channels.

• Repeat repeat - The input image is tiled to fill gaps in the output image.

• Mirror mirror - The input image is mirrored and tiled to fill games in the output image.

Optimal Alpha alpha - Determines how much of the image is preserved when calculating the optimal post transform. When zero, the optimal transform will include only the region of interest. When one, the transform will include all of the pixels from the input image. This value is equivalent to the 'alpha' value used in OpenCVs getOptimalNewCameraMatrix function.

Post Transform transformmode - ⊞ - Choose whether to preform an addition transformation to the image after the lens distortion is applied. This is useful for positioning and scaling the distorted image within the final image frame and can be used to preserve parts of the input image that would be shifted out of frame by the distortion.

• None none - No additional transformation is applied.

• Optimal optimal - The image is transformed according to the optimal new camera matrix as given by OpenCVs getOptimalNewCamera matrix. Depending on the value of the Optimal Alpha parameter, this mode can be used to ensure that none of the input image is lost outside of the image frame.

• Custom custom - Enables the custom center and scaling parameters.

New Center newcenter - ⊞ - A new optical center position that allows for shifting the transformed image within the output image frame.

• New Center newcenter1 -

• New Center newcenter2 -

New Center Unit newcenterunit - ⊞ - Determines how the new center values are interpreted.

• R relative - The center is measured in normalized coordinates from -0.5 to -0.5 relative to the center of the image.

• A absolute - The center is measured in normalized coordinates (0 to 1) from the bottom-left corner of the image.

• RP pixelrel - The center is measured in pixel coordinates relative to the center of the image.

• AP pixelabs - The center is measured in absolute pixel coordinates from the bottom-left corner of the image.

Scale scale - ⊞ - Performs an additional post-distortion scale on the image.

• Scale scale1 -

• Scale scale2 -

Scale Unit scaleunit - ⊞ - Determines how the scale values are used.

• F fraction - The scale is described in fractional or normalized coordinates.

• P pixels - The scale is described in pixels.

Cropping cropmode - ⊞ -

• None none -

• Region of Interest roi -

• Custom custom -

Custom Region cropregion - ⊞ -

• Custom Region cropregionx -

• Custom Region cropregiony -

• Custom Region cropregionz -

• Custom Region cropregionw -

Crop Unit cropunit - ⊞ -

• F fraction -

• P pixels -

Parameters - Common Page

Output Resolution outputresolution - ⊞ - quickly change the resolution of the TOP's data.

• Use Input useinput - Uses the input's resolution.

• Eighth eighth - Multiply the input's resolution by that amount.

• Quarter quarter - Multiply the input's resolution by that amount.

• Half half - Multiply the input's resolution by that amount.

• 2X 2x - Multiply the input's resolution by that amount.

• 4X 4x - Multiply the input's resolution by that amount.

• 8X 8x - Multiply the input's resolution by that amount.

• Fit Resolution fit - Fits the width and height to the resolution given below, while maintaining the aspect ratio.

• Limit Resolution limit - The width and height are limited to the resolution given below. If one of the dimensions exceeds the given resolution, the width and height will be reduced to fit inside the given limits while maintaining the aspect ratio.

• Custom Resolution custom - Enables the Resolution parameter below, giving direct control over width and height.

Resolution resolution - ⊞ - Enabled only when the Resolution parameter is set to Custom Resolution. Some Generators like Constant and Ramp do not use inputs and only use this field to determine their size. The drop down menu on the right provides some commonly used resolutions.

• W resolutionw -

• H resolutionh -

Resolution Menu resmenu - A drop-down menu with some commonly used resolutions.

Use Global Res Multiplier resmult - Uses the Global Resolution Multiplier found in Edit>Preferences>TOPs. This multiplies all the TOPs resolutions by the set amount. This is handy when working on computers with different hardware specifications. If a project is designed on a desktop workstation with lots of graphics memory, a user on a laptop with only 64MB VRAM can set the Global Resolution Multiplier to a value of half or quarter so it runs at an acceptable speed. By checking this checkbox on, this TOP is affected by the global multiplier.

Output Aspect outputaspect - ⊞ - Sets the image aspect ratio allowing any textures to be viewed in any size. Watch for unexpected results when compositing TOPs with different aspect ratios. (You can define images with non-square pixels using xres, yres, aspectx, aspecty where xres/yres != aspectx/aspecty.)

• Use Input useinput - Uses the input's aspect ratio.

• Resolution resolution - Uses the aspect of the image's defined resolution (ie 512x256 would be 2:1), whereby each pixel is square.

• Custom Aspect custom - Lets you explicitly define a custom aspect ratio in the Aspect parameter below.

Aspect aspect - ⊞ - Use when Output Aspect parameter is set to Custom Aspect.

• Aspect1 aspect1 -

• Aspect2 aspect2 -

Aspect Menu armenu - A drop-down menu with some commonly used aspect ratios.

Input Smoothness inputfiltertype - ⊞ - This controls pixel filtering on the input image of the TOP.

• Nearest Pixel nearest - Uses nearest pixel or accurate image representation. Images will look jaggy when viewing at any zoom level other than Native Resolution.

• Interpolate Pixels linear - Uses linear filtering between pixels. This is how you get TOP images in viewers to look good at various zoom levels, especially useful when using any Fill Viewer setting other than Native Resolution.

• Mipmap Pixels mipmap - Uses mipmap filtering when scaling images. This can be used to reduce artifacts and sparkling in moving/scaling images that have lots of detail.

Fill Viewer fillmode - ⊞ - Determine how the TOP image is displayed in the viewer.

NOTE:To get an understanding of how TOPs work with images, you will want to set this to Native Resolution as you lay down TOPs when starting out. This will let you see what is actually happening without any automatic viewer resizing.

• Use Input useinput - Uses the same Fill Viewer settings as it's input.

• Fill fill - Stretches the image to fit the edges of the viewer.

• Fit Horizontal width - Stretches image to fit viewer horizontally.

• Fit Vertical height - Stretches image to fit viewer vertically.

• Fit Best best - Stretches or squashes image so no part of image is cropped.

• Fit Outside outside - Stretches or squashes image so image fills viewer while constraining it's proportions. This often leads to part of image getting cropped by viewer.

• Native Resolution nativeres - Displays the native resolution of the image in the viewer.

Viewer Smoothness filtertype - ⊞ - This controls pixel filtering in the viewers.

• Nearest Pixel nearest - Uses nearest pixel or accurate image representation. Images will look jaggy when viewing at any zoom level other than Native Resolution.

• Interpolate Pixels linear - Uses linear filtering between pixels. Use this to get TOP images in viewers to look good at various zoom levels, especially useful when using any Fill Viewer setting other than Native Resolution.

• Mipmap Pixels mipmap - Uses mipmap filtering when scaling images. This can be used to reduce artifacts and sparkling in moving/scaling images that have lots of detail.

Passes npasses - Duplicates the operation of the TOP the specified number of times. Making this larger than 1 is essentially the same as taking the output from each pass, and passing it into the first input of the node and repeating the process. Other inputs and parameters remain the same for each pass.

Channel Mask chanmask - Allows you to choose which channels (R, G, B, or A) the TOP will operate on. All channels are selected by default.

Pixel Format format - ⊞ - Format used to store data for each channel in the image (ie. R, G, B, and A). Refer to Pixel Formats for more information.

• Use Input useinput - Uses the input's pixel format.

• 8-bit fixed (RGBA) rgba8fixed - Uses 8-bit integer values for each channel.

• sRGB 8-bit fixed (RGBA) srgba8fixed - Uses 8-bit integer values for each channel and stores color in sRGB colorspace.

• 16-bit float (RGBA) rgba16float - Uses 16-bits per color channel, 64-bits per pixel.

• 32-bit float (RGBA) rgba32float - Uses 32-bits per color channel, 128-bits per pixels.

• 10-bit RGB, 2-bit Alpha, fixed (RGBA) rgb10a2fixed - Uses 10-bits per color channel and 2-bits for alpha, 32-bits total per pixel.

• 16-bit fixed (RGBA) rgba16fixed - Uses 16-bits per color channel, 64-bits total per pixel.

• 11-bit float (RGB), Positive Values Only rgba11float - A RGB floating point format that has 11 bits for the Red and Green channels, and 10-bits for the Blue Channel, 32-bits total per pixel (therefore the same memory usage as 8-bit RGBA). The Alpha channel in this format will always be 1. Values can go above one, but can't be negative. ie. the range is [0, infinite).

• 16-bit float (RGB) rgb16float -

• 32-bit float (RGB) rgb32float -

• 8-bit fixed (Mono) mono8fixed - Single channel, where RGB will all have the same value, and Alpha will be 1.0. 8-bits per pixel.

• 16-bit fixed (Mono) mono16fixed - Single channel, where RGB will all have the same value, and Alpha will be 1.0. 16-bits per pixel.

• 16-bit float (Mono) mono16float - Single channel, where RGB will all have the same value, and Alpha will be 1.0. 16-bits per pixel.

• 32-bit float (Mono) mono32float - Single channel, where RGB will all have the same value, and Alpha will be 1.0. 32-bits per pixel.

• 8-bit fixed (RG) rg8fixed - A 2 channel format, R and G have values, while B is 0 always and Alpha is 1.0. 8-bits per channel, 16-bits total per pixel.

• 16-bit fixed (RG) rg16fixed - A 2 channel format, R and G have values, while B is 0 always and Alpha is 1.0. 16-bits per channel, 32-bits total per pixel.

• 16-bit float (RG) rg16float - A 2 channel format, R and G have values, while B is 0 always and Alpha is 1.0. 16-bits per channel, 32-bits total per pixel.

• 32-bit float (RG) rg32float - A 2 channel format, R and G have values, while B is 0 always and Alpha is 1.0. 32-bits per channel, 64-bits total per pixel.

• 8-bit fixed (A) a8fixed - An Alpha only format that has 8-bits per channel, 8-bits per pixel.

• 16-bit fixed (A) a16fixed - An Alpha only format that has 16-bits per channel, 16-bits per pixel.

• 16-bit float (A) a16float - An Alpha only format that has 16-bits per channel, 16-bits per pixel.

• 32-bit float (A) a32float - An Alpha only format that has 32-bits per channel, 32-bits per pixel.

• 8-bit fixed (Mono+Alpha) monoalpha8fixed - A 2 channel format, one value for RGB and one value for Alpha. 8-bits per channel, 16-bits per pixel.

• 16-bit fixed (Mono+Alpha) monoalpha16fixed - A 2 channel format, one value for RGB and one value for Alpha. 16-bits per channel, 32-bits per pixel.

• 16-bit float (Mono+Alpha) monoalpha16float - A 2 channel format, one value for RGB and one value for Alpha. 16-bits per channel, 32-bits per pixel.

• 32-bit float (Mono+Alpha) monoalpha32float - A 2 channel format, one value for RGB and one value for Alpha. 32-bits per channel, 64-bits per pixel.

Operator Inputs

• Input 0 -