3D camera in front of a monitor displaying a coloured point cloud and a software interface

Setting up Nion 3D camera in IDS peak Cockpit

Nion getting started

1. Introduction

This guide is designed to provide information on setting up the Nion 3D ToF camera in IDS peak Cockpit and covers the operating modes, data optimisation and workspace calibration.

For instructions on installing the camera and setting it up on the network, please refer to the Nion camera manual.

2. Configuration of working range and operating modes

2.1 Working range setup

In order to optimise the accuracy of the depth data, different operating modes (or unambiguous ranges) are used.

Working range 0–750 mm with correct and incorrect detection
Only distances to objects or surfaces within the selected working range are valid, therefore different working ranges are provided for scene optimisation.
Extended range up to 1500 mm with two detected objects
For best results, be sure to select the correct working range on the camera and avoid working at the edge of the working range.

2.2 Selecting the best mode for your application

Use the operation modes and precision tables on the Nion datasheet to determine the optimum configuration for the application considering the following:

  • Unambiguous range must exceed the distance to the furthest object or surface
  • Maximum exposure time - use Quad VGA operating modes to minimise motion artefacts for fast moving objects
  • Spatial resolution – operating modes with Quad VGA suffix offer a higher spatial resolution
  • Accuracy
  • Precision

2.3 Configure operating mode

  • To configure the operating mode in peak Cockpit use:
Button to save and load parameters in the interface
  • Select the required operating mode in the drop-down menu:
Camera parameter set selection
  • Here it is possible to save any settings to the camera UserSets area or to a *.cset file and to set the default startup parameters

3. Data optimisation

3.1 Optimise intensity image

To optimise the 3D data, use the intensity image controls (exposure and analog gain) to maximise the image brightness whilst avoiding (or minimising) saturation.

  • To set up the intensity image use:  
Button for brightness and frame rate selection
  • Adjust exposure and analog gain:
Slider for exposure time set to 0.499 ms
Slider for analogue gain set to value 2.63
  • Use the histogram display to optimise image brightness
  • Digital gain can be used to increase image brightness without affecting the 3D data, here some saturation is tolerable
  • Gamma correction can also be applied to stretch the dynamic range of the displayed intensity image and does not affect the 3D data.  
  • To adjust the Gamma use:
Menu item for host features in the interface
Gamma setting showing value 2.08 in control panel
  • Once the Intensity image is correctly configured, it is a good idea to disable this component to reduce bandwidth usage

3.2 Enable and use the confidence map

The confidence map is a useful tool for further data optimisation and shows, by colour, the confidence of each point in the image. By default, this component is disabled to minimise bandwidth usage.

  • To enable the confidence map use:
Navigation point for host functions in the software
  • Select confidence from the Image component list.
Image component mode with confidence option enabled
  • Enable the output with the toggle switch (stop the camera acquisition if the toggle switch is not active)
Colour confidence map with red centre and green edges
Example confidence map of a flat surface using the “jet” colour map.
Colour display selection with jet colour scale
Colours closer to red indicate higher confidence, colours closer to blue indicate lower confidence.
  • Use the exposure and analog gain controls to adjust the confidence map to optimise the data

3.3 Nion specific parameters

There are additional parameters available to optimise the 3D data:

Noise filter

Smoothing filter to fill gaps in 3D data and reduce noisy points

Confidence threshold

Filters out lower confidence points in the depth image

Flying pixel threshold

Filters out points “flying” between two planes in the depth image

  • To adjust these parameters, use:
Section for generic parameters in the interface
  • Set visibility to expert or guru
Search bar with Guru selection and scan 3D input
  • Enter “Scan 3D” in the search bar to filter down to the relevant parameters
  • Click on the required parameter and use the slider bar or text entry fields to set the parameter as required using the data displays for feedback.
  • A new custom dialog for these parameters can be created using the select parameters and apply parameter selection buttons.
Icon to apply settings with check mark symbol

4. 3D data representation

4.1 3D colour mapping

The 3D colour map is used to help visualise the 3D data by relating colour to distance or height. Using the min and max values the colour map can be adjusted to map to just the range of interest in the depth map and increase contrast in the data.

Depth map with blue area and low-contrast object edges
Depth map with colour map over entire range
Depth map with clearly highlighted objects in green and yellow
Depth map with colour limited to interesting depth range
  • To adjust these parameters use
Settings 3D tab with cube icon
  • Set desired 3D colour map
  • Set min (near) [mm] value to point of interest closest to the camera
  • Set max (far) [mm] value to point that incorporates all points of interest in the operating range

4.2 3D data threshold

3D data can also be filtered out of the point cloud to reduce the number of points for processing. For example, if the application does not require the background for processing, this can be removed.

  • To adjust these parameters, use:
3D settings section with a cube icon in the menu
  • Set threshold Z min [mm] and threshold Z max [mm] as per the min and max colormap settings
Point cloud of object with rough surface and blue background
Full point cloud including background
Isolated point cloud with fine structural details
Filtered point cloud with background removed

5. Workspace calibration

To transform the coordinates to a different reference plane, the workspace calibration wizard can be used.

Sensor with defined working distance 750 mm
Factory camera coordinates
Sensors with alternative measuring ranges and spacing in mm
Alternative coordinates
  • To change the 3D coordinates use:
Calibration tab with icon for calibration options
  • Follow the steps in the wizard to complete the coordinate transformation.
  • Workspace calibration settings can be saved to or loaded from file for later use