More resolution for color sensor
The AR1820HS 18 mega pixel sensor in our UI-3590 camera models was launched by the sensor manufacturer onsemi as a pure colour sensor. Like all colour sensors, the Bayer filter means that you get colour images with effectively only around a quarter of the nominal sensor resolution, as the colour information for each pixel is obtained from four neighbours
To use each individual pixel, however, it is not sufficient to operate the sensor in RAW data format (without Bayer interpolation). The Bayer matrix results in a different brightness perception of the individual pixels.
We will show you how to use the colour sensor as a “pure” mono sensor by appropriate parameter settings and the use of suitable light sources, in order to obtain a significantly higher resolution.
Background
The principle of digital image sensors such as the 18 MP onsemi AR1820HS means that they acquire only brightness – but not colour – information. As a result, a colour filter is applied to each pixel during manufacture of colour sensors. This is known as the Bayer matrix.
Of each four pixels, two pixels are given a green colour filter, one pixel a red filter and one pixel a blue colour filter. This colour distribution corresponds to the perception of the human eye and is referred to as the Bayer matrix. A pixel depicts only the information for one colour.
To obtain the complete RGB values for each pixel, the missing primary colours are interpolated from four neighboring pixels using appropriate algorithms. This colour interpolation assumes that there are only slight colour differences between two adjacent pixels of the same colour. Strictly speaking, a sensor with Bayer matrix therefore has only a quarter of the native sensor resolution.
Sensor mono mode
Although the Bayer matrix cannot simply be rendered invisible for mono mode, the following two solutions show how you can achieve the desired result depending on the type of application.
1) … for "grey scenes"
If the 18 MP colour sensor is to be used in mono mode for achromatic scenes, note that a broad band light source (white light) must still be used. This is because of the sensor’s Bayer matrix. With this sensor, monochromatic (single colour) light would have resulted in the individual pixels transmitting no or less information depending on the wavelength of the light, due to the RGB filter layers used (see Figure 2). This can result in a different brightness perception for the individual pixels. In this case, the RGB enhancement must be calibrated separately for R, G, and B. As a result, you then obtain an identical brightness perception for all pixels as with a mono sensor.
Without calibration of the RGB enhancement, the Bayer matrix is clearly visible (left).<br>After RGB calibration (see RGB histogram, right) there is a homo-geneous brightness perception as with a mono sensor.
Note: This RGB calibration is only valid for this specific light source and a "grey" scene. If the light source (wavelength) changes, the RGB enhancement factors have to be re-adjusted.
How to switch the Bayer matrix to "invisible" using the uEye Cockpit:
- Illuminate the scene with a white light source.
- Show the histogram with the option "Show Bayer RGB"
- Select the exposure time so that no significant parts of the image are overexposed (clipping). This can be seen in the histogram if numerous pixels have the value 255. Counter measure, e.g. use AES ("AES/AGC" tab) to regulate to 128.
- Then correct the AWB (Auto White Balance) to "Grey World". In the histogram, you can see how the colour curves align over one another.
- Check in 8-bit RAW mode ("Format" tab). The Bayer matrix should not be visible.
- If it is, adjust the RGB enhancement factors manually ("Image" tab).
After calibration, you will no longer see the Bayer matrix in "monochromatic" scenes. By contrast, if you bring a coloured object into the scene, you will only see the Bayer matrix on it.
After the RGB calibration, the Bayer matrix can only be seen in coloured parts of the image, as the RGB filter layers transmit no or less information depending on the wavelength of the light. (see Figure 2)
2) … for "colour or grey scenes"
If you work with colour scenes in your application, the brightness sensitivity of the individual Bayer pixels constantly changes with the variation in colour components. There is also a way to achieve genuine mono mode in this situation. The solution lies in the colour spectrum of the 18 MP onsemi AR1820HS.
Above a wavelength of around 900 nm the colour filters for the individual pixels have similar spectral properties. Beyond this threshold, all pixels on the sensor respond practically identically to incident light again – exactly as with a dedicated mono sensor. This means that the Bayer matrix can also be made invisible using this method, both for colour and also for grey scenes.
In order to be able to use this spectral property of the sensor as described, you must observe the following:
- Ensure defined lighting conditions, i.e. seal off light with other wavelengths shorter than 900 nm as far as possible.
- Order your uEye camera with AR1820HS sensor specifically with GL filter (glass). The HQ filter normally ordered with this sensor would shut out the long-wave light required here. By contrast, the GL filter allows light beyond 900 nm to pass almost unweakened. The highest possible signal strength thus arrives at the sensor.
Suitable lens
Under the conditions described, a uEye camera with AR1820HS sensor in mono mode satisfies all the requirements for a far higher image resolution than in colour mode. In the overwhelming majority of cases, however, the camera is used in conjunction with a lens. In this case, with an achievable nominal sensor resolution of 18 MP, the lens is the limiting factor in the resolution capability of the entire system.
The optical resolution of a lens is generally specified in mega pixels. This figure relates to the largest sensor format for which the lens is designed. It determines how fine the structures are that the lens can transmit. In other words, the smaller the sensor format the finer resolution the lens requires. If you are using a lens with an insufficient optical resolution, the sensor pixels are under-scanned. The details that can be depicted then spread over more adjacent pixels. As a consequence, you do not achieve the full image sharpness that the sensor resolution allows. However, you should avoid combinations involving a lens that has a higher resolution on the image side than the relevant sensor. This can make unwanted aliasing / moiré effects visible in the image.
In practice, reproducing the smallest detail with approx. 2 pixels is recommended. Overall, this means that identifying a suitable lens depends on the reproduction scale, but also to a significant extent on the pixel size of the sensor used.
Summary
With the right settings and optimum ambient conditions (defined lighting conditions, appropriate lens) you can benefit from the high nominal sensor resolution of the onsemi AR1820HS in mono mode. By operating it with appropriate high-resolution lenses in the 10 to 16 mega pixel class, which are widely available on the market, you can achieve the corresponding gain in resolution. For example:
- 10 MP Lensation, B10M7224, 7.2 mm, 1/2.3"
- 16 MP Lensation, BF16M220D, 1.2 mm, 1/2.3"
You can use the IDS lens finder to quickly and easily identify other appropriate lenses for your IDS camera: https://en.ids-imaging.com/ueye-lensfinder.html. Select your camera model and then enter the working distance and object height or width. The IDS lens finder automatically identifies appropriate lenses to meet your requirements. You can also get support in choosing the appropriate lenses from our sales team.
Further information about the 18 MP onsemi sensor in our UI-3590LE and CP camera models can be found on our website at: https://en.ids-imaging.com/store/products/cameras/ids-sensor-model/ar1820hs.html