All new features at a glance

Highlights of the IDS NXT software releases

IDS NXT 3.0 - New AI method for anomalies

With the software release IDS NXT 3.0, we are expanding the application possibilities for the all-in-one AI system to include, among other things, an additional deep learning method and also ensure better traceability in the training of neural networks.

Anomaly Detection

You can now use IDS NXT cameras for anomaly detection in addition to object detection and classification. Only a small amount of training data is required to reliably identify both known and unknown process deviations. This reduces the time and effort required to create and annotate the training data.

Code Reader

With the new code reader function in the block-based editor, you can quickly and easily enable IDS NXT cameras to locate, identify and read different types of code and the required parameters.

Transparency in the training process

As early as during the training and testing process in IDS NXT lighthouse, attention maps show which image areas have an impact on classification results. This means that training errors or biases can be detected and eliminated at an early stage, before the AI is working in the camera. This reduces review and maintenance loops in the development process and therefore accelerates commissioning.

IDS NXT 2.6 - App your camera!

This software release focuses on simplifying the creation of apps. Starting a development project is often one of the biggest challenges in realising a project. With the help of the new Use Case Assistant in IDS NXT lighthouse, you can configure a complete vision app under guidance in just a few steps, which you can then run directly on an IDS NXT camera. Another new feature is the Block-based Editor, which allows you to develop your own programme sequences with AI image processing functions such as object recognition or classification without any programming knowledge.

Use Case Assistant

In the Use Case Assistant, you select the use case that suits your project. With queries and tips, the wizard guides you through the process of creating the Vision App project and creates the programme code, just like in an interview. In the process, it links existing training projects with the Vision App project or creates new training projects and data sets in IDS NXT lighthouse if required.

Block-based Editor

With the modular blocks and the intuitive user interface, anyone can realise their own projects using AI-based image processing (such as object detection or classification) in the form of an individual Vision App without having to know the syntax of a specific programming language. In this case, you create the Vision App project yourself and use the predefined blocks of the code editor to build your Vision App graphically yourself, including processes such as loops and conditional statements.

Confusion Matrix

In the "Training Sessions" area of the "Training" tab of IDS NXT lighthouse, you can display a confusion matrix for classification networks that you have trained from version 2.6. The confusion matrix is suitable for assessing the performance of your classification network and shows how the test or validation data is classified compared to the assigned labels.

Multi-camera support in IDS NXT cockpit

You can now monitor camera status, images and results for multiple cameras on one screen, and keep up to date with your applications. In addition, the configuration including login can be saved for quick access.

IDS NXT 2.0 - AI for Factory Automation

The update expands the AI capabilities of IDS NXT with object recognition, introduces the OPC UA interface and, thanks to a new development environment, ensures that custom image processing tasks can be programmed as vision apps and executed on the cameras.

New development environment for professionals

Developers and AI specialists can use the "IDS NXT Vision App Creator" to dive even deeper into the system, create individual vision apps and thereby adapt IDS NXT cameras even better to their own needs. This makes even the combination of classifications or object recognition with classic image processing, such as measuring, feasible in one device.

Automation via OPC UA

IDS NXT rio and rome cameras can now communicate with machines and controllers in the same language and exchange tasks or results directly. The use of OPC UA enables the direct integration of these intelligent cameras into factory automation, without additional hardware or programming effort. The standardised communication also creates the basis for the "plug-and-produce" of new devices. This shortens the commissioning of machine vision systems to a minimum.