Data Engineer at work

AI Quality via DIN SPEC 92001-2

Team Konfuzio

DIN 92001 defines a quality metamodel over the lifecycle of AI and identifies performance, stability, functionality, and traceability of AI as the overarching goals of AI quality assurance.

DIN SPEC 92001-2 has been publicly available since December 2020. The document of more than 40 pages is extensive and detailed. On this page you will find a short and abbreviated overview. You can download the entire DIN document unsing the following link .

Definition of robust AI

What is robust AI?

AI can be assumed to be robust if intentional interference by harmful adversaries and by unintentional interference due to changes in the input data do not impose risk on AI stakeholders. Both disturbances represent a safety and a protection problem.

AI must cope with faulty, noisy, unknown or
constructed input data. In complex environments, robustness is a key AI quality criterion. Even state-of-the-art AI modules are susceptible to these types of glitches. When companies want to make AI robust, there are two dimensions to focus on.

  • intentional interference by harmful adversaries
  • unintentional disturbance due to changes in data input

6 steps to improve your AI quality

How to implement a quality cycle for robust artificial intelligence based on DIN SPEC 92001-2?

  1. Match the tasks to be undertaken by the AI with your organization's risk appetite.

  2. Define "AI malfunction" per automated task

  3. Identify opponents, think about possible attacks and prepare defense strategies

  4. Monitor your input data and be ready to retrain your AI on new data

  5. Add error-causing data to your test data and calculate its impact after each training of the AI

  6. Document your strategy and repeat the above steps regularly

Already in November the Informatik Aktuell in a wide-ranging article about our KI-Dreieck®, which is based on DIN SPEC 92001. This, as well as our software Konfuzio, continuously expanded to exceed the latest demands on quality and robustness.

More Articles

Faster R-CNN for page segmentation

Automatic text summarization in documents with faster R-CNN and PEGASUS

Increasing volumes of documents and the information they contain need to be processed by businesses today in order to harness the hidden content...

Read article
Vehicle registration document sample

Scan vehicle registration document and process digitally with AI

AI scanner software captures all data in a few seconds for the automotive industry, insurance companies and government agencies Many garages take the information from...

Read article
Traffic at night

Document processing with AI, automate processes and generate insights

Why do companies process documents with AI? Today, data is considered one of the most valuable resources in the world. In contrast,...

Read article

    Are you looking for more information?

    You are also welcome to send us an e-mail to [email protected] , call us via +49 6441 8994005 or book a meeting.
    Arrow-up