ROBOT SALES / PURCHASE AND DEPLOYMENT
// Machine vision and decisions based on data

AI quality control: scope and limits

A vision system can support the detection of selected defects or part features. Effectiveness depends on image quality, samples and decision criteria. AI does not replace either a clear definition of a defect or testing on real data.

Contact: Marcin Bialczyk, Eng. · +48 503 75 55 81

Robotised part handling cell at a machine
Illustrative material from Robotstock assets.

What the system can cover

Vision-based quality control can analyse the presence of elements, position, orientation, selected surface features or the conformity of appearance with an adopted reference. The choice of technique depends on what is to be recognised.

A typical project scope covers:

First the definition of conformity and a defect

A photo on its own does not say whether a part is defective. You must define which features are acceptable, which require rejection and which should go to an additional assessment. If different people classify the same sample differently, the criteria must first be organised.

Element of the assessment Questions to close before the test
Defect What does it look like, where does it occur and what variants does it have?
Good part What variation is accepted?
Presentation Will every relevant surface be visible?
Decision Which result categories are needed?
System error How to handle a false rejection, a miss and a lack of certainty?
Process change When must the tests be repeated or the samples extended?

When it is worth assessing AI

AI can be useful when the features are hard to describe with simple rules and their appearance changes between parts. However, representative data and a stable way of capturing the image are needed.

A good starting point is a process in which:

When this is not the right solution

We do not recommend starting with an AI model when the quality criteria are contradictory, the samples do not come from the actual process or the defect is not visible in the available data. Strong reflections, contamination, obstruction and uncontrolled part position can also be a problem — in that case the imaging conditions must be improved first.

A vision system does not replace the measurement of properties that the chosen technique does not record. Decisions should also not be automated without defining who is responsible for the criteria, the review of results and the reaction to an error.

The role of samples and testing

Collecting data

The samples should cover typical parts, acceptable deviations, known defects and borderline conditions. The description of the data must be consistent with the current quality criteria.

Division of work and assessment

The data used to build the model should not be the only material for assessing how it performs. A separate test set helps to check the behaviour on examples that the model did not use during training.

Acceptance criteria

Before the test you must agree which types of error are particularly important and how they will be counted. A percentage of correct decisions alone, without a division into types of parts and errors, may not describe the risk of the process well.

Changes after commissioning

New material, a supplier, a part variant, the lighting or the way the camera is set up can change the input data. Such situations require an assessment and, if needed, revalidation.

Integration with the process

The result of the image analysis can be passed to the control, stored with the part identifier or shown to the operator. The actual way of integration and the scope of data are defined in the project. A connection to a specific system or the availability of a ready-made interface is not assumed in advance.

Check what the next stages of assessment and deployment look like

// QUESTIONS AND ANSWERS

Frequently asked questions

Will AI detect every type of defect?

This should not be assumed. The scope depends on the visibility of the feature, the image resolution, the samples and the definition of the defect. Defects hidden inside the material or invisible to the chosen technique require a different method.

How many samples are needed?

There is no single number suitable for every process. The set must represent the actual variation of parts and conditions. The required number and structure of samples are defined after the task has been assessed.

Can the system work without defective samples?

Different approaches can be analysed, but the lack of real examples of defects limits the assessment. The test criteria and the way of treating new, unknown cases must be defined with particular care.

What about an uncertain result?

The rules for an uncertain result must be defined before deployment. The part may be sent for additional inspection or handled in another agreed way, instead of automatically receiving a decision without sufficient grounds.

Does the system replace all existing inspections?

The scope of replacing or supporting other inspections depends on the process requirements and the validation results. The decision should be based on documented tests and the rules of responsibility for quality.

CallRobot valuation