Knowledge · Robot vision

Failed robot pick: recovery and retry logic

The camera finds no usable grip, or the gripper returns empty. A recovery sequence must decide whether another image or attempt will help and when to call an operator. Start with a clear failure state, then measure the handling time, product damage and manual work it causes.

Identify the state

Separate an empty container, uncertain localization and missing grip confirmation.

Bound retries

Use current evidence and define when automatic recovery must stop.

Measure production time

Include recovery time, interventions and accepted output in capacity measurements.

Recover from a known state
Explanatory schematic, not a production capture or measured result.

Identify the failure before retrying

StateNext action to define
No object detectedDetermine whether the container is empty or the measurement is insufficient.
No reachable gripAssess another grip or a changed scene; reprocessing the same image cannot create clearance.
Missing grip confirmationCheck the tool state and decide whether a new capture or operator action is needed.
Placement failedEstablish where the part is and which recovery motion can be executed.

Give each state a clear message and defined next action. Where useful, retain the image, chosen grip and robot status so repeated causes can be distinguished from unrelated failures hidden behind one generic alarm.

Confirm the grip with appropriate signals

Available feedback depends on the tool. Vacuum pressure may contribute to suction-grip confirmation; position or force may help with a mechanical gripper. Without validation, none of these signals alone proves that exactly the intended part is held correctly.

Test empty grips, incorrect contact, leakage and multiple-part acquisition where relevant. Set thresholds and waits using actual products. Define whether confirmation is checked again during motion and how loss of confirmation affects the sequence.

A retry should respond to changed evidence

Contact can change the scene. Decide whether another acquisition is required before selecting a different grip. Prevent unlimited repetition of the same rejected attempt. Record the rejection reason and define a bounded retry policy.

A recovery motion needs its own clearance, contact and gripper-state assessment. If the system does not know whether a part is held, it cannot simply assume the usual empty-tool withdrawal is appropriate.

Make operator intervention explicit

Define what the operator is told and what action is expected, such as replacing a container or inspecting an unusual part. Restart must check that process conditions are valid again. Cell access and safe restart belong to the complete installation design.

An isolated technical error code is insufficient. Explain the state, why automatic continuation is unavailable and the agreed next action. Exercise the intervention workflow during the trial rather than discovering it after commissioning.

Include recovery in the capacity calculation

Record frequency and duration by failure category. Calculate average time per accepted product from elapsed time and accepted output over an agreed test period. State product mix, fill conditions and operator availability.

Include operator labor, damage, rejects and maintenance alongside nominal cycle time. A change that speeds up individual picks while increasing recovery can reduce total capacity. The trial therefore needs normal cycles and exceptions.

Review exceptions in your picking process

Share current failure categories, grip feedback and the intended operator role so we can define a testable recovery sequence.

Discuss your application