Knowledge · Robotics

Hand-eye calibration: connect camera and robot

A camera locates a part in a different coordinate frame from the one used by the robot. Hand-eye calibration determines the spatial relationship needed to use those measurements for robot guidance. Camera and target placement determine which relationship is solved and which observations are required.

Robot and camera

Concept

Camera on the robot or fixed in the cell?

In eye-in-hand, the camera moves with the robot and its relationship to the flange must be known. In eye-to-hand, the camera is fixed relative to the cell and must be related to the robot base. A robot-mounted target can be used to calibrate a fixed camera; target placement alone therefore does not define the configuration.

What you calibrate

The camera-to-robot relationship is a spatial transform: rotation and translation between coordinate frames. Camera intrinsics and lens distortion are determined separately. The tool centre point and offset from the detected feature to the grip must also be known.

Why it fails

Mounting play, a displaced camera or an incorrect tool centre point can change the final pick position. Check mechanics and configuration before using a new calibration to compensate for the error.

Choosing a calibration target

A checkerboard, ChArUco board or AprilTag grid can provide identifiable references, depending on the method. Pattern, marker family, physical dimensions and software support must agree. Verify the printed board's dimensions and mount it flat and rigidly.

Practice

What to include in the project

A useful procedure defines data collection, quality checks and independent testing after solving the transform. Retain camera settings, tool data and mounting configuration alongside the result.

  1. 01

    Check the mounting

    Camera, target and tooling must not move unintentionally during data collection. Check whether cable loads or robot motion deform a mount. A changing geometry cannot be represented by one fixed transform.

  2. 02

    Document the procedure

    Collect observations with sufficient positional and rotational variation for the chosen method. Associate each image with the correct robot pose. Allow settling for stationary capture; moving acquisition requires validated timing alignment. There is no universal image count sufficient for every setup.

  3. 03

    Check the complete coordinate chain

    Include image measurement, camera-to-robot transformation, tool calibration and part movement in the error budget. Check units, axis conventions and transformation order. An error can look small at one orientation and become apparent at another.

  4. 04

    Test real grasps

    Use independent reference positions distributed across the work area. Measure reached position and product placement. Set limits from the gripper and production task, and test the consequences of relevant maintenance or tool changes.

Vincent van Montfoort

Calibration in your cell

Share camera arrangement, robot model, work area and placement tolerance so we can define a calibration and verification procedure, including execution time and maintenance checks.

A calibration target on the robot arm

With a fixed camera, a rigidly mounted target can be moved through different robot configurations. The camera estimates target pose while the robot reports the corresponding flange pose. The calibration method uses paired observations to determine the relevant spatial relationships. Pair only observations representing the same physical state.

Avoid a sequence of nearly identical configurations. Observations must sufficiently constrain the rotations and translations being solved. Use poses in which the target is reliably visible and motion can be executed in a controlled manner. The illustration below explains the arrangement; it is not a printable calibration target.

Handover and maintenance

Store the transform with target dimensions, software version and physical configuration. Define who may release a recalibration and which independent checks are required. Replacing a camera, changing lens settings or moving a mount requires reassessing validity.

Investment planning should also include downtime, measurement equipment and repeat checks. A quick solver offers limited benefit if acquisition or post-maintenance recovery does not fit production operations.

Fixed camera, target on moving robot
Explanatory schematic, not a capture or measurement from a production cell.