What is visible?
The camera measures colour, intensity and depth, including missing or unreliable pixels.
Knowledge · Robotics
Loading a machine from a bin can involve repetitive lifting and positioning. The required vision depends on how parts arrive: fixed locations, a known plane or changing height and orientation. Use the decision matrix to compare mechanical presentation, 2D guidance and 3D bin picking.

The short answer
Do not start with the most elaborate 3D solution by default. If parts lie at a known height with the same face upward, a straightforward 2D camera may be enough. Only when height, tilt and overlap keep changing does the robot cell need to perceive and plan more for itself.
Fixed presentation or varying positions
The bin itself says little about how difficult the task is. When every part has a fixed position in a tray, the robot can repeat almost the same movement. When parts lie loose and overlap, the system must decide again for every pick what is visible, reachable and safe to grasp.
| Presentation | What is known? | Usually suitable approach | Main limitation |
|---|---|---|---|
| Fixed tray or fixture | Position, height and orientation are predefined. | Robot program with presence verification; vision may not be required. | Limited flexibility across product changes. |
| Separated on a plane | Known height, limited orientations, no overlap. | 2D camera for X, Y and in-plane rotation. | Fails when parts tilt or cover one another. |
| Layered or semi-ordered | Same face upward, but height or limited tilt varies. | 2.5D height map or 3D guidance with constrained pose freedom. | A depth image contains visible surfaces only. |
| Randomly piled | Position and orientation are unknown; parts overlap. | 3D perception, pose or grasp estimation, and collision-aware planning. | Each pick changes the scene; reacquisition is normally required. |
| Entangled or deformable | Shape and physical relationships may change during the pick. | 3D plus a specialised gripper, active rearrangement or mechanical singulation. | Direct bulk picking may be technically or economically unattractive. |
On a flat support with known part height, a 2D detection can often be converted directly into a fixed pick Z. The number of possible orientations is reduced as well. Once parts stack, tilt or vary in shape, this simplification disappears: actual height, surface normal and gripper clearance must be recovered from the scene.
The complete chain
Each stage must have a valid output and a defined response when it fails. Verify the complete sequence from capture to accepted placement.
The camera measures colour, intensity and depth, including missing or unreliable pixels.
Software separates instances, identifies the type, and estimates pose or possible grasp points directly.
Flatness, edges, holes, material, centre of mass and clearance determine whether a grasp is stable.
Reach, joint limits, singularities, bin walls and full tool geometry constrain the choice.
Approach, gripper closure, lift and extraction must be collision-free with the part attached.
Vacuum pressure, finger position, force sensing or a verification image confirms the pick and drives recovery.
Complicating factors
Test which surfaces are visible, whether a part can separate from its neighbours and whether the tool has clearance. These conditions can change after every pick.
The camera measures visible surfaces only. A hidden edge or underside is inferred from CAD or learned priors, not directly observed. The target may also be trapped beneath a neighbour.
Gloss can redirect projected light or saturate a sensor. Dark material may return too little light, while transparent parts transmit or refract it. No depth technology solves every material universally.
A cylinder may have several equivalent orientations. That is harmless if every orientation is acceptable, but critical when a hidden key must later be aligned.
Walls create shadows, reflections and restricted tool access. A fixed camera also observes a full and nearly empty bin from different ranges and angles.
Rings, clips, springs and sheet parts can interlock. A correct pose does not prove that exactly one part will separate.
Errors in camera intrinsics, camera-to-robot calibration, robot accuracy and the tool centre point accumulate. Accurate depth alone therefore does not guarantee an accurate pick.
Pose found. What next?
A suction cup needs an accessible contact surface; a finger gripper needs space to approach and close. Both require a validated withdrawal path with the part attached.
Illustrative case: a part has a visible top surface beside a bin wall, but the robot wrist hits the rim during approach. Reject that candidate and test another grip, robot configuration, viewpoint or part.
Reducing complexity deliberately
Often limits the problem to three degrees of freedom and permits a fixed pick height.
Parts cover less of one another, leaving more visible gripping surfaces. Test whether multiple picks can use the same image after the pile changes.
Usually provide more stable depth and retain their geometry during detection and gripping.
More candidate grasps and greater tolerance of measurement and calibration errors.
Better lines of sight and more room for the wrist, tool and extraction motion.
A vibration plate, conveyor, step feeder or intermediate station can reduce overlap before vision begins.
Important:Mechanical feeding can constrain position before imaging. Compare its changeover effort, wear and handling limits with the sensing and recovery work required for loose parts.
Solution types
For flat, separated parts. Fast, explainable and often easier to maintain.
For layers, boxes or top surfaces with height variation. A height map contains one visible depth per image point, not hidden geometry.
Fits known 3D geometry to the measured point cloud. Strong for fixed industrial parts when CAD, calibration and visible geometry agree sufficiently.
Can help with variable appearance, instance separation and grasp estimation. Training must represent actual materials, lighting and pile states.
Combines, for example, AI segmentation with CAD pose, depth verification and explicit collision checking. This is often more diagnosable than a fully end-to-end model.
Spreads or meters parts so the robot can use 2D or simpler 3D. Particularly relevant for small, interlocking or high-throughput parts.
Measuring depth
Use the depth guide below to compare measurement principles. For this decision, test valid depth on the required gripping surfaces throughout the full-to-empty bin range.
Calculate depth from image differences between cameras. Projected texture can help on uniform surfaces. Repeated patterns, reflections and surfaces hidden from one camera can prevent a valid match.
Measures a projected pattern. Test shadows, ambient light and movement during capture.
Measures light travel time or phase. Test reflections from multiple surfaces, saturation and weak returns.
Simpler calibration and often shorter cycles when the complete bin remains within range and field of view. In deep bins, capture quality changes between full and empty states.
Allows alternate viewpoints and more consistent working distance. The trade-offs are extra motion, stationary capture, payload, protection and cable routing.
Testing under production conditions
Do not test only a few easy parts placed neatly on top. Use actual parts and the real bin, including full corners, glossy surfaces, interlocked parts and an almost empty bin. That reveals where the robot needs help or a different approach before the investment is made.
The fastest isolated robot move is not automatically the best strategy. A slightly slower grasp with a high success probability can deliver more production than an aggressive grasp that often causes a rescan, drop or operator intervention.
Available 3D hardware
The Hikrobot MV-DB range includes RGB-D models for tasks such as singulation, volume and pose measurement. Compare each model's measurement range, clearance distance, field of view, depth accuracy and scan rate against both the full and empty bin.

Use the product page to compare models and specifications. Material behaviour, viewing angle, bin walls and gripper access remain part of the practical test.
View MV-DB models →Frequently asked questions
Continue within Sedeco
Bring representative parts, the actual bin, required output and placement tolerance. For the investment comparison, record current handling hours, replenishment, changeovers and recovery. Estimate equipment, tooling and integration/validation hours × rate, plus ongoing maintenance. A trial should measure accepted placements and interventions over full-to-empty bins before assigning savings.