About

This code has been produced during while writing my Ph.D. (Dr.-Ing.) thesis at the institut of automatic control, RWTH Aachen University. If you find it helpful for your research please cite this:

T. Redick, „Bayesian inference for CAD-based pose estimation on depth images for robotic manipulation“, RWTH Aachen University, 2024. doi: 10.18154/RWTH-2024-04533.

PoseErrors.jl

A good overview and rationale behind 6D pose error metrics can be found in the BOP-challenge. They prefer Maximum Symmetry-Aware Surface Distance (MSSD) over Averade Average Distance of Model Points with indistinguishable views (ADD-S = ADI), because they can yield low errors with bad visual alignment. Moreover, ADD-S is dominated by higher-frequency surface parts (e.g. a Thread). Maximum distances do not suffer from the surface sampling density as much.

However, annotating the symmetries is tedious and heavily depends on the choice of coordinate frames. For a large set of objects like surgical instruments which are not exported in a standardized / symmetry aligned frame, this is impractical. So, similar to (Gorschlüter et al. 2022) we use ADD-S and VDS (Hodan et. al 2016) as metrics.

Setup for BOP dataset evaluation

Extract the BOP datasets as described on their website. Move the detections JSON to the matching datasets test directory and rename it to default_detections.json, e.g. datasets/tless/default_detections.json.

You could also you the keyword argument detections_file of scene_test_targets to specify another file in the test directory.

Loading the BOP datasets

Your first entry points should be the methods to load the according targets. These load the required image files, mesh files, camera parameters, etc.

• gt_targets: Loads the ground truth pose as :gt_t and :gt_R, the ground truth visible bounding box, and the gt mask image paths.
• test_targets: the estimated bounding box, and the estimated segmentation masks.

Iterate each row and load cropped images via:

• load_color_img(row, width, height)
• load_depth_img(row, width, height) scaled in meters as Float32
• load_mask_img(row, width, height) masks the visible object surface either gt from disk or from the detections file in the test targets.