TRISK: A local features extraction framework for texture-plus-depth content matching

Maxim Karpushin (1) , Giuseppe Valenzise (2) , Frederic Dufaux (2)

1 LTCI - Laboratoire Traitement et Communication de l'Information
2 L2S - Laboratoire des signaux et systèmes

In this paper we present a new complete detector–descriptor framework for local features extraction from grayscale texture-plus-depth images. It is designed by putting together a locally normalized binary descriptor and the popular AGAST corner detector modified to incorporate the depth map into the keypoint detection process. With these new local features, we target image matching applications when significant out-of-plane rotations and viewpoint position changes are present in the input data. Our approach is designed to perform on RGBD images acquired with low-cost sensors such as Kinect without any complex depth map preprocessing such as denoising or inpainting. We show improved results with respect to several other highly competitive local image features through both a classic local feature evaluation procedure and an illustrative application scenario. Moreover, the proposed method requires low computational effort.

Mots clés: descriptor; viewpoint changes; texture-plus-depth; RGBD; local feature; keypoint detector

Domaines: Traitement des images [eess.IV]; Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Maxim Karpushin, Giuseppe Valenzise, Frederic Dufaux. TRISK: A local features extraction framework for texture-plus-depth content matching. Image and Vision Computing, 2018, 71, pp.1-16. ⟨10.1016/j.imavis.2017.11.007⟩. ⟨hal-01654139⟩