An improved non-rigid image registration approach

HE Kai; WEI Ying; WANG Yang; HUANG Wan-rong

doi:10.13374/j.issn2095-9389.2019.07.015

Volume 41 Issue 7

Jul. 2019

Turn off MathJax

Article Contents

Article Navigation > Chinese Journal of Engineering > 2019 > 41(7): 955-960

HE Kai, WEI Ying, WANG Yang, HUANG Wan-rong. An improved non-rigid image registration approach[J]. Chinese Journal of Engineering, 2019, 41(7): 955-960. doi: 10.13374/j.issn2095-9389.2019.07.015

Citation:

HE Kai, WEI Ying, WANG Yang, HUANG Wan-rong. An improved non-rigid image registration approach[J]. Chinese Journal of Engineering, 2019, 41(7): 955-960. doi: 10.13374/j.issn2095-9389.2019.07.015

HE Kai, WEI Ying, WANG Yang, HUANG Wan-rong. An improved non-rigid image registration approach[J]. Chinese Journal of Engineering, 2019, 41(7): 955-960. doi: 10.13374/j.issn2095-9389.2019.07.015

Citation:

HE Kai, WEI Ying, WANG Yang, HUANG Wan-rong. An improved non-rigid image registration approach[J]. Chinese Journal of Engineering, 2019, 41(7): 955-960. doi: 10.13374/j.issn2095-9389.2019.07.015

PDF( 8132 KB)

An improved non-rigid image registration approach

doi: 10.13374/j.issn2095-9389.2019.07.015

School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China

More Information

Corresponding author: HE Kai, E-mail: hekai@tju.edu.cn
Received Date: 2018-05-16
Publish Date: 2019-07-01

Abstract

Abstract

With the rapid development of image registration technology, it is being widely used in the fields of medical image processing, remote sensing image analysis, computer vision, and others. Image registration involves two or more images that contain the same object that are obtained under different conditions. Geometric mapping between images is realized by spatial geometric transformation, so that the points in one image can be related to their corresponding points in the other. Compared with rigid transformations, non-rigid transformations usually have severe local distortions and obvious nonlinear characteristics. So, it is difficult to describe non-rigid transformations using a unified transformation model. For this reason, non-rigid image registration has always been an issue and a source of difficulty in the field of computer vision. To solve this problem, an improved optical-flow-model algorithm was proposed to more accurately estimate the optical flow field. First, the original variational optical flow model was improved. To prevent blurring and preserve the edge and detail features of images, a new anisotropic regular term was proposed to replace the original homologous diffusion term. Then, to remove optical flow outliers, a non-local smoothness term was introduced that contained neighborhood information. Moreover, a weight function that combines image-structure and optical-flow information was added to reduce the loss of detail caused by over-smoothing and to improve robustness. Finally, to solve the displacement field and realize the automatic registration of non-rigid images, an alternating minimization method and pyramid hierarchical iteration strategy were utilized. To verify the effectiveness of the proposed algorithm, subjective and objective evaluation values such as the peak signal-to-noise ratio (PSNR) and normalized mutual information (NMI) were adopted to analyze the registration results. Compared with state-of-the-art methods, experimental results reveal the robustness and ideal registration effects of the proposed method on different types of non-rigid images.
- non-rigid image registration,
- optical flow model,
- anisotropic regularization term,
- non-local smoothness term,
- alternate minimization

FullText(HTML)

References(17)

References

[1]	陳世偉, 張勝修, 楊小岡, 等. 基于橢圓對稱方向矩的可見光與紅外圖像配準算法. 工程科學學報, 2017, 39(7): 1107 https://www.cnki.com.cn/Article/CJFDTOTAL-BJKD201707018.htm Chen S W, Zhang S X, Yang X G, et al. Registration of visual-infrared images based on ellipse symmetrical orientation moment. Chin J Eng, 2017, 39(7): 1107 https://www.cnki.com.cn/Article/CJFDTOTAL-BJKD201707018.htm
[2]	潘博, 賁進, 閆佳雯, 等. 全局約束下超聲圖像微器械輪廓提取方法. 哈爾濱工業大學學報, 2018, 50(1): 24 https://www.cnki.com.cn/Article/CJFDTOTAL-HEBX201801005.htm Pan B, Ben J, Yan J W, et al. Method to extract micro device profile in ultrasound image under global constraints. J Harbin Inst Technol, 2018, 50(1): 24 https://www.cnki.com.cn/Article/CJFDTOTAL-HEBX201801005.htm
[3]	Dellinger F, Delon J, Gousseau Y, et al. SAR-SIFT: a SIFT-like algorithm for SAR images. IEEE Trans Geosci Remote Sens, 2015, 53(1): 453 doi: 10.1109/TGRS.2014.2323552
[4]	Sariyanidi E, Gunes H, Cavallaro A. Automatic analysis of facial affect: a survey of registration, representation, and recognition. IEEE Trans Pattern Anal Mach Intell, 2015, 37(6): 1113 doi: 10.1109/TPAMI.2014.2366127
[5]	Thirion J P. Image matching as a diffusion process: an analogy with Maxwell's demons. Med Image Anal, 1998, 2(3): 243 doi: 10.1016/S1361-8415(98)80022-4
[6]	Horn B K P, Schunck B G. Determining optical flow. Artif Intell, 1981, 17(1-3): 185 doi: 10.1016/0004-3702(81)90024-2
[7]	Nagel H H, Enkelmann W. An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences. IEEE Trans Pattern Anal Mach Intell, 1986, 8(5): 565 doi: 10.1109/TPAMI.1986.4767833
[8]	Brox T, Malik J. Large displacement optical flow: descriptor matching in variational motion estimation. IEEE Trans Pattern Anal Mach Intell, 2011, 33(3): 500 doi: 10.1109/TPAMI.2010.143
[9]	Amiaz T, Lubetzky E, Kiryati N. Coarse to over-fine optical flow estimation. Pattern Recognit, 2007, 40(9): 2496 doi: 10.1016/j.patcog.2006.09.011
[10]	Bao L C, Yang Q X, Jin H L. Fast edge-preserving patch match for large displacement optical flow//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus, 2014: 3534 doi: 10.1109/CVPR.2014.452
[11]	Liu C, Yuen J, Torralba A. SIFT flow: dense correspondence across scenes and its applications. IEEE Trans Pattern Anal Mach Intell, 2011, 33(5): 978 doi: 10.1109/TPAMI.2010.147
[12]	Sun D Q, Roth S, Black M J. A quantitative analysis of current practices in optical flow estimation and the principles behind them. Int J Comput Vision, 2014, 106(2): 115 doi: 10.1007/s11263-013-0644-x
[13]	劉紅彬, 常發亮. 權重系數自適應光流法運動目標檢測. 光學精密工程, 2016, 24(2): 460 https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201602027.htm Liu H B, Chang F L. Moving object detection by optical flow method based on adaptive weight coefficient. Opt Precis Eng, 2016, 24(2): 460 https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201602027.htm
[14]	Revaud J, Weinzaepfel P, Harchaoui Z, et al. EpicFlow: edge-preserving interpolation of correspondences for optical flow//Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition. Boston, 2015: 1164 doi: 10.1109/CVPR.2015.7298720
[15]	李帥, 樊曉光, 許悅雷, 等. 序列圖像運動自適應V1-MT光流估計算法. 工程科學學報, 2017, 39(8): 1238 https://www.cnki.com.cn/Article/CJFDTOTAL-BJKD201708014.htm Li S, Fan X G, Xu Y L, et al. Bio-inspired motion-adaptive estimation algorithm of sequence image. Chin J Eng, 2017, 39(8): 1238 https://www.cnki.com.cn/Article/CJFDTOTAL-BJKD201708014.htm
[16]	Dosovitskiy A, Fischer P, Ilg E, et al. FlowNet: learning optical flow with convolutional networks//Proceedings of the IEEE International Conference on Computer Vision. Santiago, 2015: 2758 https://www.researchgate.net/publication/304409658_FlowNet_Learning_Optical_Flow_with_Convolutional_Networks
[17]	何凱, 閆佳星, 魏穎, 等. 基于改進光流場模型的非剛性圖像配準. 天津大學學報: 自然科學與工程技術版, 2018, 51(5): 491 https://www.cnki.com.cn/Article/CJFDTOTAL-TJDX201805008.htm He K, Yan J X, Wei Y, et al. Non-rigid image registration using improved optical flow field. J Tianjin Univ Sci Technol, 2018, 51(5): 491 https://www.cnki.com.cn/Article/CJFDTOTAL-TJDX201805008.htm