Hybrid multiscale landmark and deformable image registration

  • Received: 01 March 2007 Accepted: 29 June 2018 Published: 01 August 2007
  • MSC : Primary: 68U10; Secondary: 92C55, 62P10, 94A08.

  • An image registration technique is presented for the registration of medical images using a hybrid combination of coarse-scale landmark and B-splines deformable registration techniques. The technique is particularly effective for registration problems in which the images to be registered contain large localized deformations. A brief overview of landmark and deformable registration techniques is presented. The hierarchical multiscale image decomposition of E. Tadmor, S. Nezzar, and L. Vese, A multiscale image representation using hierarchical (BV,L2) decompositions, Multiscale Modeling and Simulations, vol. 2, no. 4, pp. 554--579, 2004, is reviewed, and an image registration algorithm is developed based on combining the multiscale decomposition with landmark and deformable techniques. Successful registration of medical images is achieved by first obtaining a hierarchical multiscale decomposition of the images and then using landmark-based registration to register the resulting coarse scales. Corresponding bony structure landmarks are easily identified in the coarse scales, which contain only the large shapes and main features of the image. This registration is then fine tuned by using the resulting transformation as the starting point to deformably register the original images with each other using an iterated multiscale B-splines deformable registration technique. The accuracy and efficiency of the hybrid technique is demonstrated with several image registration case studies in two and three dimensions. Additionally, the hybrid technique is shown to be very robust with respect to the location of landmarks and presence of noise.

    Citation: Dana Paquin, Doron Levy, Lei Xing. Hybrid multiscale landmark and deformable image registration[J]. Mathematical Biosciences and Engineering, 2007, 4(4): 711-737. doi: 10.3934/mbe.2007.4.711

    Related Papers:

    [1] Dana Paquin, Doron Levy, Lei Xing . Multiscale deformable registration of noisy medical images. Mathematical Biosciences and Engineering, 2008, 5(1): 125-144. doi: 10.3934/mbe.2008.5.125
    [2] Dana Paquin, Doron Levy, Eduard Schreibmann, Lei Xing . Multiscale Image Registration. Mathematical Biosciences and Engineering, 2006, 3(2): 389-418. doi: 10.3934/mbe.2006.3.389
    [3] Liwei Deng, Yuanzhi Zhang, Jingjing Qi, Sijuan Huang, Xin Yang, Jing Wang . Enhancement of cone beam CT image registration by super-resolution pre-processing algorithm. Mathematical Biosciences and Engineering, 2023, 20(3): 4403-4420. doi: 10.3934/mbe.2023204
    [4] Yuan-Nan Young, Doron Levy . Registration-Based Morphing of Active Contours for Segmentation of CT Scans. Mathematical Biosciences and Engineering, 2005, 2(1): 79-96. doi: 10.3934/mbe.2005.2.79
    [5] Xinran Zhang, Yongde Zhang, Jianzhi Yang, Haiyan Du . A prostate seed implantation robot system based on human-computer interactions: Augmented reality and voice control. Mathematical Biosciences and Engineering, 2024, 21(5): 5947-5971. doi: 10.3934/mbe.2024262
    [6] Luca Bertelli, Frédéric Gibou . Fast two dimensional to three dimensional registration of fluoroscopy and CT-scans using Octrees on segmentation maps. Mathematical Biosciences and Engineering, 2012, 9(3): 527-537. doi: 10.3934/mbe.2012.9.527
    [7] Hua Wang, Weiwei Li, Wei Huang, Jiqiang Niu, Ke Nie . Research on land use classification of hyperspectral images based on multiscale superpixels. Mathematical Biosciences and Engineering, 2020, 17(5): 5099-5119. doi: 10.3934/mbe.2020275
    [8] Viliam Ďuriš, Vladimir I. Semenov, Sergey G. Chumarov . Wavelets and digital filters designed and synthesized in the time and frequency domains. Mathematical Biosciences and Engineering, 2022, 19(3): 3056-3068. doi: 10.3934/mbe.2022141
    [9] Tianran Yuan, Hongsheng Zhang, Hao Liu, Juan Du, Huiming Yu, Yimin Wang, Yabin Xu . Watertight 2-manifold 3D bone surface model reconstruction from CT images based on visual hyper-spherical mapping. Mathematical Biosciences and Engineering, 2021, 18(2): 1280-1313. doi: 10.3934/mbe.2021068
    [10] Hilly Gohain Baruah, Vijay Kumar Nath, Deepika Hazarika, Rakcinpha Hatibaruah . Local bit-plane neighbour dissimilarity pattern in non-subsampled shearlet transform domain for bio-medical image retrieval. Mathematical Biosciences and Engineering, 2022, 19(2): 1609-1632. doi: 10.3934/mbe.2022075
  • An image registration technique is presented for the registration of medical images using a hybrid combination of coarse-scale landmark and B-splines deformable registration techniques. The technique is particularly effective for registration problems in which the images to be registered contain large localized deformations. A brief overview of landmark and deformable registration techniques is presented. The hierarchical multiscale image decomposition of E. Tadmor, S. Nezzar, and L. Vese, A multiscale image representation using hierarchical (BV,L2) decompositions, Multiscale Modeling and Simulations, vol. 2, no. 4, pp. 554--579, 2004, is reviewed, and an image registration algorithm is developed based on combining the multiscale decomposition with landmark and deformable techniques. Successful registration of medical images is achieved by first obtaining a hierarchical multiscale decomposition of the images and then using landmark-based registration to register the resulting coarse scales. Corresponding bony structure landmarks are easily identified in the coarse scales, which contain only the large shapes and main features of the image. This registration is then fine tuned by using the resulting transformation as the starting point to deformably register the original images with each other using an iterated multiscale B-splines deformable registration technique. The accuracy and efficiency of the hybrid technique is demonstrated with several image registration case studies in two and three dimensions. Additionally, the hybrid technique is shown to be very robust with respect to the location of landmarks and presence of noise.


  • This article has been cited by:

    1. C. Yan, H. Zhong, M. Murphy, E. Weiss, J. V. Siebers, A pseudoinverse deformation vector field generator and its applications, 2010, 37, 00942405, 1117, 10.1118/1.3301594
    2. Silja Kiriyanthan, Ketut Fundana, Tahir Majeed, Philippe C. Cattin, 2012, Chapter 15, 978-3-642-33611-9, 137, 10.1007/978-3-642-33612-6_15
    3. Feng Yang, Mingyue Ding, Xuming Zhang, Yi Wu, Jiani Hu, Two Phase Non-Rigid Multi-Modal Image Registration Using Weber Local Descriptor-Based Similarity Metrics and Normalized Mutual Information, 2013, 13, 1424-8220, 7599, 10.3390/s130607599
    4. Qiegen Liu, Jianbo Liu, Dong Liang, 2013, Adaptive image decomposition via dictionary learning with stuctural incoherence, 978-1-4799-2341-0, 280, 10.1109/ICIP.2013.6738058
    5. R. Shahidi, C. Moloney, Decorrelating the Structure and Texture Components of a Variational Decomposition Model, 2009, 18, 1057-7149, 299, 10.1109/TIP.2008.2008046
    6. Meysam Siyah Mansoory, Hamid Behnam, Emad Fatemi Zadeh, 2009, Landmark Extraction from Echocardiography Sequence Based on Corner Detection Algorithms Using Product Moment Coefficient Matcher, 978-0-7695-3654-5, 91, 10.1109/ICSPS.2009.67
    7. Ali Uneri, Sajendra Nithiananthan, Sebastian Schafer, Yoshito Otake, J. Webster Stayman, Gerhard Kleinszig, Marc S. Sussman, Jerry L. Prince, Jeffrey H. Siewerdsen, Deformable registration of the inflated and deflated lung in cone-beam CT-guided thoracic surgery: Initial investigation of a combined model- and image-driven approach, 2012, 40, 00942405, 017501, 10.1118/1.4767757
    8. Youbing Yin, Eric A Hoffman, Kai Ding, Joseph M Reinhardt, Ching-Long Lin, A cubic B-spline-based hybrid registration of lung CT images for a dynamic airway geometric model with large deformation, 2011, 56, 0031-9155, 203, 10.1088/0031-9155/56/1/013
    9. Yin Tat Lee, Ka Chun Lam, Lok Ming Lui, Landmark-Matching Transformation with Large Deformation Via n-dimensional Quasi-conformal Maps, 2016, 67, 0885-7474, 926, 10.1007/s10915-015-0113-5
    10. Eitan Tadmor, Hierarchical Construction of Bounded Solutions in Critical Regularity Spaces, 2016, 69, 00103640, 1087, 10.1002/cpa.21575
    11. Mohamed E. Khalifa, Haitham M. Elmessiry, Khaled M. ElBahnasy, Hassan M. M. Ramadan, 2009, Chapter 37, 978-3-540-92840-9, 151, 10.1007/978-3-540-92841-6_37
    12. Yaoqin Xie, Ming Chao, Lei Xing, Tissue Feature-Based and Segmented Deformable Image Registration for Improved Modeling of Shear Movement of Lungs, 2009, 74, 03603016, 1256, 10.1016/j.ijrobp.2009.02.023
    13. Georgios Vlachopoulos, Panayiotis Korfiatis, Spyros Skiadopoulos, Alexandra Kazantzi, Christina Kalogeropoulou, Ioannis Pratikakis, Lena Costaridou, Selecting registration schemes in case of interstitial lung disease follow-up in CT, 2015, 42, 00942405, 4511, 10.1118/1.4923170
    14. Pengwen Chen, Ching-Long Lin, I-Liang Chern, A Perfect Match Condition for Point-Set Matching Problems Using the Optimal Mass Transport Approach, 2013, 6, 1936-4954, 730, 10.1137/12086443X
    15. Stefan Wörz, Karl Rohr, Spline-Based Hybrid Image Registration using Landmark and Intensity Information based on Matrix-Valued Non-radial Basis Functions, 2014, 106, 0920-5691, 76, 10.1007/s11263-013-0642-z
    16. A. Sotiras, C. Davatzikos, N. Paragios, Deformable Medical Image Registration: A Survey, 2013, 32, 0278-0062, 1153, 10.1109/TMI.2013.2265603
    17. Dana Paquin, Doron Levy, Lei Xing, Multiscale registration of planning CT and daily cone beam CT images for adaptive radiation therapy, 2008, 36, 00942405, 4, 10.1118/1.3026602
    18. Youbing Yin, Eric A. Hoffman, Ching-Long Lin, Mass preserving nonrigid registration of CT lung images using cubic B-spline, 2009, 36, 00942405, 4213, 10.1118/1.3193526
    19. Wei Xia, Xin Gao, A fast deformable registration method for 4D lung CT in hybrid framework, 2014, 9, 1861-6410, 523, 10.1007/s11548-013-0960-1
    20. Meysam Siyah Mansoory, Hamid Behnam, Emad Fatemi Zadeh, 2009, Landmark Extraction from Echocardiography Sequence Based on Corner Detection Algorithms Using Gradient Vector Matcher, 978-0-7695-3653-8, 510, 10.1109/IACSIT-SC.2009.29
    21. Klas Modin, Adrian Nachman, Luca Rondi, A multiscale theory for image registration and nonlinear inverse problems, 2019, 346, 00018708, 1009, 10.1016/j.aim.2019.02.014
    22. Fahimeh Mohagheghian, Alireza Ahmadian, Hooshang Saberi, Javad Alirezaie, 2010, Symmetric multi-scale image registration, 978-1-4244-4123-5, 5931, 10.1109/IEMBS.2010.5627551
    23. Edward Castillo, Richard Castillo, Josue Martinez, Maithili Shenoy, Thomas Guerrero, Four-dimensional deformable image registration using trajectory modeling, 2010, 55, 0031-9155, 305, 10.1088/0031-9155/55/1/018
    24. Ka Chun Lam, Lok Ming Lui, Landmark- and Intensity-Based Registration with Large Deformations via Quasi-conformal Maps, 2014, 7, 1936-4954, 2364, 10.1137/130943406
    25. Noémie Debroux, Carole Le Guyader, Luminita A. Vese, 2021, Chapter 10, 978-3-030-75548-5, 115, 10.1007/978-3-030-75549-2_10
    26. Tengfei Wang, Tiancheng He, Zhenglin Zhang, Qi Chen, Liwei Zhang, Guoren Xia, Lizhuang Yang, Hongzhi Wang, Stephen T. C. Wong, Hai Li, A personalized image-guided intervention system for peripheral lung cancer on patient-specific respiratory motion model, 2022, 17, 1861-6429, 1751, 10.1007/s11548-022-02676-2
    27. Chunling Jiang, Yuling Huang, Shenggou Ding, Xiaochang Gong, Xingxing Yuan, Shaobin Wang, Jingao Li, Yun Zhang, Comparison of an in‐house hybrid DIR method to NiftyReg on CBCT and CT images for head and neck cancer, 2022, 23, 1526-9914, 10.1002/acm2.13540
    28. Noémie Debroux, Carole Le Guyader, 2023, Chapter 49, 978-3-031-31974-7, 639, 10.1007/978-3-031-31975-4_49
    29. Noémie Debroux, Carole Le Guyader, Luminita A. Vese, A Multiscale Deformation Representation, 2023, 16, 1936-4954, 802, 10.1137/22M1510200
  • Reader Comments
  • © 2007 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(2884) PDF downloads(487) Cited by(29)

Article outline

Other Articles By Authors

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog