The Generalised Image Fusion Toolkit (GIFT)

Mueller, Daniel; Maeder, Anthony; O'Shea, Peter1*
1.Philips Healthcare
Abstract

Abstract

Image fusion provides a mechanism to combine multiple images into a single representation to aid human visual perception and image processing tasks. Such algorithms endeavour to create a fused image containing the salient information from each source image, without introducing artefacts or inconsistencies. Image fusion is applicable for numerous fields including: defence systems, remote sensing and geoscience, robotics and industrial engineering, and medical imaging. In the medical imaging domain, image fusion may aid diagnosis and surgical planning tasks requiring the segmentation, feature extraction, and/or visualisation of multi-modal datasets. This paper discusses the implementation of an image fusion toolkit built upon the Insight Toolkit (ITK). Based on an existing architecture, the proposed framework (GIFT) offers a 'plug-and-play' environment for the construction of n-D multi-scale image fusion methods. We give a brief overview of the toolkit design and demonstrate how to construct image fusion algorithms from low-level components (such as multi-scale methods and feature generators). A number of worked examples for medical applications are presented in Appendix A, including quadrature mirror filter discrete wavelet transform (QMF DWT) image fusion.

Keywords

waveletimage fusionmulti-modalITK
Manuscript
Source Code and Data

Source Code and Data

ArticleInsightArticle.cls4.1 KBalgorithm.sty2.2 KBalgorithmic.sty5.4 KBInsightJournal.sty35.1 KBamssymb.sty14.9 KBarticle.cls20.7 KBarticle.bib7.7 KBarticle.pdf819.1 KBarticle.tcp198 Barticle.tex36.3 KBfancyhdr.sty14.4 KBfloatflt.sty10.8 KBfncychap.sty10.1 KBtempMultilevelMultibandImageFilter.ppt29.5 KBMultiscaleFusionFlowDiagram.ppt17 KBgiftArchitecture.ppt24 KBimagesMultilevelMultibandImageFilter.emf77.2 KBMultilevelMultibandImageFilter.eps5.8 MBMultiscaleFusionFlowDiagram.emf42 KBMultiscaleFusionFlowDiagram.eps4.6 MBNLM_P2_S40_ARITHMETIC.png38.5 KBNLM_P2_S40_FUSED.png43.4 KBNLM_P2_S40_MRA.png36.6 KBNLM_P2_S40_T1_PRE.png26.9 KBgiftArchitecture.eps34.9 MBgiftArchitecture.emf99.6 KBtimes.sty857 BCMakeLists.txt3 KBExamplesFusionCMakeLists.txt493 BgiftExampleFusionQmfWavelet1.cxx7.4 KBgiftExampleFusionQmfWavelet2.cxx7.9 KBCMakeLists.txt60 BMultiscaleMethodsCMakeLists.txt295 BgiftExampleMultiscaleQmfWavelet.cxx7 KBRegistrationCMakeLists.txt261 BgiftExampleRegistration.cxx15.9 KBTestingDataBaselineP2_FUSED_1.mhd291 Bcthead1.png192.6 KBP2_FUSED_1.raw5 MBRockinger_Remote_bior2.2_L1.png195.3 KBengine.raw1.7 MBengine.mhd280 BgiftTestQmfWavelet_cthead1.png28.4 KBgiftTestQmfWavelet_cthead1_00.png8.3 KBgiftTestQmfWavelet_cthead1_01.png8.3 KBgiftTestLinearWeightCombiner.png38.1 KBgiftTestQmfWavelet_cthead1_02.png8.2 KBgiftTestQmfWavelet_cthead1_03.png9.5 KBgiftTestQmfWavelet_cthead1_04.png2.5 KBgiftTestQmfWavelet_cthead1_05.png2.6 KBgiftTestQmfWavelet_cthead1_06.png2.4 KBgiftTestQmfWavelet_cthead1_07.png2.6 KBsf4.png51.1 KBgiftDataReadMe.txt216 BInputEngine_027.jpg5.7 KBOctecWSIR1.png160 KBOctecWSIR2.png157.9 KBOctecWSTV1.png239.5 KBOctecWSTV2.png252.8 KBP2_MRA_RESCALE_WL.mhd298 BP2_MRA_RESCALE_WL.raw5 MBP2_MRI_T1_PRE_RESCALE.mhd305 BP2_MRI_T1_PRE_RESCALE.raw7.8 MBP2_T1_PRE_REGISTERED_WL.mhd304 BP2_T1_PRE_REGISTERED_WL.raw5 MBTest_64x64x64.mhd290 BTest_64x64x64.raw256 KBTest_64x64x64_Rotate.mhd297 BTest_64x64x64_Rotate.raw256 KBclockA.png106.2 KBcthead1.png192.6 KBclockB.png94.7 KBcthead1_Wavelet_0.png8.3 KBcthead1_Wavelet_1.png8.3 KBcthead1_wavelet_2.png8.2 KBcthead1_wavelet_3.png9.5 KBengine.mhd280 Bengine.raw1.7 MBmedA.png12.7 KBmedB.png34 KBnaviA.png151.6 KBnaviB.png144.3 KBpeppers_BW.png45.2 KBremoteA.png140.6 KBremoteB.png135 KBsf4.png51.1 KBweight1.png1.4 KBweight3.PNG1.3 KBweight2.PNG1.9 KBCMakeLists.txt5.9 KBgiftTestFeatureGenerators.cxx8.9 KBgiftTestImageFusionFilter.cxx7.7 KBgiftTestWaveletOperator.cxx15.7 KBgiftTestQmfWaveletImageFilter.cxx11.5 KBgiftTestWeightCombiners.cxx4.9 KBgiftTestWeightGenerators.cxx4.1 KBgiftTests.cxx1.2 KBSourceCMakeLists.txt1.6 KBgiftAbsSampleActivity.cxx2.4 KBgiftAbsSampleActivity.h3.7 KBgiftAverageFeature.cxx4.6 KBgiftAverageFeature.h2.7 KBgiftBiorthogonalWaveletOperator.cxx27 KBgiftBiorthogonalWaveletOperator.h6.3 KBgiftDownsampleImageFilter.cxx7.2 KBgiftDownsampleImageFilter.h5 KBgiftFeatureGenerator.cxx1.3 KBgiftFeatureGenerator.h2.8 KBgiftImageFusionFilter.cxx14.8 KBgiftImageFusionFilter.h7.2 KBgiftLinearWeightCombiner.h3 KBgiftLinearWeightCombiner.cxx4.9 KBgiftMaximumWindowSampleActivity.cxx2.8 KBgiftMaximumWindowSampleActivity.h4.6 KBgiftMedianWindowSampleActivity.cxx2.7 KBgiftMedianWindowSampleActivity.h4.7 KBgiftMultilevelMultibandImageFilter.cxx11.7 KBgiftMultilevelMultibandImageFilter.h11.7 KBgiftQmfWaveletImageFilter.cxx22.3 KBgiftQmfWaveletImageFilter.h6.1 KBgiftSampleActivity.cxx2.4 KBgiftSampleActivity.h3.7 KBgiftSelectFeature.cxx4.1 KBgiftSelectMaximumFeature.cxx4.6 KBgiftSelectFeature.h2.9 KBgiftSelectMaximumFeature.h2.8 KBgiftUpsampleImageFilter.cxx7.7 KBgiftUpsampleImageFilter.h5 KBgiftWeightCombiner.cxx1.2 KBgiftWeightCombiner.h3.6 KBgiftWeightGenerator.cxx2.3 KBgiftWeightGenerator.h5.4 KBitkMaximumWindowImageFilter.h4.5 KBitkMaximumWindowImageFilter.txx5.8 KBgiftCopyright.txt2 KBgiftIncludeDirectories.cmake1.1 KB

Select a file to preview