面向医学图像融合的多尺度特征频域分解滤波
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP391

基金项目:

国家自然科学基金(62072274, U22A2033); 中央引导地方科技发展项目(YDZX2022009); 山东省泰山学者特聘专家计划(tstp20221137)


Multi-scale Feature Frequency Domain Decomposition Filtering for Medical Image Fusion
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    多模态医学图像融合技术可以实现不同模态数据反映的组织结构与病变信息的融合, 为后续医疗诊断、手术导航等临床应用提供更为全面和准确的医学图像分析. 针对现有融合方法中存在的部分光谱退化、黏连病变侵袭区域边缘和细节缺失和色彩还原不足等问题, 提出一种在多尺度特征频域分解滤波域内实现图像多特征增强和色彩保留的多模态医学图像融合方法. 该方法将源图像分解为平滑、纹理、轮廓和边缘4个特征层, 分别利用特定融合规则并通过图像重构产生融合结果. 特别地, 鉴于平滑层所含潜在特征信息, 提出视觉显著性分解策略, 多尺度多维度地挖掘平滑层图像能量、部分纤维纹理等特征, 提升源图像信息利用率; 在纹理层中, 提出纹理增强算子, 通过空间结构和信息度量提取细节及其层次信息, 解决现有融合方法中对黏连病变区域侵袭状态难以区分等问题. 此外, 针对缺乏公开腹部数据集的问题, 配准403组腹部图像可供公开访问和下载. 在Atlas公开数据集和腹部数据集上与6种基准方法对比及消融实验结果表明, 所提方法相较于最先进的方法在融合图像与源图像相似度提升22.92%, 边缘保持度提升35.79%, 空间频率提升28.79%, 对比度提升32.92%, 并在视觉和计算效率方面有较好的效果, 明显优于其他方法.

    Abstract:

    Multi-modal medical image fusion provides a more comprehensive and accurate medical image description for medical diagnosis, surgical navigation, and other clinical applications by effectively combining human tissue structure and lesion information reflected by different modal datasets. This study aims to address partial spectral degradation, lack of edges and details and insufficient color reproduction of adhesion lesion-invaded regions in current fusion methods. It proposes a novel multi-modal medical image fusion method to achieve multi-feature enhancement and color preservation in the multi-scale feature frequency domain decomposition filter domain. This method decomposes the source image into four parts: smoothing, texture, contour, and edge feature layers, which employ specific fusion rules and generate fusion results by image reconstruction. In particular, given the potential feature information contained in the smoothing layer, the study proposes a visual saliency decomposition strategy to explore the energy and partial fiber texture features with multi-scale and multi-dimensionality, enhancing the utilization of source image information. In the texture layer, the study introduces a texture enhancement operator to extract details and hierarchical information through spatial structure and information measurement, addressing the issue of distinguishing the invasion status of adherent lesion areas in current fusion methods. In addition, due to the lack of a public abdominal dataset, 403 sets of abdominal images are registered in this study for public access and download. Experiments conducted on public dataset Atlas and abdominal datasets are compared with six baseline methods. Compared to the most advanced methods, the results show that the similarity between the fused image and the source image is improved by 22.92%, the edge retention, spatial frequency, and contrast ratio of fused images are improved by 35.79%, 28.79%, and 32.92%, respectively. In addition, the visual and computing efficiency of the proposed method are better than those of other methods.

    参考文献
    相似文献
    引证文献
引用本文

刘慧,朱积成,王欣雨,盛玉瑞,张彩明,聂礼强.面向医学图像融合的多尺度特征频域分解滤波.软件学报,,():1-23

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-07-13
  • 最后修改日期:2023-09-11
  • 录用日期:
  • 在线发布日期: 2024-03-06
  • 出版日期:
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号