← 开源
Linfeng-Tang

Image-Fusion

Deep Learning-based Image Fusion: A Survey

ListsPaper collectionsMATLAB
在 GitHub 打开
增长势头
+024 小时新增 Star0.0%
1.22k
Star
155
Fork
+0
本周
4
贡献者
创建于 2022-05-01 · 更新于 2026-10-06 · 今日第 11094 名
主要开发者
Linfeng-TangHappyEinsteinHenry-Lee-real
README

图像融合(Image Fusion)

News

🔥 了解完整的论文列表和最新科研动态,请访问我的个人主页:linfeng-tang.github.io/Homepage

[2026-06-02] 我们的论文 DSPFusion: Image Fusion via Degradation and Semantic Dual-Prior Guidance 被 IEEE Transactions on Image Processing (IEEE TIP) 正式接收! [论文下载] [Code]

[2026-02-21] 我们的论文 VideoFusion: A Spatio-Temporal Collaborative Network for Multi-modal Video Fusion 被 The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026) 正式接收! [论文] [arXiv] [Code]

[2025-11-26] 我们的综述 基于深度学习的图像融合方法综述 荣获中国图象图形学报 2020-2024 优秀论文!

[2025-9-18] 我们的论文 ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Prompts 被 Advances in Neural Information Processing Systems (NeurIPS 2025) 正式接收! [论文下载] [Code]

[2025-9-10] 我们的论文 Mask-DiFuser: A Masked Diffusion Model for Unified Unsupervised Image Fusion 被 IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI) 正式接收! [论文下载] [Code]

[2025-3-15] 我们的论文 C2RF: Bridging Multi-modal Image Registration and Fusion via Commonality Mining and Contrastive Learning 被International Journal of Computer Vision (IJCV)正式接收![论文下载] [Code]

[2025-02-11] 我们发布了一个用于红外和可见光视频融合的大规模数据集:M3SVD: Multi-Modal Multi-Scene Video Dataset.

[2024-12-26] 我们的综述 基于深度学习的图像融合方法综述 荣获中国图象图形学报2024优秀论文![《中国图象图形学报》2024年优秀论文公布!][论文下载] [Code]

[2024-11-28] 我们的论文(SeAFusion) Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network 荣获 Information Fusion Best Paper Award 2024 (最佳论文奖)![论文下载] [Code]

[2024-09] 我们的综述 基于深度学习的图像融合方法综述 入选空天信息科技期刊高影响力论文 (全国共14篇)![论文下载] [Code]

[2024-07-16] 我们的论文 DRMF: Degradation-Robust Multi-Modal Image Fusion via Composable Diffusion Prior 被《ACM MM 2024》正式接收![论文下载] [Code]

[2023-06-05] 我们的论文 Rethinking the necessity of image fusion in high-level vision tasks: A practical infrared and visible image fusion network based on progressive semantic injection and scene fidelity 被Information Fusion正式接收![论文下载] [Code]

[2022-07-29] 我们的综述论文 基于深度学习的图像融合方法综述 被《中国图象图形学报》正式接收![论文下载]

Citation

如果我们的总结对你有所帮助, 请引用以下论文:

@article{Tang2024Mask-DiFuser,
  author={Tang, Linfeng and Li, Chunyu and Ma, Jiayi},
  journal={IEEE Transactions on Pattern Analysis and Machine Intelligence}, 
  title={Mask-DiFuser: A Masked Diffusion Model for Unified Unsupervised Image Fusion}, 
  year={2025},
  volume={},
  number={},
  pages={1-18},
 }
@article{Tang2025ControlFusion,
  title={ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Prompts},
  author={Tang, Linfeng and Wang, Yeda and Cai, Zhanchuan and Jiang, Junjun and Ma, Jiayi},
  journal={Advances in Neural Information Processing Systems},
  year={2025}
}

@article{Tang2024C2RF,
	title={C2RF: Bridging Multi-modal Image Registration and Fusion via Commonality Mining and Contrastive Learning}, 
	author={Tang, Linfeng and Yan, Qinglong and Xiang, Xinyu and Fang, Leyuan and Ma, Jiayi},
	journal={International Journal of Computer Vision}, 
	pages={5262--5280},
	volume={133},
	year={2025},
}
@article{Tang2022Survey,
  title={Deep learning-based image fusion: A survey},
  author={Tang, Linfeng and Zhang, Hao and Xu, Han and Ma, Jiayi},  
  journal={Journal of Image and Graphics}
  volume={28},
  number={1},
  pages={3--36},
  year={2023}
}
@inproceedings{Tang2024DRMF,
    title={DRMF: Degradation-Robust Multi-Modal Image Fusion via Composable Diffusion Prior},
    author={Tang, Linfeng and Deng, Yuxin and Yi, Xunpeng and Yan, Qinglong and Yuan, Yixuan and Ma, Jiayi},
    booktitle={Proceedings of the ACM International Conference on Multimedia},
    pages={8546--8555},
    year={2024}
}

1. 红外和可见光图像融合 (Infrared & Visible Image Fusion)

这一部分聚焦于 IVIF,从早期的卷积自编码器和 GAN,到近年来的 Vision-Language、Diffusion 与可控融合框架。

  • 分类说明:
    • 面向视觉融合:侧重低层次视觉质量(细节、对比度、纹理);
    • 语义驱动融合:引入检测/分割/文本等高层任务或语义先验;
    • 联合配准融合:同时学习配准与融合,解决对齐问题;
    • 退化鲁棒融合:针对噪声、模糊、低照度等场景。
方法 论文标题 分类 基础框架 监督范式 发表期刊或会议 年份 论文 代码
MaeFuse MaeFuse: Transferring Omni Features with Pretrained Masked Autoencoders for Infrared and Visible Image Fusion via Guided Training 语义
先验
融合 AE 无
监
督 TIP 2025 Paper Code
ControlFusion ControlFusion: A Controllable Image Fusion Network with Language-Vision Degradation Prompts 语义
驱动
融合 Transformer 无
监
督 NeurIPS 2025 Paper Code
CDTFusion CDTFusion: Crossing Domain and Task for Infrared and Visible Image Fusion 面向
视觉
融合 CNN 无
监
督 TPAMI 2025 Paper Code
DCEvo DCEvo: Discriminative Cross-Dimensional Evolutionary Learning for Infrared and Visible Image Fusion 语义
驱动
融合 CNN 无
监
督 CVPR 2025 Paper Code
Dream-IF Dream-IF: Dynamic Relative EnhAnceMent for Image Fusion 退化
鲁棒
融合 CNN&
Transformer 有
监
督 arXiv 2025 Paper Code
SAGE Every SAMDrop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyond 语义
驱动
融合 CNN 无
监
督 CVPR 2025 Paper Code
FreeFusion FreeFusion: Infrared and Visible Image Fusion via Cross Reconstruction Learning 退化
鲁棒
融合 CNN 有
监
督 TPAMI 2025 Paper Code
FusionBooster FusionBooster: A Unified Image Fusion Boosting Paradigm 语义
驱动
融合 AE 有
监
督 IJCV 2025 Paper Code
MulFS-CAP MulFS-CAP: Multimodal Fusion-Supervised Cross-Modality Alignment Perception for Unregistered Infrared-Visible Image Fusion 语义
驱动
融合 CNN 有
监
督 TPAMI 2025 Paper Code
OCCO OCCO: LVM-Guided Infrared and Visible Image Fusion Framework Based on Object-Aware and Contextual Contrastive Learning 联合
配准
融合 CNN 有
监
督 IJCV 2025 Paper Code
OmniFuse OmniFuse: Composite Degradation-Robust Image Fusion With Language-Driven Semantics 联合
配准
融合 Diffusion
Model 有
监
督 TPAMI 2025 Paper Code
TDFusion Task-driven Image Fusion with Learnable Fusion Loss 语义
驱动
融合 CNN&
Transformer 无
监
督 CVPR 2025 Paper Code
MRFS MRFS: Mutually Reinforcing Image Fusion and Segmentation 语义
驱动
融合 CNN&
Transformer 无
监
督 CVPR 2024 Paper Code
FILM Image Fusion via Vision-Language Model 语义
驱动
融合 CNN&
Transformer 无
监
督 ICML 2024 Paper Code
TC-MoA Task-Customized Mixture of Adapters for General Image Fusion 面向
视觉
融合 Transformer 无
监
督 CVPR 2024 Paper Code
Text-IF Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusion 语义
驱动
融合 Transformer 无
监
督 CVPR 2024 Paper Code
PSFusion Rethinking the necessity of image fusion in high-level vision tasks... 语义
驱动
融合 CNN 无
监
督 InfFus 2023 Paper Code
LRRNet LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Images 面向
视觉
融合 CNN 有
监
督 TPAMI 2023 Paper Code
MURF MURF: Mutually Reinforcing Multi-Modal Image Registration and Fusion 联合
配准
融合 CNN 无
监
督 TPAMI 2023 Paper Code
SegMiF Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentation 语义
驱动
融合 CNN&
Transformer 有
监
督 ICCV 2023 Paper Code
CAMF AMF: An interpretable infrared and visible image fusion network based on class activation mapping 面向
视觉
融合 AE 自
监
督 TMM 2023 Paper Code
PAIF PAIF: Perception-Aware Infrared-Visible Image Fusion for Attack-Tolerant Semantic Segmentation 语义
驱动
融合 CNN 无
监
督 ACM MM 2023 Paper Code
SeAFusion Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network 语义
驱动
融合 CNN 无
监
督 InfFus 2022 Paper Code
TarDAL Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark... 语义
驱动
融合 GAN 无
监
督 CVPR 2022 Paper Code
PIAFusion PIAFusion: A progressive infrared and visible image fusion network based on illumination aware 面向
视觉
融合 CNN 无
监
督 InfFus 2022 Paper Code
CSF Classification Saliency-Based Rule for Visible and Infrared Image Fusion 面向
视觉
融合 AE 无
监
督 TCI 2021 Paper Code
RFN-Nest RFN-Nest: An end-to-end residual fusion network for infrared and visible images 面向
视觉
融合 AE 无
监
督 InfFus 2021 Paper Code
FusionGAN FusionGAN: A generative adversarial network for infrared and visible image fusion 面向
视觉
融合 GAN 无
监
督 InfFus 2019 Paper Code
DenseFuse DenseFuse: A Fusion Approach to Infrared and Visible Images 面向
视觉
融合 AE 无
监
督 TIP 2019 Paper Code

多模图像融合(Multi-Modal Image Fusion)方法汇总

方法 论文标题 分类 基础框架 监督范式 发表期刊或会议 年份 论文 代码
C2RF C2RF: Bridging Multi-modal Image Registration and Fusion via Commonality Mining and Contrastive Learning 联合
配准
融合 CNN 无
监
督 IJCV 2025 Paper Code
MTG‑Fusion Multi-Text Guidance Is Important: Multi-Modality Image Fusion via Large Generative Vision-Language Model 语义
驱动
融合 Diffusion
Model 有
监
督 IJCV 2025 Paper Code
DRMF DRMF: Degradation-Robust Multi-Modal Image Fusion via Composable Diffusion Prior 面向
视觉
融合 Diffusion
Model 无
监
督 ACM MM 2024 Paper Code
IVF-WoReg A Deep Learning Framework for Infrared and Visible Image Fusion Without Strict Registration 联合
配准
融合 CNN 有
监
督 IJCV 2024 Paper Code
CoCoNet CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion 面向
视觉
融合 CNN 无
监
督 IJCV 2024 Paper Code
CCF Conditional Controllable Image Fusion 联合
配准
融合 Diffusion
Model 无
监
督 NeurIPS 2024 Paper Code
ReFusion ReFusion: Learning Image Fusion from Reconstruction with Learnable Loss Via Meta-Learning 面向
视觉
融合 CNN 无
监
督 IJCV 2024 Paper Code
TTD Test-Time Dynamic Image Fusion 面向
视觉
融合 CNN 无
监
督 NeurIPS 2024 Paper Code
CDDFuse CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion 语义
驱动
融合 CNN&
Transformer 无
监
督 CVPR 2023 Paper Code
DDFM DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion 面向
视觉
融合 Diffusion
Model 无
监
督 CVPR 2023 Paper Code
DDcGAN Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators 面向
视觉
融合 GAN 无
监
督 IJCAI 2019 Paper Code

通用图像融合(General Image Fusion)方法汇总

方法 论文标题 场景 基础框架 监督范式 发表期刊或会议 年份 论文 代码
DiTFuse Towards Unified Semantic and Controllable Image Fusion: A Diffusion Transformer Approach 通用
图像
融合 DiT 有
监
督 TPAMI 2026 Paper Code
Mask-DiFuser Mask-DiFuser: A Masked Diffusion Model for Unified Unsupervised Image Fusion 通用
图像
融合 Diffusion
Model 无
监
督 TPAMI 2025 Paper Code
GIFNet One Model for ALL: Low-Level Task Interaction Is a Key to Task-Agnostic Image Fusion 通用
图像
融合 Transformer 有
监
督 CVPR 2025 Paper Code
SwinFusion SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer 通用
图像
融合 Transformer 无
监
督 IEEE/CAA JAS 2022 Paper Code
U2Fusion U2Fusion: A Unified Unsupervised Image Fusion Network 通用
图像
融合 CNN 无
监
督 TPAMI 2022 Paper Code
DeFusion Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion 通用
图像
融合 CNN 无
监
督 ECCV 2022 Paper Code
SDNet SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion 通用
图像
融合 CNN 无
监
督 IJCV 2021 Paper Code
PMGI Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity 通用
图像
融合 CNN 无
监
督 AAAI 2020 Paper Code
IFCNN IFCNN: A general image fusion framework based on convolutional neural network 通用
图像
融合 CNN 有
监
督 InfFus 2020 Paper Code

多模图像融合(Multi-Modal Image Fusion)

红外和可见光图像融合(Infrared and visible image fusion)

方法

标题

论文

代码

发表期刊或会议

基础框架

监督范式

发表年份

DenseFuse

DenseFuse: A Fusion Approach to Infrared and Visible Images

Paper

Code

TIP

AE

自监督

2019

FusionGAN

FusionGAN: A generative adversarial network for infrared and   visible image fusion

Paper

Code

InfFus

GAN

无监督

2019

DDcGAN

Learning a Generative Model for Fusing Infrared and Visible   Images via Conditional Generative Adversarial Network with Dual   Discriminators

Paper

Code

IJCAI

GAN

无监督

2019

NestFuse

NestFuse: An Infrared and Visible Image Fusion Architecture   Based on Nest Connection and Spatial/Channel Attention Models

Paper

Code

TIM

AE

自监督

2020

DDcGAN

DDcGAN: A dual-discriminator conditional generative   adversarial network for multi-resolution image fusion

Paper

Code

TIP

GAN

无监督

2020

DIDFuse

DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusion

Paper

Code

IJCAI

AE

自监督

2020

RFN-Nest

RFN-Nest: An end-to-end residual fusion network for infrared   and visible images

Paper

Code

InfFus

AE

自监督

2021

CSF

Classification Saliency-Based Rule for Visible and Infrared   Image Fusion

Paper

Code

TCI

AE

自监督

2021

DRF

DRF: Disentangled Representation for Visible and Infrared   Image Fusion

Paper

Code

TIM

AE

自监督

2021

SEDRFuse

SEDRFuse: A Symmetric Encoder–Decoder With Residual Block   Network for Infrared and Visible Image Fusion

Paper

Code

TIM

AE

自监督

2021

MFEIF

Learning a Deep Multi-Scale Feature Ensemble and an   Edge-Attention Guidance for Image Fusion

Paper

TCSVT

AE

自监督

2021

Meta-Learning

Different Input Resolutions and Arbitrary Output Resolution: A   Meta Learning-Based Deep Framework for Infrared and Visible Image Fusion

Paper

TIP

CNN

无监督

2021

RXDNFuse

RXDNFuse: A aggregated residual dense network for infrared and   visible image fusion

Paper

Code

InfFus

CNN

无监督

2021

STDFusionNet

STDFusionNet: An Infrared and Visible Image Fusion Network   Based on Salient Target Detection

Paper

Code

TIM

CNN

无监督

2021

D2LE

A Bilevel Integrated Model With Data-Driven Layer Ensemble for   Multi-Modality Image Fusion

Paper

TIP

CNN

无监督

2021

HAF

Searching a Hierarchically Aggregated Fusion Architecture for   Fast Multi-Modality Image Fusion

Paper

Code

ACM MM

CNN

无监督

2021

SDDGAN

Semantic-supervised Infrared and Visible Image Fusion via a   Dual-discriminator Generative Adversarial Network

Paper

Code

TMM

GAN

无监督

2021

Detail-GAN

Infrared and visible image fusion via detail preserving   adversarial learning

Paper

Code

InfFus

GAN

无监督

2021

Perception-GAN

Image fusion based on   generative adversarial network consistent with perception

Paper

Code

InfFus

GAN

无监督

2021

GAN-FM

GAN-FM: Infrared and Visible   Image Fusion Using GAN With Full-Scale Skip Connection and Dual Markovian   Discriminators

Paper

Code

TCI

GAN

无监督

2021

AttentionFGAN

AttentionFGAN: Infrared and Visible Image Fusion Using   Attention-Based Generative Adversarial Networks

Paper

TMM

GAN

无监督

2021

GANMcC

GANMcC: A Generative   Adversarial Network With Multiclassification Constraints for Infrared and   Visible Image Fusion

Paper

Code

TIM

GAN

无监督

2021

MgAN-Fuse

Multigrained Attention Network for Infrared and Visible Image   Fusion

Paper

TIM

GAN

无监督

2021

TC-GAN

Infrared and Visible Image   Fusion via Texture Conditional Generative Adversarial Network

Paper

TCSVT

GAN

无监督

2021

AUIF

Efficient and model-based infrared and visible image fusion via algorithm unrolling

Paper

Code

TCSVT

AE

自监督

2021

TarDAL

Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection

Paper

Code

CVPR

GAN

无监督

2022

RFNet

RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and Fusion

Paper

Code

CVPR

CNN

无监督

2022

SeAFusion

Image fusion in the loop of   high-level vision tasks: A semantic-aware real-time infrared and visible   image fusion network

Paper

Code

InfFus

CNN

无监督

2022

PIAFusion

PIAFusion: A progressive infrared and visible image fusion   network based on illumination aware

Paper

Code

InfFus

CNN

无监督

2022

UMF-CMGR

Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration

Paper

Code

IJCAI

CNN

无监督

2022

DetFusion

DetFusion: A Detection-driven Infrared and Visible Image Fusion Network

Paper

Code

ACM MM

CNN

无监督

2022

DIVFusion

DIVFusion: Darkness-free infrared and visible image fusion

Paper

Code

InfFus

CNN

无监督

2023

PSFusion

Rethinking the necessity of image fusion in high-level vision tasks: A practical infrared and visible image fusion network based on progressive semantic injection and scene fidelity

Paper

Code

InfFus

CNN

无监督

2023

医学图像融合(Medical image fusion)

方法

标题

论文

代码

发表期刊或会议

基础框架

监督范式

年份

CNN

A medical image fusion method based on   convolutional neural networks

Paper

ICIF

CNN

无监督

2017

Zero-LMF

Zero-Learning Fast Medical Image Fusion

Paper

Code

ICIF

CNN

无监督

2019

DDcGAN

Learning a Generative Model for Fusing Infrared and Visible   Images via Conditional Generative Adversarial Network with Dual   Discriminators

Paper

Code

IJCAI

GAN

无监督

2019

GFPPC-GAN

Green Fluorescent Protein and Phase-Contrast   Image Fusion via Generative Adversarial Networks

Paper

CMMM

GAN

无监督

2019

CCN-CP

Multi-modality medical image fusion using convolutional neural   network and contrast pyramid

Paper

Sensors

CNN

无监督

2020

DDcGAN

DDcGAN: A Dual-Discriminator Conditional   Generative Adversarial Network for Multi-Resolution Image Fusion

Paper

Code

TIP

GAN

无监督

2020

MGMDcGAN

Medical Image Fusion Using Multi-Generator   Multi-Discriminator Conditional Generative Adversarial Network

Paper

Code

Access

GAN

无监督

2020

D2LE

A Bilevel Integrated Model With Data-Driven Layer Ensemble for   Multi-Modality Image Fusion

Paper

TIP

CNN

无监督

2021

HAF

Searching a Hierarchically Aggregated Fusion   Architecture for Fast Multi-Modality Image Fusion

Paper

Code

ACM MM

CNN

无监督

2021

EMFusion

EMFusion: An unsupervised enhanced medical   image fusion network

Paper

Code

InfFus

CNN

无监督

2021

DPCN-Fusion

Green Fluorescent Protein and Phase Contrast   Image Fusion Via Detail Preserving Cross Network

Paper

Code

TCI

CNN

无监督

2021

MSPRN

A multiscale residual pyramid attention   network for medical image fusion

Paper

Code

BSPC

CNN

无监督

2021

DCGAN

Medical image fusion method based on dense   block and deep convolutional generative adversarial network

Paper

NCA

GAN

无监督

2021

DILRAN

Edge-Enhanced Dilated Residual Attention Network for Multimodal Medical Image Fusion

Paper

Code

BIBM

CNN

无监督

2024

数字摄影图像融合(Digital Photography Image Fusion)

多曝光图像融合(Multi-exposure image fusion)

方法

标题

论文

代码

发表期刊或会议

基础框架

监督范式

年份

DeepFuse

DeepFuse: A Deep Unsupervised Approach for Exposure Fusion   with Extreme Exposure Image Pairs

Paper

Code

ICCV

CNN

无监督

2017

CNN

Multi-exposure fusion with CNN features

Paper

Code

ICIP

CNN

无监督

2018

MEF-Net

Deep guided learning for fast multi-exposure image fusion

Paper

Code

TIP

CNN

无监督

2020

ICEN

Multi-exposure high dynamic range imaging with informative   content enhanced network

Paper

NC

CNN

无监督

2020

MEF-GAN

MEF-GAN: Multi-Exposure Image Fusion via Generative   Adversarial Networks

Paper

Code

TIP

GAN

无监督

2020

CF-Net

Deep coupled feedback network for joint exposure fusion and   image super-resolutions

Paper

Code

TIP

CNN

无监督

2021

UMEF

Deep unsupervised learning based on color un-referenced loss   functions for multi-exposure image fusion

Paper

Code

InFus

CNN

无监督

2021

PA-AGN

Two exposure fusion using prior-aware generative adversarial   network

Paper

TMM

GAN

无监督

2021

AGAL

Attention-guided Global-local Adversarial Learning for   Detail-preserving Multi-exposure Image Fusion

Paper

Code

TCSVT

GAN

无监督

2022

GANFuse

GANFuse: a novel multi-exposure image fusion method based on   generative adversarial networks

Paper

NCAA

GAN

无监督

2021

DRLF

Automatic Intermediate Generation With Deep Reinforcement   Learning for Robust Two-Exposure Image Fusion

Paper

TNNLS

CNN

无监督

2021

Trans-MEF

TransMEF: A Transformer-Based Multi-Exposure Image Fusion   Framework using Self-Supervised Multi-Task Learning

Paper

Code

AAAI

AE

自监督

2022

DPE-MEF

Multi-exposure image fusion via deep perceptual enhancement

Paper

Code

InFus

CNN

无监督

2022

多聚焦图像融合(Multi-focus image fusion)

方法

标题

论文

代码

发表期刊或会议

基础框架

监督范式

年份

CNN

Multi-focus image fusion with a deep convolutional neural   network

Paper

Code

InFus

CNN

有监督

2017

ECNN

Ensemble of CNN for multi-focus image fusion

Paper

Code

InFus

CNN

有监督

2019

MLFCNN

Multilevel features convolutional neural network for   multifocus image fusion

Paper

TCI

CNN

有监督

2019

DRPL

DRPL: Deep Regression Pair Learning for Multi-Focus Image   Fusion

Paper

Code

TIP

CNN

有监督

2020

MMF-Net

An α-Matte Boundary Defocus Model-Based Cascaded Network for   Multi-Focus Image Fusion

Paper

Code

TCI

CNN

有监督

2020

MFF-SSIM

Towards Reducing Severe Defocus Spread Effects for Multi-Focus   Image Fusion via an Optimization Based Strategy

Paper

Code

Sensors

CNN

无监督

2020

MFNet

Structural Similarity Loss for Learning to Fuse Multi-Focus   Images

Paper

TIP

CNN

有监督

2021

GEU-Net

Global-Feature Encoding U-Net (GEU-Net) for Multi-Focus Image   Fusion [GEU-Net

Paper

Code

TCI

CNN

自监督

2021

DTMNet

DTMNet: A Discrete Tchebichef Moments-Based Deep Neural   Network for Multi-Focus Image Fusion

Paper

TMM

CNN

无监督

2021

SMFuse

SMFuse: Multi-Focus   Image Fusion Via Self-Supervised Mask-Optimization

Paper

Code

NCA

CNN

无监督

2021

ACGAN

A generative adversarial network with adaptive constraints for   multi-focus image fusion

Paper

Code

ICCV

GAN

有监督

2021

FuseGAN

Learning to fuse multi-focus image via conditional generative   adversarial network

Paper

TIP

GAN

有监督

2020

D2FMIF

Depth-Distilled Multi-focus Image Fusion

Paper

TMM

CNN

有监督

2019

SESF-Fuse

SESF-Fuse: an unsupervised deep model for multi-focus image   fusion

Paper

Code

NCAA

CNN

有监督

2020

MFF-GAN

MFF-GAN: An unsupervised generative adversarial network with   adaptive and gradient joint constraints for multi-focus image fusion

Paper

Code

InFus

GAN

无监督

2021

MFIF-GAN

MFIF-GAN: A new generative adversarial network for multi-focus   image fusion

Paper

Code

SPIC

GAN

有监督

2021

遥感影像融合(Remote Sensing Image Fusion)

全色图像锐化(Pansharpening)

方法

标题

论文

代码

发表期刊或会议

基础框架

监督范式

年份

PNN

Pansharpening by Convolutional Neural   Networks

Paper

Code

RS

CNN

有监督

2016

PanNet

PanNet: A deep network architecture for   pan-sharpening

Paper

Code

PanNet

CNN

有监督

2017

TFNet

Remote sensing image fusion based on   two-stream fusion network

Paper

Code

TFNet

CNN

有监督

2020

BKL

Unsupervised Blur Kernel Learning for   Pansharpening

Paper

IGARSS

CNN

无监督

2020

Pan-GAN

Pan-GAN: An unsupervised pan-sharpening   method for remote sensing image fusion

Paper%5d%20%5bCode%5d(https://github.com/yuwei998/PanGAN)

Code

InFus

GAN

无监督

2020

UCNN

Pansharpening via Unsupervised Convolutional   Neural Networks

Paper

JSTARS

CNN

无监督

2020

UPSNet

UPSNet: Unsupervised Pan-Sharpening Network   With Registration Learning Between Panchromatic and Multi-Spectral Images

Paper

ACCESS

CNN

无监督

2020

GPPNN

Deep Gradient Projection Networks for   Pan-sharpening

Paper

Code

CVPR

CNN

有监督

2021

GTP-PNet

GTP-PNet: A residual learning network based   on gradient transformation prior for pansharpening

Paper

Code

ISPRS

CNN

有监督

2021

HMCNN

Pan-Sharpening Via High-Pass Modification   Convolutional Neural Network

Paper

Code

ICIP

CNN

有监督

2021

SDPNet

SDPNet: A Deep Network for Pan-Sharpening   With Enhanced Information Representation

Paper

Code

TGRS

CNN

有监督

2021

SIPSA-Net

SIPSA-Net: Shift-Invariant Pan Sharpening   with Moving Object Alignment for Satellite Imagery

Paper

Code

CVPR

CNN

有监督

2021

SRPPNN

Super-resolution-guided progressive   pansharpening based on a deep convolutional neural network

Paper

Code

TGRS

CNN

有监督

2021

PSGAN

PSGAN: A generative adversarial network for   remote sensing image pan-sharpening

Paper

Code

TGRS

GAN

有监督

2021

MDCNN

MDCNN: multispectral pansharpening based on a   multiscale dilated convolutional neural network

Paper

JRS

CNN

有监督

2021

LDP-Net

LDP-Net: An Unsupervised Pansharpening   Network Based on Learnable Degradation Processes

Paper

Code

Arxiv

CNN

无监督

2021

DIGAN

Pansharpening approach via two-stream detail   injection based on relativistic generative adversarial networks

Paper

ESA

GAN

有监督

2022

DPFN

A Dual-Path Fusion Network for Pan-Sharpening

Paper

Code

TGRS

CNN

有监督

2022

MSGAN

An Unsupervised Multi-scale Generative   Adversarial Network for Remote Sensing Image Pan-Sharpening

Paper

ICMM

GAN

无监督

2022

UCGAN

Unsupervised Cycle-Consistent Generative   Adversarial Networks for Pan Sharpening

Paper

Code

TGRS

GAN

无监督

2022

D2TNet

A ConvLSTM Network with Dual-direction Transfer for Pan-sharpening

Paper

Code

TGRS

CNN

有监督

2022

P2Sharpen

P2Sharpen: A progressive pansharpening network with deep spectral transformation

Paper

Code

INFFus

CNN

有监督

2023

通用图像融合框架(General Image Fusion Framerwork)

方法

标题

论文

代码

发表期刊或会议

基础框架

监督范式

年份

IFCNN

IFCNN: A general image fusion framework based on convolutional   neural network

Paper

Code

InFus

CNN

有监督

2020

FusionDN

FusionDN: A Unified Densely Connected Network for Image   Fusion

Paper

Code

AAAI

CNN

无监督

2020

PMGI

Rethinking the Image Fusion: A Fast Unified Image Fusion   Network based on Proportional Maintenance of Gradient and Intensity

Paper

Code

AAAI

CNN

无监督

2020

CU-Net

Deep Convolutional Neural Network for Multi-Modal Image   Restoration and Fusion

Paper

Code

TPAMI

CNN

有监督

2021

SDNet

SDNet: A Versatile Squeeze-and-Decomposition Network for   Real-Time Image Fusion

Paper

Code

IJCV

CNN

无监督

2021

DIF-Net

Unsupervised Deep Image Fusion With Structure Tensor   Representations

Paper

Code

TIP

CNN

无监督

2021

IFSepR

IFSepR: A general framework for image fusion based on separate   representation learning

Paper

TMM

AE

自监督

2021

MTOE

Multiple Task-Oriented Encoders for Unified Image Fusion

Paper

ICME

CNN

无监督

2021

U2Fusion

U2Fusion: A Unified Unsupervised Image Fusion Network

Paper

Code

TPAMI

CNN

无监督

2022

SwinFusion

SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer

Paper

Code

JAS

Transformer

无监督

2022

DeFusion

Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion

Paper

Code

ECCV

CNN

无监督

2022

UIFGAN

UIFGAN: An unsupervised continual-learning generative adversarial network for unified image fusion

Paper

Code

INFFus

GAN

无监督

2023

综述(Survey)

标题

论文

代码

发表期刊或会议

年份

A review of   remote sensing image fusion methods

Paper

InFus

2016

Pixel-level   image fusion: A survey of the state of the art

Paper

InFus

2017

Deep learning for pixel-level image fusion: Recent advances and future prospects

Paper

InFus

2018

Infrared and visible image fusion methods and applications: A survey

Paper

InFus

2019

Multi-focu image fusion: A Survey of the state of the art

Paper

InFus

2020

Image fusion meets deep learning: A survey and perspective

Paper

InFus

2021

Deep Learning-based Multi-focus Image Fusion: A Survey and A Comparative   Study

Paper

Code

TPAMI

2021

Benchmarking and comparing multi-exposure image fusion algorithms

Paper

Code

InFus

2021

Current advances and future perspectives of image fusion: A comprehensive review

Paper

Code

InFus

2023

数据集(Dataset)

融合场景

数据集

下载链接

红外和可见光图像融合

TNO

https://figshare.com/articles/dataset/TNO_Image_Fusion_Dataset/1008029

INO

https://www.ino.ca/en/technologies/video-analytics-dataset/videos/

RoadScene

https://github.com/hanna-xu/RoadScene

MSRS

https://github.com/Linfeng-Tang/MSRS

LLVIP

https://bupt-ai-cz.github.io/LLVIP/

M3FD

https://github.com/JinyuanLiu-CV/TarDAL

医学图像融合

Harvard

http://www.med.harvard.edu/AANLIB/home.html

多曝光图像融合

MEF

https://github.com/csjcai/SICE

MEFB

https://github.com/xingchenzhang/MEFB

多聚焦图像融合

Lytro

https://mansournejati.ece.iut.ac.ir/content/lytro-multi-focus-dataset

MFI-WHU

https://github.com/HaoZhang1018/MFI-WHU

MFFW

https://www.semanticscholar.org/paper/MFFW%3A-A-new-dataset-for-multi-focus-image-fusion-Xu-Wei/4c0658f338849284ee4251a69b3c323908e62b45

全色图像锐化

GaoFen

https://directory.eoportal.org/web/eoportal/satellite-missions/g

WorldView

https://worldview.earthdata.nasa.gov/

GeoEye

https://earth.esa.int/eogateway/missions/geoeye-1

QuickBird

https://www.satimagingcorp.com/satellite-sensors/quickbird/

评估指标(Evaluation Metric)

通用评估指标(General evaluation metric)

通用评估指标位于:https://github.com/Linfeng-Tang/Image-Fusion/tree/main/General Evaluation Metric or https://github.com/Linfeng-Tang/Evaluation-for-Image-Fusion

遥感影像融合评估指标(Evaluation metric for pansharpening)

Citation

如果我们的总结对你有所帮助, 请引用以下论文:

@article{Tang2022Survey,
  title={Deep learning-based image fusion: A survey},
  author={Tang, Linfeng and Zhang, Hao and Xu, Han and Ma, Jiayi},  
  journal={Journal of Image and Graphics}
}
@article{Ma2022SwinFusion,
  title={SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer},
  author={Ma, Jiayi and Tang, Linfeng and Fan, Fan and Huang, Jun and Mei, Xiaoguang and Ma, Yong},
  journal={IEEE/CAA Journal of Automatica Sinica},
  volume={9},
  number={7},
  pages={1200--1217},
  year={2022},
  publisher={IEEE}
}
@article{TANG2022SeAFusion,
title = {Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network},
author = {Linfeng Tang and Jiteng Yuan and Jiayi Ma},
journal = {Information Fusion},
volume = {82},
pages = {28-42},
year = {2022},
issn = {1566-2535},
publisher={Elsevier}
}
@article{Tang2022PIAFusion,
  title={PIAFusion: A progressive infrared and visible image fusion network based on illumination aware},
  author={Tang, Linfeng and Yuan, Jiteng and Zhang, Hao and Jiang, Xingyu and Ma, Jiayi},
  journal={Information Fusion},
  volume = {83-84},
  pages = {79-92},
  year = {2022},
  issn = {1566-2535},
  publisher={Elsevier}
}
@article{Tang2022DIVFusion,
  title={DIVFusion: Darkness-free infrared and visible image fusion},
  author={Tang, Linfeng and Xiang, Xinyu and Zhang, Hao and Gong, Meiqi and Ma, Jiayi},
  journal={Information Fusion},
  volume = {91},
  pages = {477-493},
  year = {2023},
  publisher={Elsevier}
}
@article{ma2021STDFusionNet,
  title={STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection},
  author={Jiayi Ma, Linfeng Tang, Meilong Xu, Hao Zhang, and Guobao Xiao},
  journal={IEEE Transactions on Instrumentation and Measurement},
  year={2021},
  volume={70},
  number={},
  pages={1-13},
  doi={10.1109/TIM.2021.3075747},
  publisher={IEEE}
}

如果有任何问题请联系:linfeng0419@gmail.com

排名相邻
同类项目