图像融合(Image Fusion)
News
🔥 了解完整的论文列表和最新科研动态,请访问我的个人主页:linfeng-tang.github.io/Homepage
[2026-06-02] 我们的论文 DSPFusion: Image Fusion via Degradation and Semantic Dual-Prior Guidance 被 IEEE Transactions on Image Processing (IEEE TIP) 正式接收! [论文下载] [Code]
[2026-02-21] 我们的论文 VideoFusion: A Spatio-Temporal Collaborative Network for Multi-modal Video Fusion 被 The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026) 正式接收! [论文] [arXiv] [Code]
[2025-11-26] 我们的综述 基于深度学习的图像融合方法综述 荣获中国图象图形学报 2020-2024 优秀论文!
[2025-9-18] 我们的论文 ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Prompts 被 Advances in Neural Information Processing Systems (NeurIPS 2025) 正式接收! [论文下载] [Code]
[2025-9-10] 我们的论文 Mask-DiFuser: A Masked Diffusion Model for Unified Unsupervised Image Fusion 被 IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI) 正式接收! [论文下载] [Code]
[2025-3-15] 我们的论文 C2RF: Bridging Multi-modal Image Registration and Fusion via Commonality Mining and Contrastive Learning 被International Journal of Computer Vision (IJCV)正式接收![论文下载] [Code]
[2025-02-11] 我们发布了一个用于红外和可见光视频融合的大规模数据集:M3SVD: Multi-Modal Multi-Scene Video Dataset.
[2024-12-26] 我们的综述 基于深度学习的图像融合方法综述 荣获中国图象图形学报2024优秀论文![《中国图象图形学报》2024年优秀论文公布!][论文下载] [Code]
[2024-11-28] 我们的论文(SeAFusion) Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network 荣获 Information Fusion Best Paper Award 2024 (最佳论文奖)![论文下载] [Code]
[2024-09] 我们的综述 基于深度学习的图像融合方法综述 入选空天信息科技期刊高影响力论文 (全国共14篇)![论文下载] [Code]
[2024-07-16] 我们的论文 DRMF: Degradation-Robust Multi-Modal Image Fusion via Composable Diffusion Prior 被《ACM MM 2024》正式接收![论文下载] [Code]
[2023-06-05] 我们的论文 Rethinking the necessity of image fusion in high-level vision tasks: A practical infrared and visible image fusion network based on progressive semantic injection and scene fidelity 被Information Fusion正式接收![论文下载] [Code]
[2022-07-29] 我们的综述论文 基于深度学习的图像融合方法综述 被《中国图象图形学报》正式接收![论文下载]
- Citation
- 多模图像融合(Multi-Modal Image Fusion)
- 数字摄影图像融合(Digital Photography Image Fusion)
- 遥感影像融合(Remote Sensing Image Fusion)
- 通用图像融合框架(General Image Fusion Framerwork)
- 综述(Survey)
- 数据集(Dataset)
- 评估指标(Evaluation Metric)
Citation
如果我们的总结对你有所帮助, 请引用以下论文:
@article{Tang2024Mask-DiFuser,
author={Tang, Linfeng and Li, Chunyu and Ma, Jiayi},
journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
title={Mask-DiFuser: A Masked Diffusion Model for Unified Unsupervised Image Fusion},
year={2025},
volume={},
number={},
pages={1-18},
}
@article{Tang2025ControlFusion,
title={ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Prompts},
author={Tang, Linfeng and Wang, Yeda and Cai, Zhanchuan and Jiang, Junjun and Ma, Jiayi},
journal={Advances in Neural Information Processing Systems},
year={2025}
}
@article{Tang2024C2RF,
title={C2RF: Bridging Multi-modal Image Registration and Fusion via Commonality Mining and Contrastive Learning},
author={Tang, Linfeng and Yan, Qinglong and Xiang, Xinyu and Fang, Leyuan and Ma, Jiayi},
journal={International Journal of Computer Vision},
pages={5262--5280},
volume={133},
year={2025},
}
@article{Tang2022Survey,
title={Deep learning-based image fusion: A survey},
author={Tang, Linfeng and Zhang, Hao and Xu, Han and Ma, Jiayi},
journal={Journal of Image and Graphics}
volume={28},
number={1},
pages={3--36},
year={2023}
}
@inproceedings{Tang2024DRMF,
title={DRMF: Degradation-Robust Multi-Modal Image Fusion via Composable Diffusion Prior},
author={Tang, Linfeng and Deng, Yuxin and Yi, Xunpeng and Yan, Qinglong and Yuan, Yixuan and Ma, Jiayi},
booktitle={Proceedings of the ACM International Conference on Multimedia},
pages={8546--8555},
year={2024}
}
1. 红外和可见光图像融合 (Infrared & Visible Image Fusion)
这一部分聚焦于 IVIF,从早期的卷积自编码器和 GAN,到近年来的 Vision-Language、Diffusion 与可控融合框架。
- 分类说明:
- 面向视觉融合:侧重低层次视觉质量(细节、对比度、纹理);
- 语义驱动融合:引入检测/分割/文本等高层任务或语义先验;
- 联合配准融合:同时学习配准与融合,解决对齐问题;
- 退化鲁棒融合:针对噪声、模糊、低照度等场景。
| 方法 | 论文标题 | 分类 | 基础框架 | 监督范式 | 发表期刊或会议 | 年份 | 论文 | 代码 |
|---|---|---|---|---|---|---|---|---|
| MaeFuse | MaeFuse: Transferring Omni Features with Pretrained Masked Autoencoders for Infrared and Visible Image Fusion via Guided Training | 语义 | ||||||
| 先验 | ||||||||
| 融合 | AE | 无 | ||||||
| 监 | ||||||||
| 督 | TIP | 2025 | Paper | Code | ||||
| ControlFusion | ControlFusion: A Controllable Image Fusion Network with Language-Vision Degradation Prompts | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | Transformer | 无 | ||||||
| 监 | ||||||||
| 督 | NeurIPS | 2025 | Paper | Code | ||||
| CDTFusion | CDTFusion: Crossing Domain and Task for Infrared and Visible Image Fusion | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | TPAMI | 2025 | Paper | Code | ||||
| DCEvo | DCEvo: Discriminative Cross-Dimensional Evolutionary Learning for Infrared and Visible Image Fusion | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | CVPR | 2025 | Paper | Code | ||||
| Dream-IF | Dream-IF: Dynamic Relative EnhAnceMent for Image Fusion | 退化 | ||||||
| 鲁棒 | ||||||||
| 融合 | CNN& | |||||||
| Transformer | 有 | |||||||
| 监 | ||||||||
| 督 | arXiv | 2025 | Paper | Code | ||||
| SAGE | Every SAMDrop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyond | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | CVPR | 2025 | Paper | Code | ||||
| FreeFusion | FreeFusion: Infrared and Visible Image Fusion via Cross Reconstruction Learning | 退化 | ||||||
| 鲁棒 | ||||||||
| 融合 | CNN | 有 | ||||||
| 监 | ||||||||
| 督 | TPAMI | 2025 | Paper | Code | ||||
| FusionBooster | FusionBooster: A Unified Image Fusion Boosting Paradigm | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | AE | 有 | ||||||
| 监 | ||||||||
| 督 | IJCV | 2025 | Paper | Code | ||||
| MulFS-CAP | MulFS-CAP: Multimodal Fusion-Supervised Cross-Modality Alignment Perception for Unregistered Infrared-Visible Image Fusion | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | CNN | 有 | ||||||
| 监 | ||||||||
| 督 | TPAMI | 2025 | Paper | Code | ||||
| OCCO | OCCO: LVM-Guided Infrared and Visible Image Fusion Framework Based on Object-Aware and Contextual Contrastive Learning | 联合 | ||||||
| 配准 | ||||||||
| 融合 | CNN | 有 | ||||||
| 监 | ||||||||
| 督 | IJCV | 2025 | Paper | Code | ||||
| OmniFuse | OmniFuse: Composite Degradation-Robust Image Fusion With Language-Driven Semantics | 联合 | ||||||
| 配准 | ||||||||
| 融合 | Diffusion | |||||||
| Model | 有 | |||||||
| 监 | ||||||||
| 督 | TPAMI | 2025 | Paper | Code | ||||
| TDFusion | Task-driven Image Fusion with Learnable Fusion Loss | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | CNN& | |||||||
| Transformer | 无 | |||||||
| 监 | ||||||||
| 督 | CVPR | 2025 | Paper | Code | ||||
| MRFS | MRFS: Mutually Reinforcing Image Fusion and Segmentation | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | CNN& | |||||||
| Transformer | 无 | |||||||
| 监 | ||||||||
| 督 | CVPR | 2024 | Paper | Code | ||||
| FILM | Image Fusion via Vision-Language Model | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | CNN& | |||||||
| Transformer | 无 | |||||||
| 监 | ||||||||
| 督 | ICML | 2024 | Paper | Code | ||||
| TC-MoA | Task-Customized Mixture of Adapters for General Image Fusion | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | Transformer | 无 | ||||||
| 监 | ||||||||
| 督 | CVPR | 2024 | Paper | Code | ||||
| Text-IF | Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusion | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | Transformer | 无 | ||||||
| 监 | ||||||||
| 督 | CVPR | 2024 | Paper | Code | ||||
| PSFusion | Rethinking the necessity of image fusion in high-level vision tasks... | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | InfFus | 2023 | Paper | Code | ||||
| LRRNet | LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Images | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | CNN | 有 | ||||||
| 监 | ||||||||
| 督 | TPAMI | 2023 | Paper | Code | ||||
| MURF | MURF: Mutually Reinforcing Multi-Modal Image Registration and Fusion | 联合 | ||||||
| 配准 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | TPAMI | 2023 | Paper | Code | ||||
| SegMiF | Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentation | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | CNN& | |||||||
| Transformer | 有 | |||||||
| 监 | ||||||||
| 督 | ICCV | 2023 | Paper | Code | ||||
| CAMF | AMF: An interpretable infrared and visible image fusion network based on class activation mapping | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | AE | 自 | ||||||
| 监 | ||||||||
| 督 | TMM | 2023 | Paper | Code | ||||
| PAIF | PAIF: Perception-Aware Infrared-Visible Image Fusion for Attack-Tolerant Semantic Segmentation | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | ACM MM | 2023 | Paper | Code | ||||
| SeAFusion | Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | InfFus | 2022 | Paper | Code | ||||
| TarDAL | Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark... | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | GAN | 无 | ||||||
| 监 | ||||||||
| 督 | CVPR | 2022 | Paper | Code | ||||
| PIAFusion | PIAFusion: A progressive infrared and visible image fusion network based on illumination aware | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | InfFus | 2022 | Paper | Code | ||||
| CSF | Classification Saliency-Based Rule for Visible and Infrared Image Fusion | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | AE | 无 | ||||||
| 监 | ||||||||
| 督 | TCI | 2021 | Paper | Code | ||||
| RFN-Nest | RFN-Nest: An end-to-end residual fusion network for infrared and visible images | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | AE | 无 | ||||||
| 监 | ||||||||
| 督 | InfFus | 2021 | Paper | Code | ||||
| FusionGAN | FusionGAN: A generative adversarial network for infrared and visible image fusion | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | GAN | 无 | ||||||
| 监 | ||||||||
| 督 | InfFus | 2019 | Paper | Code | ||||
| DenseFuse | DenseFuse: A Fusion Approach to Infrared and Visible Images | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | AE | 无 | ||||||
| 监 | ||||||||
| 督 | TIP | 2019 | Paper | Code |
多模图像融合(Multi-Modal Image Fusion)方法汇总
| 方法 | 论文标题 | 分类 | 基础框架 | 监督范式 | 发表期刊或会议 | 年份 | 论文 | 代码 |
|---|---|---|---|---|---|---|---|---|
| C2RF | C2RF: Bridging Multi-modal Image Registration and Fusion via Commonality Mining and Contrastive Learning | 联合 | ||||||
| 配准 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | IJCV | 2025 | Paper | Code | ||||
| MTG‑Fusion | Multi-Text Guidance Is Important: Multi-Modality Image Fusion via Large Generative Vision-Language Model | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | Diffusion | |||||||
| Model | 有 | |||||||
| 监 | ||||||||
| 督 | IJCV | 2025 | Paper | Code | ||||
| DRMF | DRMF: Degradation-Robust Multi-Modal Image Fusion via Composable Diffusion Prior | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | Diffusion | |||||||
| Model | 无 | |||||||
| 监 | ||||||||
| 督 | ACM MM | 2024 | Paper | Code | ||||
| IVF-WoReg | A Deep Learning Framework for Infrared and Visible Image Fusion Without Strict Registration | 联合 | ||||||
| 配准 | ||||||||
| 融合 | CNN | 有 | ||||||
| 监 | ||||||||
| 督 | IJCV | 2024 | Paper | Code | ||||
| CoCoNet | CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | IJCV | 2024 | Paper | Code | ||||
| CCF | Conditional Controllable Image Fusion | 联合 | ||||||
| 配准 | ||||||||
| 融合 | Diffusion | |||||||
| Model | 无 | |||||||
| 监 | ||||||||
| 督 | NeurIPS | 2024 | Paper | Code | ||||
| ReFusion | ReFusion: Learning Image Fusion from Reconstruction with Learnable Loss Via Meta-Learning | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | IJCV | 2024 | Paper | Code | ||||
| TTD | Test-Time Dynamic Image Fusion | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | NeurIPS | 2024 | Paper | Code | ||||
| CDDFuse | CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion | 语义 | ||||||
| 驱动 | ||||||||
| 融合 | CNN& | |||||||
| Transformer | 无 | |||||||
| 监 | ||||||||
| 督 | CVPR | 2023 | Paper | Code | ||||
| DDFM | DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | Diffusion | |||||||
| Model | 无 | |||||||
| 监 | ||||||||
| 督 | CVPR | 2023 | Paper | Code | ||||
| DDcGAN | Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators | 面向 | ||||||
| 视觉 | ||||||||
| 融合 | GAN | 无 | ||||||
| 监 | ||||||||
| 督 | IJCAI | 2019 | Paper | Code |
通用图像融合(General Image Fusion)方法汇总
| 方法 | 论文标题 | 场景 | 基础框架 | 监督范式 | 发表期刊或会议 | 年份 | 论文 | 代码 |
|---|---|---|---|---|---|---|---|---|
| DiTFuse | Towards Unified Semantic and Controllable Image Fusion: A Diffusion Transformer Approach | 通用 | ||||||
| 图像 | ||||||||
| 融合 | DiT | 有 | ||||||
| 监 | ||||||||
| 督 | TPAMI | 2026 | Paper | Code | ||||
| Mask-DiFuser | Mask-DiFuser: A Masked Diffusion Model for Unified Unsupervised Image Fusion | 通用 | ||||||
| 图像 | ||||||||
| 融合 | Diffusion | |||||||
| Model | 无 | |||||||
| 监 | ||||||||
| 督 | TPAMI | 2025 | Paper | Code | ||||
| GIFNet | One Model for ALL: Low-Level Task Interaction Is a Key to Task-Agnostic Image Fusion | 通用 | ||||||
| 图像 | ||||||||
| 融合 | Transformer | 有 | ||||||
| 监 | ||||||||
| 督 | CVPR | 2025 | Paper | Code | ||||
| SwinFusion | SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer | 通用 | ||||||
| 图像 | ||||||||
| 融合 | Transformer | 无 | ||||||
| 监 | ||||||||
| 督 | IEEE/CAA JAS | 2022 | Paper | Code | ||||
| U2Fusion | U2Fusion: A Unified Unsupervised Image Fusion Network | 通用 | ||||||
| 图像 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | TPAMI | 2022 | Paper | Code | ||||
| DeFusion | Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion | 通用 | ||||||
| 图像 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | ECCV | 2022 | Paper | Code | ||||
| SDNet | SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion | 通用 | ||||||
| 图像 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | IJCV | 2021 | Paper | Code | ||||
| PMGI | Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity | 通用 | ||||||
| 图像 | ||||||||
| 融合 | CNN | 无 | ||||||
| 监 | ||||||||
| 督 | AAAI | 2020 | Paper | Code | ||||
| IFCNN | IFCNN: A general image fusion framework based on convolutional neural network | 通用 | ||||||
| 图像 | ||||||||
| 融合 | CNN | 有 | ||||||
| 监 | ||||||||
| 督 | InfFus | 2020 | Paper | Code |
多模图像融合(Multi-Modal Image Fusion)
红外和可见光图像融合(Infrared and visible image fusion)
方法
标题
论文
代码
发表期刊或会议
基础框架
监督范式
发表年份
DenseFuse
DenseFuse: A Fusion Approach to Infrared and Visible Images
TIP
AE
自监督
2019
FusionGAN
FusionGAN: A generative adversarial network for infrared and visible image fusion
InfFus
GAN
无监督
2019
DDcGAN
Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators
IJCAI
GAN
无监督
2019
NestFuse
NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models
TIM
AE
自监督
2020
DDcGAN
DDcGAN: A dual-discriminator conditional generative adversarial network for multi-resolution image fusion
TIP
GAN
无监督
2020
DIDFuse
DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusion
IJCAI
AE
自监督
2020
RFN-Nest
RFN-Nest: An end-to-end residual fusion network for infrared and visible images
InfFus
AE
自监督
2021
CSF
Classification Saliency-Based Rule for Visible and Infrared Image Fusion
TCI
AE
自监督
2021
DRF
DRF: Disentangled Representation for Visible and Infrared Image Fusion
TIM
AE
自监督
2021
SEDRFuse
SEDRFuse: A Symmetric Encoder–Decoder With Residual Block Network for Infrared and Visible Image Fusion
TIM
AE
自监督
2021
MFEIF
Learning a Deep Multi-Scale Feature Ensemble and an Edge-Attention Guidance for Image Fusion
TCSVT
AE
自监督
2021
Meta-Learning
Different Input Resolutions and Arbitrary Output Resolution: A Meta Learning-Based Deep Framework for Infrared and Visible Image Fusion
TIP
CNN
无监督
2021
RXDNFuse
RXDNFuse: A aggregated residual dense network for infrared and visible image fusion
InfFus
CNN
无监督
2021
STDFusionNet
STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection
TIM
CNN
无监督
2021
D2LE
A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion
TIP
CNN
无监督
2021
HAF
Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion
ACM MM
CNN
无监督
2021
SDDGAN
Semantic-supervised Infrared and Visible Image Fusion via a Dual-discriminator Generative Adversarial Network
TMM
GAN
无监督
2021
Detail-GAN
Infrared and visible image fusion via detail preserving adversarial learning
InfFus
GAN
无监督
2021
Perception-GAN
Image fusion based on generative adversarial network consistent with perception
InfFus
GAN
无监督
2021
GAN-FM
GAN-FM: Infrared and Visible Image Fusion Using GAN With Full-Scale Skip Connection and Dual Markovian Discriminators
TCI
GAN
无监督
2021
AttentionFGAN
AttentionFGAN: Infrared and Visible Image Fusion Using Attention-Based Generative Adversarial Networks
TMM
GAN
无监督
2021
GANMcC
GANMcC: A Generative Adversarial Network With Multiclassification Constraints for Infrared and Visible Image Fusion
TIM
GAN
无监督
2021
MgAN-Fuse
Multigrained Attention Network for Infrared and Visible Image Fusion
TIM
GAN
无监督
2021
TC-GAN
Infrared and Visible Image Fusion via Texture Conditional Generative Adversarial Network
TCSVT
GAN
无监督
2021
AUIF
Efficient and model-based infrared and visible image fusion via algorithm unrolling
TCSVT
AE
自监督
2021
TarDAL
Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection
CVPR
GAN
无监督
2022
RFNet
RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and Fusion
CVPR
CNN
无监督
2022
SeAFusion
Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network
InfFus
CNN
无监督
2022
PIAFusion
PIAFusion: A progressive infrared and visible image fusion network based on illumination aware
InfFus
CNN
无监督
2022
UMF-CMGR
Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration
IJCAI
CNN
无监督
2022
DetFusion
DetFusion: A Detection-driven Infrared and Visible Image Fusion Network
ACM MM
CNN
无监督
2022
DIVFusion
DIVFusion: Darkness-free infrared and visible image fusion
InfFus
CNN
无监督
2023
PSFusion
Rethinking the necessity of image fusion in high-level vision tasks: A practical infrared and visible image fusion network based on progressive semantic injection and scene fidelity
InfFus
CNN
无监督
2023
医学图像融合(Medical image fusion)
方法
标题
论文
代码
发表期刊或会议
基础框架
监督范式
年份
CNN
A medical image fusion method based on convolutional neural networks
ICIF
CNN
无监督
2017
Zero-LMF
Zero-Learning Fast Medical Image Fusion
ICIF
CNN
无监督
2019
DDcGAN
Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators
IJCAI
GAN
无监督
2019
GFPPC-GAN
Green Fluorescent Protein and Phase-Contrast Image Fusion via Generative Adversarial Networks
CMMM
GAN
无监督
2019
CCN-CP
Multi-modality medical image fusion using convolutional neural network and contrast pyramid
Sensors
CNN
无监督
2020
DDcGAN
DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion
TIP
GAN
无监督
2020
MGMDcGAN
Medical Image Fusion Using Multi-Generator Multi-Discriminator Conditional Generative Adversarial Network
Access
GAN
无监督
2020
D2LE
A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion
TIP
CNN
无监督
2021
HAF
Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion
ACM MM
CNN
无监督
2021
EMFusion
EMFusion: An unsupervised enhanced medical image fusion network
InfFus
CNN
无监督
2021
DPCN-Fusion
Green Fluorescent Protein and Phase Contrast Image Fusion Via Detail Preserving Cross Network
TCI
CNN
无监督
2021
MSPRN
A multiscale residual pyramid attention network for medical image fusion
BSPC
CNN
无监督
2021
DCGAN
Medical image fusion method based on dense block and deep convolutional generative adversarial network
NCA
GAN
无监督
2021
DILRAN
Edge-Enhanced Dilated Residual Attention Network for Multimodal Medical Image Fusion
BIBM
CNN
无监督
2024
数字摄影图像融合(Digital Photography Image Fusion)
多曝光图像融合(Multi-exposure image fusion)
方法
标题
论文
代码
发表期刊或会议
基础框架
监督范式
年份
DeepFuse
DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs
ICCV
CNN
无监督
2017
CNN
Multi-exposure fusion with CNN features
ICIP
CNN
无监督
2018
MEF-Net
Deep guided learning for fast multi-exposure image fusion
TIP
CNN
无监督
2020
ICEN
Multi-exposure high dynamic range imaging with informative content enhanced network
NC
CNN
无监督
2020
MEF-GAN
MEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks
TIP
GAN
无监督
2020
CF-Net
Deep coupled feedback network for joint exposure fusion and image super-resolutions
TIP
CNN
无监督
2021
UMEF
Deep unsupervised learning based on color un-referenced loss functions for multi-exposure image fusion
InFus
CNN
无监督
2021
PA-AGN
Two exposure fusion using prior-aware generative adversarial network
TMM
GAN
无监督
2021
AGAL
Attention-guided Global-local Adversarial Learning for Detail-preserving Multi-exposure Image Fusion
TCSVT
GAN
无监督
2022
GANFuse
GANFuse: a novel multi-exposure image fusion method based on generative adversarial networks
NCAA
GAN
无监督
2021
DRLF
Automatic Intermediate Generation With Deep Reinforcement Learning for Robust Two-Exposure Image Fusion
TNNLS
CNN
无监督
2021
Trans-MEF
TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework using Self-Supervised Multi-Task Learning
AAAI
AE
自监督
2022
DPE-MEF
Multi-exposure image fusion via deep perceptual enhancement
InFus
CNN
无监督
2022
多聚焦图像融合(Multi-focus image fusion)
方法
标题
论文
代码
发表期刊或会议
基础框架
监督范式
年份
CNN
Multi-focus image fusion with a deep convolutional neural network
InFus
CNN
有监督
2017
ECNN
Ensemble of CNN for multi-focus image fusion
InFus
CNN
有监督
2019
MLFCNN
Multilevel features convolutional neural network for multifocus image fusion
TCI
CNN
有监督
2019
DRPL
DRPL: Deep Regression Pair Learning for Multi-Focus Image Fusion
TIP
CNN
有监督
2020
MMF-Net
An α-Matte Boundary Defocus Model-Based Cascaded Network for Multi-Focus Image Fusion
TCI
CNN
有监督
2020
MFF-SSIM
Towards Reducing Severe Defocus Spread Effects for Multi-Focus Image Fusion via an Optimization Based Strategy
Sensors
CNN
无监督
2020
MFNet
Structural Similarity Loss for Learning to Fuse Multi-Focus Images
TIP
CNN
有监督
2021
GEU-Net
Global-Feature Encoding U-Net (GEU-Net) for Multi-Focus Image Fusion [GEU-Net
TCI
CNN
自监督
2021
DTMNet
DTMNet: A Discrete Tchebichef Moments-Based Deep Neural Network for Multi-Focus Image Fusion
TMM
CNN
无监督
2021
SMFuse
SMFuse: Multi-Focus Image Fusion Via Self-Supervised Mask-Optimization
NCA
CNN
无监督
2021
ACGAN
A generative adversarial network with adaptive constraints for multi-focus image fusion
ICCV
GAN
有监督
2021
FuseGAN
Learning to fuse multi-focus image via conditional generative adversarial network
TIP
GAN
有监督
2020
D2FMIF
Depth-Distilled Multi-focus Image Fusion
TMM
CNN
有监督
2019
SESF-Fuse
SESF-Fuse: an unsupervised deep model for multi-focus image fusion
NCAA
CNN
有监督
2020
MFF-GAN
MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion
InFus
GAN
无监督
2021
MFIF-GAN
MFIF-GAN: A new generative adversarial network for multi-focus image fusion
SPIC
GAN
有监督
2021
遥感影像融合(Remote Sensing Image Fusion)
全色图像锐化(Pansharpening)
方法
标题
论文
代码
发表期刊或会议
基础框架
监督范式
年份
PNN
Pansharpening by Convolutional Neural Networks
RS
CNN
有监督
2016
PanNet
PanNet: A deep network architecture for pan-sharpening
PanNet
CNN
有监督
2017
TFNet
Remote sensing image fusion based on two-stream fusion network
TFNet
CNN
有监督
2020
BKL
Unsupervised Blur Kernel Learning for Pansharpening
IGARSS
CNN
无监督
2020
Pan-GAN
Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion
Paper%5d%20%5bCode%5d(https://github.com/yuwei998/PanGAN)
InFus
GAN
无监督
2020
UCNN
Pansharpening via Unsupervised Convolutional Neural Networks
JSTARS
CNN
无监督
2020
UPSNet
UPSNet: Unsupervised Pan-Sharpening Network With Registration Learning Between Panchromatic and Multi-Spectral Images
ACCESS
CNN
无监督
2020
GPPNN
Deep Gradient Projection Networks for Pan-sharpening
CVPR
CNN
有监督
2021
GTP-PNet
GTP-PNet: A residual learning network based on gradient transformation prior for pansharpening
ISPRS
CNN
有监督
2021
HMCNN
Pan-Sharpening Via High-Pass Modification Convolutional Neural Network
ICIP
CNN
有监督
2021
SDPNet
SDPNet: A Deep Network for Pan-Sharpening With Enhanced Information Representation
TGRS
CNN
有监督
2021
SIPSA-Net
SIPSA-Net: Shift-Invariant Pan Sharpening with Moving Object Alignment for Satellite Imagery
CVPR
CNN
有监督
2021
SRPPNN
Super-resolution-guided progressive pansharpening based on a deep convolutional neural network
TGRS
CNN
有监督
2021
PSGAN
PSGAN: A generative adversarial network for remote sensing image pan-sharpening
TGRS
GAN
有监督
2021
MDCNN
MDCNN: multispectral pansharpening based on a multiscale dilated convolutional neural network
JRS
CNN
有监督
2021
LDP-Net
LDP-Net: An Unsupervised Pansharpening Network Based on Learnable Degradation Processes
Arxiv
CNN
无监督
2021
DIGAN
Pansharpening approach via two-stream detail injection based on relativistic generative adversarial networks
ESA
GAN
有监督
2022
DPFN
A Dual-Path Fusion Network for Pan-Sharpening
TGRS
CNN
有监督
2022
MSGAN
An Unsupervised Multi-scale Generative Adversarial Network for Remote Sensing Image Pan-Sharpening
ICMM
GAN
无监督
2022
UCGAN
Unsupervised Cycle-Consistent Generative Adversarial Networks for Pan Sharpening
TGRS
GAN
无监督
2022
D2TNet
A ConvLSTM Network with Dual-direction Transfer for Pan-sharpening
TGRS
CNN
有监督
2022
P2Sharpen
P2Sharpen: A progressive pansharpening network with deep spectral transformation
INFFus
CNN
有监督
2023
通用图像融合框架(General Image Fusion Framerwork)
方法
标题
论文
代码
发表期刊或会议
基础框架
监督范式
年份
IFCNN
IFCNN: A general image fusion framework based on convolutional neural network
InFus
CNN
有监督
2020
FusionDN
FusionDN: A Unified Densely Connected Network for Image Fusion
AAAI
CNN
无监督
2020
PMGI
Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity
AAAI
CNN
无监督
2020
CU-Net
Deep Convolutional Neural Network for Multi-Modal Image Restoration and Fusion
TPAMI
CNN
有监督
2021
SDNet
SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion
IJCV
CNN
无监督
2021
DIF-Net
Unsupervised Deep Image Fusion With Structure Tensor Representations
TIP
CNN
无监督
2021
IFSepR
IFSepR: A general framework for image fusion based on separate representation learning
TMM
AE
自监督
2021
MTOE
Multiple Task-Oriented Encoders for Unified Image Fusion
ICME
CNN
无监督
2021
U2Fusion
U2Fusion: A Unified Unsupervised Image Fusion Network
TPAMI
CNN
无监督
2022
SwinFusion
SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
JAS
Transformer
无监督
2022
DeFusion
Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion
ECCV
CNN
无监督
2022
UIFGAN
UIFGAN: An unsupervised continual-learning generative adversarial network for unified image fusion
Code
INFFus
GAN
无监督
2023
综述(Survey)
标题
论文
代码
发表期刊或会议
年份
A review of remote sensing image fusion methods
InFus
2016
Pixel-level image fusion: A survey of the state of the art
InFus
2017
Deep learning for pixel-level image fusion: Recent advances and future prospects
InFus
2018
Infrared and visible image fusion methods and applications: A survey
InFus
2019
Multi-focu image fusion: A Survey of the state of the art
InFus
2020
Image fusion meets deep learning: A survey and perspective
InFus
2021
Deep Learning-based Multi-focus Image Fusion: A Survey and A Comparative Study
TPAMI
2021
Benchmarking and comparing multi-exposure image fusion algorithms
InFus
2021
Current advances and future perspectives of image fusion: A comprehensive review
Code
InFus
2023
数据集(Dataset)
融合场景
数据集
下载链接
红外和可见光图像融合
TNO
https://figshare.com/articles/dataset/TNO_Image_Fusion_Dataset/1008029
INO
https://www.ino.ca/en/technologies/video-analytics-dataset/videos/
RoadScene
https://github.com/hanna-xu/RoadScene
MSRS
https://github.com/Linfeng-Tang/MSRS
LLVIP
https://bupt-ai-cz.github.io/LLVIP/
M3FD
https://github.com/JinyuanLiu-CV/TarDAL
医学图像融合
Harvard
http://www.med.harvard.edu/AANLIB/home.html
多曝光图像融合
MEF
https://github.com/csjcai/SICE
MEFB
https://github.com/xingchenzhang/MEFB
多聚焦图像融合
Lytro
https://mansournejati.ece.iut.ac.ir/content/lytro-multi-focus-dataset
MFI-WHU
https://github.com/HaoZhang1018/MFI-WHU
MFFW
全色图像锐化
GaoFen
https://directory.eoportal.org/web/eoportal/satellite-missions/g
WorldView
https://worldview.earthdata.nasa.gov/
GeoEye
https://earth.esa.int/eogateway/missions/geoeye-1
QuickBird
https://www.satimagingcorp.com/satellite-sensors/quickbird/
评估指标(Evaluation Metric)
通用评估指标(General evaluation metric)
通用评估指标位于:https://github.com/Linfeng-Tang/Image-Fusion/tree/main/General Evaluation Metric or https://github.com/Linfeng-Tang/Evaluation-for-Image-Fusion
遥感影像融合评估指标(Evaluation metric for pansharpening)
Citation
如果我们的总结对你有所帮助, 请引用以下论文:
@article{Tang2022Survey,
title={Deep learning-based image fusion: A survey},
author={Tang, Linfeng and Zhang, Hao and Xu, Han and Ma, Jiayi},
journal={Journal of Image and Graphics}
}
@article{Ma2022SwinFusion,
title={SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer},
author={Ma, Jiayi and Tang, Linfeng and Fan, Fan and Huang, Jun and Mei, Xiaoguang and Ma, Yong},
journal={IEEE/CAA Journal of Automatica Sinica},
volume={9},
number={7},
pages={1200--1217},
year={2022},
publisher={IEEE}
}
@article{TANG2022SeAFusion,
title = {Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network},
author = {Linfeng Tang and Jiteng Yuan and Jiayi Ma},
journal = {Information Fusion},
volume = {82},
pages = {28-42},
year = {2022},
issn = {1566-2535},
publisher={Elsevier}
}
@article{Tang2022PIAFusion,
title={PIAFusion: A progressive infrared and visible image fusion network based on illumination aware},
author={Tang, Linfeng and Yuan, Jiteng and Zhang, Hao and Jiang, Xingyu and Ma, Jiayi},
journal={Information Fusion},
volume = {83-84},
pages = {79-92},
year = {2022},
issn = {1566-2535},
publisher={Elsevier}
}
@article{Tang2022DIVFusion,
title={DIVFusion: Darkness-free infrared and visible image fusion},
author={Tang, Linfeng and Xiang, Xinyu and Zhang, Hao and Gong, Meiqi and Ma, Jiayi},
journal={Information Fusion},
volume = {91},
pages = {477-493},
year = {2023},
publisher={Elsevier}
}
@article{ma2021STDFusionNet,
title={STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection},
author={Jiayi Ma, Linfeng Tang, Meilong Xu, Hao Zhang, and Guobao Xiao},
journal={IEEE Transactions on Instrumentation and Measurement},
year={2021},
volume={70},
number={},
pages={1-13},
doi={10.1109/TIM.2021.3075747},
publisher={IEEE}
}
如果有任何问题请联系:linfeng0419@gmail.com