高光谱图像超分辨率重建技术研究进展

聂江涛; 张磊; 魏巍; 闫庆森; 丁晨; 陈国超; 张艳宁

doi:10.11834/jig.230038

目标检测与图像重建 | 浏览量 : 0 下载量: 3007 CSCD: 0

PDF
导出
分享
收藏
专辑

高光谱图像超分辨率重建技术研究进展
A survey of hyperspectral image super-resolution method
2023年28卷第6期页码：1685-1697
收稿：2023-01-17，

修回：2023-02-28，

纸质出版：2023-06-16
DOI： 10.11834/jig.230038
稿件说明：

移动端阅览

聂江涛，张磊，魏巍，闫庆森，丁晨，陈国超，张艳宁. 2023. 高光谱图像超分辨率重建技术研究进展. 中国图象图形学报， 28(06):1685-1697 DOI： 10.11834/jig.230038.

Nie Jiangtao， Zhang Lei， Wei Wei， Yan Qingsen， Ding Chen， Chen Guochao， Zhang Yanning. 2023. A survey of hyperspectral image super-resolution method. Journal of Image and Graphics， 28(06):1685-1697 DOI： 10.11834/jig.230038.

摘要

不同于传统图像（如灰度图像、RGB图像等）专注于保存目标场景的空间信息，高光谱图像蕴含丰富的空—谱信息，不仅可以保存目标的空间信息，还可以保存具有高可辨性的光谱信息。因此高光谱图像广泛应用于多种计算机视觉和遥感图像任务中，如目标检测、场景分类和目标追踪等。然而，在高光谱图像获取以及重建过程中仍然存在许多问题与瓶颈。如传统高光谱成像仪器在成像过程中通常会引入噪声，且获得的图像往往具有较低的空间分辨率，极大地影响了高光谱图像的质量，对后续数据分析任务造成了极大的困难。近年来，高光谱图像超分辨率重建技术研究得到了极大的发展，现有超分辨率重建方法可以大致分为两类，一类为空间超分辨率重建方法，可以通过直接提升高光谱图像的空间分辨率来获得高质量高光谱图像；另一类为光谱超分辨率重建方法，可以通过提升高空间分辨率图像的光谱分辨率来生成高质量高光谱图像。本文从高光谱图像超分辨率重建领域的新设计、新方法和应用场景出发，通过综合国内外前沿文献来梳理该领域的主要发展，重点论述高光谱图像超分辨率重建领域的发展现状、前沿动态、热点问题及趋势。

Abstract

Computer vision-oriented hyperspectral images （HSIs） are featured to enrich spatial and spectral information compared to gray and RGB images. It has been developing in such domains like target detection， scene classification， and tracking. However， the HSI imaging technique is challenged for its distortion problems （e.g.， low spatial resolution， noise）. HSI-related super-resolution （SR） methods are proposed to reconstruct high-quality HSIs in terms of a high spectral resolution and spatial resolution （HR）. Current HSI SR methods can be segmented into two categories： spatial SR and spectral SR. The spatial SR method is oriented to reconstruct the target HR HSI via improving the spatial resolution of low-resolution （LR） HSI. It can be subdivided into single image SR and fusion based SR methods further. Single image based SR method can be used to reconstruct the target HSI via directly improving the spatial resolution of LR HSI. However， due to much more spatial information is sacrificed， single image based SR method is challenged to reconstruct effective HSIs. Therefore， to fuse these high quality spatial information into the LR HSIs， extra high spatial homogeneous information is introduced （e.g.， multispectral image （MSI）， RGB）. In this way， the spatial resolution of LR HSI can be improved greatly （e.g.， 8 times， 16 times， and 32 times SR）. The other HSI SR method is focused on the spectral super-resolution method， which can improve the spectral resolution of high spatial resolution images （e.g.， MSI， RGB） and generate the target hyperspectral image. The literature review is focused on the growth of HSI SR methods in relevance to three aspects single image-based， fusion-based， and spectral super-resolution contexts. Each of these three category for HSI SR methods can be further subdivided into two aspects of traditional optimization framework and deep learning based methods. For single image HSI SR， due to the SR problem being an illness inverse problem， traditional optimization framework based single image HSI SR methods is used to develop effective image priors to restrain the SR process. Image priors like low-rank， sparse representation， and non-local features are commonly used in single based HSI SR method， but it still challenged for such problems of manpower and restrictions. For the traditional fusion based method， the core element is to balance the spatial-spectral correlation between HR MSI and LR HSI. It is feasible to split these two images into key components and then re-combine the effective parts of each image. Therefore， multiple schemes are introduced （e.g.， non-negative matrix factorization， coupled tensor factorization） to leverage the key information from HR MSI and LR HSI. In addition， to increase the effectiveness of these decomposition methods， some constraints are required to be introduced （e.g.， sparse， low-rank）. For the traditional spectral resolution method， it is essential to learn how to reconstruct the spectral characteristics from RGB/MSI images. When paired RGB and HSI exist， a promising way is feasible to construct a dictionary （e.g.， sparse dictionary learning） that the mapping relation can be recorded between RGB/MSI images and HSIs. The dictionary learning based spectral super-resolution methods have been developing as well， but it is often challenged to realize more generalization ability for applications. In recent years， deep learning based methods have facilitated much more computer vision tasks， and is beneficial for exploiting the inherent spatial-spectral relations of HSIs. For the single image HSI SR methods， a deep convolution neural network （DCNN） is utilized to learn the mapping process from LR HSI to HR HSI. The DCNN is capable to learn deep image prior from plenty of training samples， which has better representation ability than the heuristic handcrafted image priors （e.g.， low-rank， sparse） to some extent. However， the performance of this kind of method is often restricted by the amount and variety of training samples. Therefore， it is necessary to reconstruct HR HSI from LR HSI in an unsupervised manner， but the robustness of the unsupervised method is still a challenging problem to be resolved. For the deep learning based HSI fusion methods， to extract spatial-spectral information from MSIs and HSIs， an effective design of DCNN frameworks （e.g.， multi-branch， multi-scale， 3D-CNN） are concerned about. However， such problems （e.g.， noise， unknown degeneration， unregistered） are challenged for effective generalization ability of DCNN-based HSI fusion method. To resolve these problems， unsupervised and alternative learning methods are introduced to improve fusion-based generalization ability. The DCNN-unfolding is proposed and the optimal interpretability is demonstrated， and its registration strategy is introduced to improve the robustness further. For the spectral super resolution method， DCNN is demonstrated to model the mapping scheme between RGB/MSI and HR HSI. However， there still some barriers are required to be resolved for DCNN-based spectral super resolution method. For example， most existing spectral super resolution methods can generate HSI only according to its fixed spectral interval or spectrum range. A spectral super resolution framework is required to be linked with generalization ability well in the future. In this study， we will summarize the developing of the HSI SR scope from the perspective of new designs， new methods， and new application scenes.

关键词

Keywords

references

Arad B and Ben-Shahar O . 2016 . Sparse recovery of hyperspectral signal from natural RGB images // Proceedings of the 14th European Conference on Computer Vision . Amsterdam， the Netherlands ： Springer： 19 - 34 ［ DOI： 10.1007/978-3-319-46478-7_2 http://dx.doi.org/10.1007/978-3-319-46478-7_2 ］

Dian R and Li S L . 2019a . Hyperspectral image super-resolution via subspace-based low tensor multi-rank regularization . IEEE Transactions on Image Processing ， 28 （ 10 ）： 5135 - 5146 ［ DOI： 10.1109/TIP.2019.2916734 http://dx.doi.org/10.1109/TIP.2019.2916734 ］

Dian R ， Li S T and Fang L Y . 2019b . Learning a low tensor-train rank representation for hyperspectral image super-resolution . IEEE Transactions on Neural Networks and Learning Systems ， 30 （ 9 ）： 2672 - 2683 ［ DOI： 10.1109/TNNLS.2018.2885616 http://dx.doi.org/10.1109/TNNLS.2018.2885616 ］

Dian R ， Li S T ， Guo A J and Fang L Y . 2018 . Deep hyperspectral image sharpening . IEEE Transactions on Neural Networks and Learning Systems ， 29 （ 11 ）： 5345 - 5355 ［ DOI： 10.1109/TNNLS.2018.2798162 http://dx.doi.org/10.1109/TNNLS.2018.2798162 ］

Dong W S ， Fu F Z ， Shi G M ， Cao X ， Wu J J ， Li G Y and Li X . 2016 . Hyperspectral image super-resolution via non-negative structured sparse representation . IEEE Transactions on Image Processing ， 25 （ 5 ）： 2337 - 2352 ［ DOI： 10.1109/TIP.2016.2542360 http://dx.doi.org/10.1109/TIP.2016.2542360 ］

Fotiadou K ， Tsagkatakis G and Tsakalides P . 2019 . Spectral super resolution of hyperspectral images via coupled dictionary learning . IEEE Transactions on Geoscience and Remote Sensing ， 57 （ 5 ）： 2777 - 2797 ［ DOI： 10.1109/TGRS.2018.2877124 http://dx.doi.org/10.1109/TGRS.2018.2877124 ］

Fu Y ， Zhang T ， Zheng Y Q ， Zhang D B and Huang H . 2022 . Joint camera spectral response selection and hyperspectral image recovery . IEEE Transactions on Pattern Analysis and Machine Intelligence ， 44 （ 1 ）： 256 - 272 ［ DOI： 10.1109/TPAMI.2020.3009999 http://dx.doi.org/10.1109/TPAMI.2020.3009999 ］

Gao L R ， Hong D F ， Yao J ， Zhang B ， Gamba P and Chanussot J . 2021 . Spectral superresolution of multispectral imagery with joint sparse and low-rank learning . IEEE Transactions on Geoscience and Remote Sensing ， 59 （ 3 ）： 2269 - 2280 ［ DOI： 10.1109/TGRS.2020.3000684 http://dx.doi.org/10.1109/TGRS.2020.3000684 ］

Gou S P ， Liu S Z ， Yang S Y and Jiao L C . 2014 . Remote sensing image super-resolution reconstruction based on nonlocal pairwise dictionaries and double regularization . IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing ， 7 （ 12 ）： 4784 - 4792 ［ DOI： 10.1109/JSTARS.2014.2328596 http://dx.doi.org/10.1109/JSTARS.2014.2328596 ］

Han X H ， Shi B X and Zheng Y Q . 2018 . SSF-CNN： spatial and spectral fusion with CNN for hyperspectral image super-resolution // Proceedings of the 25th IEEE International Conference on Image Processing （ICIP） . Athens， Greece ： IEEE： 2506 - 2510 ［ DOI： 10.1109/ICIP.2018.8451142 http://dx.doi.org/10.1109/ICIP.2018.8451142 ］

Han X H ， Zheng Y Q and Chen Y W . 2019 . Multi-level and multi-scale spatial and spectral fusion CNN for hyperspectral image super-resolution // Proceedings of 2019 IEEE/CVF International Conference on Computer Vision Workshop . Seoul， Korea （South）： IEEE： 4330 - 4339 ［ DOI： 10.1109/ICCVW.2019.00533 http://dx.doi.org/10.1109/ICCVW.2019.00533 ］

Hang R L ， Liu Q S and Li Z . 2021 . Spectral super-resolution network guided by intrinsic properties of hyperspectral imagery . IEEE Transactions on Image Processing ， 30 ： 7256 - 7265 ［ DOI： 10.1109/TIP.2021.3104177 http://dx.doi.org/10.1109/TIP.2021.3104177 ］

He W ， Chen Y ， Yokoya N ， Li C and Zhao Q B . 2022 . Hyperspectral super-resolution via coupled tensor ring factorization . Pattern Recognition ， 122 ： # 108280 ［ DOI： 10.1016/j.patcog.2021.108280 http://dx.doi.org/10.1016/j.patcog.2021.108280 ］

Hu J ， Jia X P ， Li Y S ， He G and Zhao M H . 2020 . Hyperspectral image super-resolution via intrafusion network . IEEE Transactions on Geoscience and Remote Sensing ， 58 （ 10 ）： 7459 - 7471 ［ DOI： 10.1109/TGRS.2020.2982940 http://dx.doi.org/10.1109/TGRS.2020.2982940 ］

Huang H J ， Christodoulou A G and Sun W D . 2014a . Super-resolution hyperspectral imaging with unknown blurring by low-rank and group-sparse modeling // Proceedings of 2014 IEEE International Conference on Image Processing . Paris， France ： IEEE： 2155 - 2159 ［ DOI： 10.1109/ICIP.2014.7025432 http://dx.doi.org/10.1109/ICIP.2014.7025432 ］

Huang H J ， Yu J and Sun W D . 2014b . Super-resolution mapping via multi-dictionary based sparse representation // Proceedings of 2014 IEEE International Conference on Acoustics， Speech and Signal Processing . Florence， Italy ： IEEE： 3523 - 3527 ［ DOI： 10.1109/ICASSP.2014.6854256 http://dx.doi.org/10.1109/ICASSP.2014.6854256 ］

Kanatsoulis C I ， Fu X ， Sidiropoulos N D and Ma W K . 2018 . Hyperspectral super-resolution： a coupled tensor factorization approach . IEEE Transactions on Signal Processing ， 66 （ 24 ）： 6503 - 6517 ［ DOI： 10.1109/TSP.2018.2876362 http://dx.doi.org/10.1109/TSP.2018.2876362 ］

Lanaras C ， Baltsavias E and Schindler K . 2015 . Hyperspectral super-resolution by coupled spectral unmixing // Proceedings of 2015 IEEE International Conference on Computer Vision . Santiago， Chile ： IEEE： 3586 - 3594 ［ DOI： 10.1109/ICCV.2015.409 http://dx.doi.org/10.1109/ICCV.2015.409 ］

Li J ， Yuan Q Q ， Shen H F ， Meng X C and Zhang L P . 2016 . Hyperspectral image super-resolution by spectral mixture analysis and spatial-spectral group sparsity . IEEE Geoscience and Remote Sensing Letters ， 13 （ 9 ）： 1250 - 1254 ［ DOI： 10.1109/LGRS.2016.2579661 http://dx.doi.org/10.1109/LGRS.2016.2579661 ］

Li J J ， Cui R X ， Li B ， Song R ， Li Y S ， Dai Y C and Du Q . 2020a . Hyperspectral image super-resolution by band attention through adversarial learning . IEEE Transactions on Geoscience and Remote Sensing ， 58 （ 6 ）： 4304 - 4318 ［ DOI： 10.1109/TGRS.2019.2962713 http://dx.doi.org/10.1109/TGRS.2019.2962713 ］

Li J J ， Du S C ， Song R ， Wu C X ， Li Y S and Du Q . 2022 . HASIC-net： hybrid attentional convolutional neural network with structure information consistency for spectral super-resolution of RGB images . IEEE Transactions on Geoscience and Remote Sensing ， 60 ： # 5522515 ［ DOI： 10.1109/TGRS.2022.3142258 http://dx.doi.org/10.1109/TGRS.2022.3142258 ］

Li J J ， Wu C X ， Song R ， Li Y S and Liu F . 2020b . Adaptive weighted attention network with camera spectral sensitivity prior for spectral reconstruction from RGB images // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops . Seattle， USA ： IEEE： 1894 - 1903 ［ DOI： 10.1109/CVPRW50498.2020.00239 http://dx.doi.org/10.1109/CVPRW50498.2020.00239 ］

Li J J ， Wu C X ， Song R ， Xie W Y ， Ge C R ， Li B and Li Y S . 2021a . Hybrid 2-D–3-D deep residual attentional network with structure tensor constraints for spectral super-resolution of RGB images . IEEE Transactions on Geoscience and Remote Sensing ， 59 （ 3 ）： 2321 - 2335 ［ DOI： 10.1109/TGRS.2020.3004934 http://dx.doi.org/10.1109/TGRS.2020.3004934 ］

Li Q ， Wang Q and Li X L . 2020c . Mixed 2D/3D convolutional network for hyperspectral image super-resolution . Remote Sensing ， 12 （ 10 ）： # 1660 ［ DOI： 10.3390/rs12101660 http://dx.doi.org/10.3390/rs12101660 ］

Li Q ， Wang Q and Li X L . 2021b . Exploring the relationship between 2D/3D convolution for hyperspectral image super-resolution . IEEE Transactions on Geoscience and Remote Sensing ， 59 （ 10 ）： 8693 - 8703 ［ DOI： 10.1109/TGRS.2020.3047363 http://dx.doi.org/10.1109/TGRS.2020.3047363 ］

Li S T ， Dian R ， Fang L Y and Bioucas-Dias J M . 2018 . Fusing hyperspectral and multispectral images via coupled sparse tensor factorization . IEEE Transactions on Image Processing ， 27 （ 8 ）： 4118 - 4130 ［ DOI： 10.1109/TIP.2018.2836307 http://dx.doi.org/10.1109/TIP.2018.2836307 ］

Li X S ， Zhang Y Q ， Ge Z X ， Cao G ， Shi H and Fu P . 2021c . Adaptive nonnegative sparse representation for hyperspectral image super-resolution . IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing ， 14 ： 4267 - 4283 ［ DOI： 10.1109/JSTARS.2021.3072044 http://dx.doi.org/10.1109/JSTARS.2021.3072044 ］

Liu D H ， Li J and Yuan Q Q . 2021 . A spectral grouping and attention-driven residual dense network for hyperspectral image super-resolution . IEEE Transactions on Geoscience and Remote Sensing ， 59 （ 9 ）： 7711 - 7725 ［ DOI： 10.1109/TGRS.2021.3049875 http://dx.doi.org/10.1109/TGRS.2021.3049875 ］

Liu J J ， Wu Z B ， Xiao L ， Sun J and Yan H . 2020 . A truncated matrix decomposition for hyperspectral image super-resolution . IEEE Transactions on Image Processing ， 29 ： 8028 - 8042 ［ DOI： 10.1109/TIP.2020.3009830 http://dx.doi.org/10.1109/TIP.2020.3009830 ］

Liu J J ， Wu Z B ， Xiao L and Wu X J . 2022a . Model inspired autoencoder for unsupervised hyperspectral image super-resolution . IEEE Transactions on Geoscience and Remote Sensing ， 60 ： # 5522412 ［ DOI： 10.1109/TGRS.2022.3143156 http://dx.doi.org/10.1109/TGRS.2022.3143156 ］

Liu L Q ， Li W Y ， Shi Z W and Zou Z X . 2022b . Physics-informed hyperspectral remote sensing image synthesis with deep conditional generative adversarial networks . IEEE Transactions on Geoscience and Remote Sensing ， 60 ： # 5528215 ［ DOI： 10.1109/TGRS.2022.3173532 http://dx.doi.org/10.1109/TGRS.2022.3173532 ］

Ma Q ， Jiang J J ， Liu X M and Ma J Y . 2021 . Learning a 3D-CNN and transformer prior for hyperspectral image super-resolution ［EB/OL］. ［ 2023-01-02 ］. https://arxiv.org/pdf/2111.13923.pdf https://arxiv.org/pdf/2111.13923.pdf

Mei S H ， Jiang R T ， Li X and Du Q . 2020 . Spatial and spectral joint super-resolution using convolutional neural network . IEEE Transactions on Geoscience and Remote Sensing ， 58 （ 7 ）： 4590 - 4603 ［ DOI： 10.1109/TGRS.2020.2964288 http://dx.doi.org/10.1109/TGRS.2020.2964288 ］

Mei S H ， Yuan X ， Ji J Y ， Zhang Y F ， Wan S and Du Q . 2017 . Hyperspectral image spatial super-resolution via 3D full convolutional neural network . Remote Sensing ， 9 （ 11 ）： # 1139 ［ DOI： 10.3390/rs9111139 http://dx.doi.org/10.3390/rs9111139 ］

Nie J T ， Zhang L ， Wei W ， Ding C and Zhang Y N . 2020 . Unsupervised deep hyperspectral super-resolution with unregistered images // Proceedings of 2020 IEEE International Conference on Multimedia and Expo （ICME） . London， UK ： IEEE： 1 - 6 ［ DOI： 10.1109/ICME46284.2020.9102881 http://dx.doi.org/10.1109/ICME46284.2020.9102881 ］

Palsson F ， Sveinsson J R and Ulfarsson M O . 2017 . Multispectral and hyperspectral image fusion using a 3-D-convolutional neural network . IEEE Geoscience and Remote Sensing Letters ， 14 （ 5 ）： 639 - 643 ［ DOI： 10.1109/LGRS.2017.2668299 http://dx.doi.org/10.1109/LGRS.2017.2668299 ］

Qu Y ， Qi H R and Kwan C . 2018 . Unsupervised sparse dirichlet-net for hyperspectral image super-resolution // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Salt Lake City， USA ： IEEE： 2511 - 2520 ［ DOI： 10.1109/CVPR.2018.00266 http://dx.doi.org/10.1109/CVPR.2018.00266 ］

Qu Y ， Qi H R ， Kwan C ， Yokoya N and Chanussot J . 2021 . Unsupervised and unregistered hyperspectral image super-resolution with mutual Dirichlet-net . IEEE Transactions on Geoscience and Remote Sensing ， 60 ： # 5507018 ［ DOI： 10.1109/TGRS.2021.3079518 http://dx.doi.org/10.1109/TGRS.2021.3079518 ］

Wan W ， Guo W H ， Huang H Y and Liu J . 2020 . Nonnegative and nonlocal sparse tensor factorization-based hyperspectral image super-resolution . IEEE Transactions on Geoscience and Remote Sensing ， 58 （ 12 ）： 8384 - 8394 ［ DOI： 10.1109/TGRS.2020.2987530 http://dx.doi.org/10.1109/TGRS.2020.2987530 ］

Wei W ， Nie J T ， Li Y ， Zhang L and Zhang Y N . 2020 . Deep recursive network for hyperspectral image super-resolution . IEEE Transactions on Computational Imaging ， 6 ： 1233 - 1244 ［ DOI： 10.1109/TCI.2020.3014451 http://dx.doi.org/10.1109/TCI.2020.3014451 ］

Wei W ， Nie J T ， Zhang L and Zhang Y N . 2021 . Unsupervised recurrent hyperspectral imagery super-resolution using pixel-aware refinement . IEEE Transactions on Geoscience and Remote Sensing ， 60 ： # 5500315 ［ DOI： 10.1109/TGRS.2020.3039534 http://dx.doi.org/10.1109/TGRS.2020.3039534 ］

Wu R Y ， Ma W K ， Fu X and Li Q . 2020 . Hyperspectral super-resolution via global-local low-rank matrix estimation . IEEE Transactions on Geoscience and Remote Sensing ， 58 （ 10 ）： 7125 - 7140 ［ DOI： 10.1109/TGRS.2020.2979908 http://dx.doi.org/10.1109/TGRS.2020.2979908 ］

Xie Q ， Zhou M H ， Zhao Q ， Xu Z B and Meng D Y . 2022 . MHF-Net： an interpretable deep network for multispectral and hyperspectral image fusion . IEEE Transactions on Pattern Analysis and Machine Intelligence ， 44 （ 3 ）： 1457 - 1473 ［ DOI： 10.1109/TPAMI.2020.3015691 http://dx.doi.org/10.1109/TPAMI.2020.3015691 ］

Xie S ， Sun C ， Huang J ， Tu Z W and Murphy K . 2018 . Rethinking spatiotemporal feature learning： speed-accuracy trade-offs in video classification // Proceedings of the 15th European Conference on Computer Vision . Munich， Germany ： Springer： 318 - 335 ［ DOI： 10.1007/978-3-030-01267-0_19 http://dx.doi.org/10.1007/978-3-030-01267-0_19 ］

Xu Y ， Wu Z B ， Chanussot J ， Comon P and Wei Z H . 2020a . Nonlocal coupled tensor CP decomposition for hyperspectral and multispectral image fusion . IEEE Transactions on Geoscience and Remote Sensing ， 58 （ 1 ）： 348 - 362 ［ DOI： 10.1109/TGRS.2019.2936486 http://dx.doi.org/10.1109/TGRS.2019.2936486 ］

Xu Y ， Wu Z B ， Chanussot J and Wei Z H . 2019 . Nonlocal patch tensor sparse representation for hyperspectral image super-resolution . IEEE Transactions on Image Processing ， 28 （ 6 ）： 3034 - 3047 ［ DOI： 10.1109/TIP.2019.2893530 http://dx.doi.org/10.1109/TIP.2019.2893530 ］

Xu Y ， Wu Z B ， Chanussot J and Wei Z H . 2020b . Hyperspectral images super-resolution via learning high-order coupled tensor ring representation . IEEE Transactions on Neural Networks and Learning Systems ， 31 （ 11 ）： 4747 - 4760 ［ DOI： 10.1109/TNNLS.2019.2957527 http://dx.doi.org/10.1109/TNNLS.2019.2957527 ］

Xue J Z ， Zhao Y Q ， Bu Y Y ， Liao W Z ， Chan J C W and Philips W . 2021 . Spatial-spectral structured sparse low-rank representation for hyperspectral image super-resolution . IEEE Transactions on Image Processing ， 30 ： 3084 - 3097 ［ DOI： 10.1109/TIP.2021.3058590 http://dx.doi.org/10.1109/TIP.2021.3058590 ］

Yan L B ， Wang X H ， Zhao M ， Kaloorazi M ， Chen J and Rahardja S . 2020 . Reconstruction of hyperspectral data from RGB images with prior category information . IEEE Transactions on Computational Imaging ， 6 ： 1070 - 1081 ［ DOI： 10.1109/TCI.2020.3000320 http://dx.doi.org/10.1109/TCI.2020.3000320 ］

Yi C ， Zhao Y Q and Chan J C W . 2019 . Spectral super-resolution for multispectral image based on spectral improvement strategy and spatial preservation strategy . IEEE Transactions on Geoscience and Remote Sensing ， 57 （ 11 ）： 9010 - 9024 ［ DOI： 10.1109/TGRS.2019.2924096 http://dx.doi.org/10.1109/TGRS.2019.2924096 ］

Yokoya N ， Yairi T and Iwasaki A . 2012 . Coupled nonnegative matrix factorization unmixing for hyperspectral and multispectral data fusion . IEEE Transactions on Geoscience and Remote Sensing ， 50 （ 2 ）： 528 - 537 ［ DOI： 10.1109/TGRS.2011.2161320 http://dx.doi.org/10.1109/TGRS.2011.2161320 ］

Yuan Y ， Zheng X T and Lu X Q . 2017 . Hyperspectral image superresolution by transfer learning . IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing ， 10 （ 5 ）： 1963 - 1974 ［ DOI： 10.1109/JSTARS.2017.2655112 http://dx.doi.org/10.1109/JSTARS.2017.2655112 ］

Zhang L ， Lang Z Q ， Wang P ， Wei W ， Liao S C ， Shao L and Zhang Y N . 2020b . Pixel-aware deep function-mixture network for spectral super-resolution . Proceedings of the AAAI Conference on Artificial Intelligence ， 34 （ 7 ）： 12821 - 12828 ［ DOI： 10.1609/aaai.v34i07.6978 http://dx.doi.org/10.1609/aaai.v34i07.6978 ］

Zhang L ， Nie J T ， Wei W ， Li Y and Zhang Y N . 2021 . Deep blind hyperspectral image super-resolution . IEEE Transactions on Neural Networks and Learning Systems ， 32 （ 6 ）： 2388 - 2400 ［ DOI： 10.1109/TNNLS.2020.3005234 http://dx.doi.org/10.1109/TNNLS.2020.3005234 ］

Zhang L ， Nie J T ， Wei W ， Zhang Y N ， Liao S C and Shao L . 2020a . Unsupervised adaptation learning for hyperspectral imagery super-resolution // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Seattle， USA ： IEEE： 3070 - 3079 ［ DOI： 10.1109/CVPR42600.2020.00314 http://dx.doi.org/10.1109/CVPR42600.2020.00314 ］

Zhao Y Z ， Po L M ， Yan Q ， Liu W and Lin T Y . 2020 . Hierarchical regression network for spectral reconstruction from RGB images // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops . Seattle， USA ： IEEE： 1695 - 1704 ［ DOI： 10.1109/CVPRW50498.2020.00219 http://dx.doi.org/10.1109/CVPRW50498.2020.00219 ］

Zhou Y ， Rangarajan A and Gader P D . 2020 . An integrated approach to registration and fusion of hyperspectral and multispectral images . IEEE Transactions on Geoscience and Remote Sensing ， 58 （ 5 ）： 3020 - 3033 ［ DOI： 10.1109/TGRS.2019.2946803 http://dx.doi.org/10.1109/TGRS.2019.2946803 ］

Zhu Z Y ， Hou J H ， Chen J ， Zeng H Q and Zhou J T . 2021 . Hyperspectral image super-resolution via deep progressive zero-centric residual learning . IEEE Transactions on Image Processing ， 30 ： 1423 - 1438 ［ DOI： 10.1109/TIP.2020.3044214 http://dx.doi.org/10.1109/TIP.2020.3044214 ］