Single Image Super-resolution Based On Non-subsampled Shearlet Transform

Ming Tan, Liang Chen, Xuan Wu, Yi Wu
Proceedings of the 15th Asian Conference on Machine Learning, PMLR 222:1337-1352, 2024.

Abstract

With the development of deep learning, breakthroughs in single image super-resolution have been achieved. However, most existing methods are limited to using only spatial domain information or only frequency domain information, and the rich information of the image in the frequency domain space is not fully utilized, so it is still difficult to recover satisfactory texture details. In this paper, we propose a method to fuse the frequency domain and spatial domain information. Our method uses a two-branch network to extract the spatial domain information and the frequency domain information separately and uses a fusion module to fuse the different information in the two domains. We also use the Non-Subsampled Shearlet Transform (NSST) to preserve the texture directionality well, and design two NSST-based directional texture enhancement modules, which are embedded in different parts of the network, to enhance the recovery of texture details in the image reconstruction process. Quantitative and qualitative experimental results show that the method outperforms advanced single-image super-resolution methods in recovering images.

Cite this Paper

BibTeX
@InProceedings{pmlr-v222-tan24a, title = {Single Image Super-resolution Based On Non-subsampled Shearlet Transform}, author = {Tan, Ming and Chen, Liang and Wu, Xuan and Wu, Yi}, booktitle = {Proceedings of the 15th Asian Conference on Machine Learning}, pages = {1337--1352}, year = {2024}, editor = {Yanıkoğlu, Berrin and Buntine, Wray}, volume = {222}, series = {Proceedings of Machine Learning Research}, month = {11--14 Nov}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v222/tan24a/tan24a.pdf}, url = {https://proceedings.mlr.press/v222/tan24a.html}, abstract = {With the development of deep learning, breakthroughs in single image super-resolution have been achieved. However, most existing methods are limited to using only spatial domain information or only frequency domain information, and the rich information of the image in the frequency domain space is not fully utilized, so it is still difficult to recover satisfactory texture details. In this paper, we propose a method to fuse the frequency domain and spatial domain information. Our method uses a two-branch network to extract the spatial domain information and the frequency domain information separately and uses a fusion module to fuse the different information in the two domains. We also use the Non-Subsampled Shearlet Transform (NSST) to preserve the texture directionality well, and design two NSST-based directional texture enhancement modules, which are embedded in different parts of the network, to enhance the recovery of texture details in the image reconstruction process. Quantitative and qualitative experimental results show that the method outperforms advanced single-image super-resolution methods in recovering images.} }
Endnote
%0 Conference Paper %T Single Image Super-resolution Based On Non-subsampled Shearlet Transform %A Ming Tan %A Liang Chen %A Xuan Wu %A Yi Wu %B Proceedings of the 15th Asian Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2024 %E Berrin Yanıkoğlu %E Wray Buntine %F pmlr-v222-tan24a %I PMLR %P 1337--1352 %U https://proceedings.mlr.press/v222/tan24a.html %V 222 %X With the development of deep learning, breakthroughs in single image super-resolution have been achieved. However, most existing methods are limited to using only spatial domain information or only frequency domain information, and the rich information of the image in the frequency domain space is not fully utilized, so it is still difficult to recover satisfactory texture details. In this paper, we propose a method to fuse the frequency domain and spatial domain information. Our method uses a two-branch network to extract the spatial domain information and the frequency domain information separately and uses a fusion module to fuse the different information in the two domains. We also use the Non-Subsampled Shearlet Transform (NSST) to preserve the texture directionality well, and design two NSST-based directional texture enhancement modules, which are embedded in different parts of the network, to enhance the recovery of texture details in the image reconstruction process. Quantitative and qualitative experimental results show that the method outperforms advanced single-image super-resolution methods in recovering images.
APA
Tan, M., Chen, L., Wu, X. & Wu, Y.. (2024). Single Image Super-resolution Based On Non-subsampled Shearlet Transform. Proceedings of the 15th Asian Conference on Machine Learning, in Proceedings of Machine Learning Research 222:1337-1352 Available from https://proceedings.mlr.press/v222/tan24a.html.

Related Material