CSBSR: Joint Learning of Blind Super-Resolution and Crack Segmentation for Realistic Degraded Images

Toyota Technological Institute
IEEE Transactions on Instrumentation and Measurement (TIM) 2024
example

Crack segmentation challenges for synthetically-degraded images given by low resolution and anisotropic Gaussian blur. Our method (f) CSBSR succeeds in detecting cracks in the most detail compared to previous studies (d), (e). Furthermore, in several cases our method was able to detect cracks as successfully as when GT high-resolution images were used for segmentation (c), despite the fact that our method was inferring from degraded images.

Abstract

This paper proposes crack segmentation augmented by super resolution (SR) with deep neural networks. In the proposed method, a SR network is jointly trained with a binary segmentation network in an end-to-end manner. This joint learning allows the SR network to be optimized for improving segmentation results. For realistic scenarios, the SR network is extended from non-blind to blind for processing a low-resolution image degraded by unknown blurs. The joint network is improved by our proposed two extra paths that further encourage the mutual optimization between SR and segmentation. Comparative experiments with State of The Art (SoTA) segmentation methods demonstrate the superiority of our joint learning, and various ablation studies prove the effects of our contributions.

🚧 **Contents will be released soon! Stay tuned.** 🚧

BibTeX

@article{kondo2023csbsr,
  title={Joint Learning of Blind Super-Resolution and Crack Segmentation for Realistic Degraded Images},
  author={Kondo, Yuki and Ukita, Norimichi},
  journal={IEEE Transactions on Instrumentation and Measurement},
  year={2024},
  volume={73},
  number={},
  pages={1-16},
}