Cross-Modal Scene Prior for Adaptive RGB-Guided Infrared Column Stripe Noise Removal
Sensors, cilt.26, sa.12, 2026 (SCI-Expanded, Scopus)
- Yayın Türü: Makale / Tam Makale
- Cilt numarası: 26 Sayı: 12
- Basım Tarihi: 2026
- Doi Numarası: 10.3390/s26123638
- Dergi Adı: Sensors
- Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Compendex, EMBASE, INSPEC, MEDLINE, Directory of Open Access Journals, Academic Search Ultimate (EBSCO), Biomedical Reference Collection: Corporate Edition (EBSCO), Health Research Premium Collection (ProQuest)
- Anahtar Kelimeler: column stripe noise, cross-modal guidance, deep learning, infrared imaging, non-uniformity correction, spatially adaptive normalization, visible-light guidance
- Hacettepe Üniversitesi Adresli: Evet
Özet
Infrared focal plane array detectors produce column stripe noise due to inter-detector response variations. Existing single-frame correction methods operate exclusively on the degraded infrared image and cannot reliably distinguish column noise from genuine vertical scene structures. With the increasing availability of co-registered visible-light cameras in modern electro-optical/infrared payloads, we propose to exploit the visible image as a structural guide for infrared destriping. Through a cross-modal correlation analysis, we show that the structural correspondence between RGB and infrared images is spatially non-uniform, motivating a selective rather than uniform fusion strategy. Based on this observation, we propose CMSP (Cross-Modal Scene Prior), a lightweight single-frame denoising architecture that selectively applies RGB guidance where it is beneficial. The proposed AdaptiveSPADE module blends RGB-guided modulation with standard instance normalization through a learned per-pixel confidence map, while a dual-path output head separately estimates pixel-wise residuals and column-constant stripe patterns. Evaluated on three public RGB–IR datasets, CMSP achieves 51.91 dB PSNR on M3FD, outperforming the best baseline by 5.79 dB with only 638 K parameters. A downstream evaluation on real stripe noise demonstrates that CMSP not only removes artifacts but also preserves the fine structures critical for infrared small target detection. Ablation studies confirm that adaptive gating more than doubles the benefit of RGB guidance compared to uniform modulation, and prevents degradation when cross-modal alignment is weak.