FPGA-based infrared image deblurring using angular position of IR detector

Doner T., GÖKCEN D.

VISUAL COMPUTER, cilt.37, sa.7, ss.2039-2050, 2021 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 37 Sayı: 7
  • Basım Tarihi: 2021
  • Doi Numarası: 10.1007/s00371-020-01961-y
  • Dergi Adı: VISUAL COMPUTER
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Applied Science & Technology Source, Compendex, Computer & Applied Sciences, INSPEC, zbMATH
  • Sayfa Sayıları: ss.2039-2050
  • Anahtar Kelimeler: Infrared imaging, Blur, FPGA, Point spread function, IMU
  • Hacettepe Üniversitesi Adresli: Evet

Özet

The motion of the object or the infrared (IR) imaging system during the integration time causes blurring of the IR image. This study covers real-time field programmable gate array (FPGA)-based deblurring for IR detectors, and an inertial measurement unit (IMU) was used to quantify the blur caused by the IR detector movement. Point spread function for each pixel was calculated using the angular position data of the IR detector obtained from IMU. Both spatially invariant and spatially variant blur cases can be modeled for the IR detector motion. After the quantification, the spatially invariant-type blur was eliminated using a Wiener filter-based deblurring algorithm. Deblurring algorithm was implemented in the Xilinx system generator environment directly using FPGA IP cores. The simulation results in the Xilinx system generator environment indicate that the proposed image deblurring method is real-time applicable, and it reduces the processing time of a single frame to 4 ms. For the implementation of 2D-fast Fourier transform design in FPGA using the corner turn matrix method, memory management is the most critical factor influencing the speed. The real-time deblurring solution given herein has the potential to be used in IR cameras on the moving platforms to increase the performance and robustness in systems such as object tracking and visual navigation.