Hand Gesture Based Remote Control System Using Infrared Sensors and a Camera

Erden F., ÇETİN A. E.

IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, cilt.60, ss.675-680, 2014 (SCI İndekslerine Giren Dergi) identifier identifier

  • Cilt numarası: 60 Konu: 4
  • Basım Tarihi: 2014
  • Doi Numarası: 10.1109/tce.2014.7027342
  • Sayfa Sayıları: ss.675-680


In this paper, a multimodal hand gesture detection and recognition system using differential Pyroelectric Infrared (PIR) sensors and a regular camera is described. Any movement within the viewing range of the differential PIR sensors are first detected by the sensors and then checked if it is due to a hand gesture or not by video analysis. If the movement is due to a hand, one-dimensional continuous-time signals extracted from the PIR sensors are used to classify/recognize the hand movements in real-time. Classification of different hand gestures by using the differential PIR sensors is carried out by a new winner-take-all (WTA) hash based recognition method. Jaccard distance is used to compare the WTA hash codes extracted from 1-D differential infrared sensor signals. It is experimentally shown that the multimodal system achieves higher recognition rates than the system based on only the on/off decisions of the analog circuitry of the PIR sensors(1).