Facial descriptors for human interaction recognition in still images

Creative Commons License

TANIŞIK G., ZALLUHOĞLU C., Ikizler-Cinbis N.

PATTERN RECOGNITION LETTERS, cilt.73, ss.44-51, 2016 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 73
  • Basım Tarihi: 2016
  • Doi Numarası: 10.1016/j.patrec.2016.01.002
  • Dergi Adı: PATTERN RECOGNITION LETTERS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Sayfa Sayıları: ss.44-51
  • Anahtar Kelimeler: Human interaction recognition, Facial features, Interaction recognition in still images
  • Hacettepe Üniversitesi Adresli: Evet

Özet

This paper presents a novel approach in a rarely studied area of computer vision: Human interaction recognition in still images. We explore whether the facial regions and their spatial configurations contribute to the recognition of interactions. In this respect, our method involves extraction of several visual features from the facial regions, as well as incorporation of scene characteristics and deep features to the recognition. Extracted multiple features are utilized within a discriminative learning framework for recognizing interactions between people. Our designed facial descriptors are based on the observation that relative positions, size and locations of the faces are likely to be important for characterizing human interactions. Since there is no available dataset in this relatively new domain, a comprehensive new dataset which includes several images of human interactions is collected. Our experimental results show that faces and scene characteristics contain important information to recognize interactions between people. (C) 2016 Elsevier B.V. All rights reserved.