Histograms of sequences: a novel representation for human interaction recognition

CAVENT A., Ikizler-Cinbis N.

IET COMPUTER VISION, vol.12, no.6, pp.844-854, 2018 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 12 Issue: 6
  • Publication Date: 2018
  • Doi Number: 10.1049/iet-cvi.2017.0471
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Page Numbers: pp.844-854
  • Hacettepe University Affiliated: Yes


This study presents a novel representation based on hierarchical histogram of local feature sequences for human interaction recognition. The authors' method basically combines the power of discriminative sequence mining and histogram representation for the effective recognition of human interactions. Our framework involves extracting visual features from the videos first, and then mining sequences of the visual features that occur consequently in space and time. After the mining step, we represent each video with a histogram pyramid of such sequences. We also propose to use soft clustering in the visual word construction step, such that more information-rich histograms can be obtained. The authors' experimental results on challenging human interaction recognition data sets indicate that the proposed algorithm performs on par with the state-of-the-art methods.