September 01, 2017

Hierarchical Context Modeling for Video Event Recognition

  • Ji Q.
  • Wang X.

Current video event recognition research remains largely target-centered. For real-world surveillance videos, target-centered event recognition faces great challenges due to large intra-class target variation, limited image resolution, and poor detection and tracking results. To mitigate these challenges, we introduced a context-augmented video event recognition approach. Specifically, we explicitly capture different types of contexts from three levels including image level, semantic level, and prior level. At the image level, we introduce two types of contextual features including the appearance context features and interaction context features to capture the appearance of context objects and their interactions with the target objects. At the semantic level, we propose a deep model based on deep Boltzmann machine to learn event object representations and their interactions. At the prior level, we utilize two types of prior-level contexts including scene priming and dynamic cueing. Finally, we introduce a hierarchical context model that systematically integrates the contextual information at different levels. Through the hierarchical context model, contexts at different levels jointly contribute to the event recognition. We evaluate the hierarchical context model for event recognition on benchmark surveillance video datasets. Results show that incorporating contexts in each level can improve event recognition performance, and jointly integrating three levels of contexts through our hierarchical model achieves the best performance.

View Original Article

Recent Publications

January 01, 2018

Fair Dynamic Spectrum Management for QRD-Based Precoding with User Encoding Ordering in Downstream G.fast Transmission

In next generation DSL networks such as G.fast, employing discrete multi-tone transmission in high frequencies up to 212 MHz, the crosstalk among lines reaches very high levels. To precompensate the crosstalk in downstream transmission, QRD-based precoding has been proposed as a near-optimal dynamic spectrum management (DSM) technique. However, the performance ...

January 01, 2018

Practical Mitigation of Passive Intermodulation in Microstrip Circuits

This paper presents new experimental evidence and a novel practical approach for mitigation of passive intermodulation (PIM) in microstrip circuits fabricated on commercial printed circuit board laminates. The mechanisms of distributed PIM in microstrip circuits are reviewed and a phenomenology of PIM generation due to locally enhanced electromagnetic fields at ...

January 01, 2018

Efficient Cooperative HARQ for Multi-Source Multi-Relay Wireless Networks

In this paper, we compare the performance of three different cooperative Hybrid Automatic Repeat reQuest (HARQ) protocols for slow-fading half-duplex orthogonal multiple access multiple relay channel. Channel State Information (CSI) is available at the receiving side of each link only. Time Division Multiplexing is assumed, where each orthogonal transmission occurs ...