Application of discriminative models for interactive query refinement in video retrieval

Amit Srivastava; Saurabh Khanwalkar; Anoop Kumar

doi:10.1117/12.2051887

24 December 2013 Application of discriminative models for interactive query refinement in video retrieval

Amit Srivastava, Saurabh Khanwalkar, Anoop Kumar

Proceedings Volume 9067, Sixth International Conference on Machine Vision (ICMV 2013); 90671N (2013) https://doi.org/10.1117/12.2051887
Event: Sixth International Conference on Machine Vision (ICMV 13), 2013, London, United Kingdom

Abstract

The ability to quickly search for large volumes of videos for specific actions or events can provide a dramatic new capability to intelligence agencies. Example-based queries from video are a form of content-based information retrieval (CBIR) where the objective is to retrieve clips from a video corpus, or stream, using a representative query sample to find more like this. Often, the accuracy of video retrieval is largely limited by the gap between the available video descriptors and the underlying query concept, and such exemplar queries return many irrelevant results with relevant ones. In this paper, we present an Interactive Query Refinement (IQR) system which acts as a powerful tool to leverage human feedback and allow intelligence analyst to iteratively refine search queries for improved precision in the retrieved results. In our approach to IQR, we leverage discriminative models that operate on high dimensional features derived from low-level video descriptors in an iterative framework. Our IQR model solicits relevance feedback on examples selected from the region of uncertainty and updates the discriminating boundary to produce a relevance ranked results list. We achieved 358% relative improvement in Mean Average Precision (MAP) over initial retrieval list at a rank cutoff of 100 over 4 iterations. We compare our discriminative IQR model approach to a naïve IQR and show our model-based approach yields 49% relative improvement over the no model naïve system.

Citation Download Citation

Amit Srivastava, Saurabh Khanwalkar, and Anoop Kumar "Application of discriminative models for interactive query refinement in video retrieval", Proc. SPIE 9067, Sixth International Conference on Machine Vision (ICMV 2013), 90671N (24 December 2013); https://doi.org/10.1117/12.2051887

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available