PIRC Net Using Proposal Indexing Relationships and Context for Phrase Grounding

Phrase Grounding aims to detect and localize objects in images that are referred to and are queried by natural language phrases . Phrase grounding finds applications in tasks such as Visual Dialog, Visual Search and Image-text co-reference resolution… In this paper, we present a framework that leverages information such as phrase category, relationships among neighboring phrases in a sentence and context to improve the performance of phrase grounding systems . We propose three modules: Proposal Indexing Network(PIN); Inter-phrase Regression Network(IRN) and Proposal Ranking Network(PRN) each of which analyze the region proposals of an image at increasing levels of detail . Also, in the absence of ground-truth spatial locations of the phrases, we propose knowledge transfer mechanisms

Links: PDF - Abstract

Code :

None

Keywords : phrase - grounding - proposal - network - phrases -

Leave a Reply

Your email address will not be published. Required fields are marked *