Building Semantic Hierarchies Faithful to Image Semantics

Abstract : This paper proposes a new image-semantic measure, named "Semantico-Visual Relatedness of Concepts" (SVRC), to estimate the semantic similarity between concepts. The proposed measure incorporates visual, conceptual and contextual information to provide a measure which is more meaningful and more representative of image semantics. We also propose a new methodology to automatically build a semantic hierarchy suitable for the purpose of image annotation and/or classification. The building is based on the previously proposed measure SVRC and on a new heuristic, named TRUST-ME, to connect concepts with higher relatedness till the building of the final hierarchy. The built hierarchy explicitly encodes a general to specific concepts relationship and therefore provides a semantic structure to concepts which facilitates the semantic interpretation of images. Our experiments showed that the use of the constructed semantic hierarchies as a hierarchical classification framework provides a better image annotation.
Document type :
Conference papers
Complete list of metadatas

Cited literature [26 references]  Display  Hide  Download

https://hal-ecp.archives-ouvertes.fr/hal-00740144
Contributor : Hichem Bannour <>
Submitted on : Tuesday, October 9, 2012 - 5:04:10 PM
Last modification on : Wednesday, August 8, 2018 - 9:40:02 AM
Long-term archiving on : Thursday, January 10, 2013 - 3:40:40 AM

File

MMM12.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Hichem Bannour, Céline Hudelot. Building Semantic Hierarchies Faithful to Image Semantics. Proceedings of the 18th international conference on Advances in Multimedia Modeling, Jan 2012, Klagenfurt, Austria. pp.4--15, ⟨10.1007/978-3-642-27355-1_4⟩. ⟨hal-00740144⟩

Share

Metrics

Record views

211

Files downloads

500