首页 | 本学科首页   官方微博 | 高级检索  
     


Concept-based indexing of annotated images using semantic DNA
Authors:Syed Abdullah Fadzli  Rossitza Setchi
Affiliation:1. University of Rome “Tor Vergata”, Dipartimento di Ingegneria Civile e Informatica, Rome, 00133, Italy;2. National Center for Atmospheric Research, Computational & Information Services Laboratory (CISL), 80305, Boulder, CO, USA;3. Cranfield University, Centre for Computational Engineering Sciences, Cranfield, MK43 0AL, UK
Abstract:One of the challenges in image retrieval is dealing with concepts which have no visual appearance in the images or are not used as keywords in their annotations. To address this problem, this paper proposes an unsupervised concept-based image indexing technique which uses a lexical ontology to extract semantic signatures called ‘semantic chromosomes’ from image annotations. A semantic chromosome is an information structure, which carries the semantic information of an image; it is the semantic signature of an image in a collection expressed through a set of semantic DNA (SDNA), each of them representing a concept. Central to the concept-based indexing technique discussed is the concept disambiguation algorithm developed, which identifies the most relevant ‘semantic DNA’ (SDNA) by measuring the semantic importance of each word/phrase in the annotation. The concept disambiguation algorithm is evaluated using crowdsourcing. The experiments show that the algorithm has better accuracy (79.4%) than the accuracy demonstrated by other unsupervised algorithms (73%) in the 2007 Semeval competition. It is also comparable with the accuracy achieved in the same competition by the supervised algorithms (82–83%) which contrary to the approach proposed in this paper have to be trained with large corpora. The approach is currently applied to the automated generation of mood boards used as an inspirational tool in concept design.
Keywords:
本文献已被 ScienceDirect 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号