Volume 16, Issue 2 (4-2024)                   itrc 2024, 16(2): 34-44 | Back to browse issues page

XML Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Taheri F, Rahbar K, Beheshtifard Z. Image Retrieval with Missing Regions by Reconstructing and Concatenating Content and Semantic Features. itrc 2024; 16 (2) :34-44
URL: http://journal.itrc.ac.ir/article-1-573-en.html
1- Department of Computer Engineering, South Tehran Branch, Islamic Azad University, Tehran, Iran
2- Department of Computer Engineering, South Tehran Branch, Islamic Azad University, Tehran, Iran , kambiz.rahbar@gmail.com
3- Department of Computer Engineering, South Tehran Branch, Islamic Azad University, Tehran, Iran
Abstract:   (2308 Views)

In recent years, the performance of deep neural networks in improving the image retrieval process has been remarkable. Utilizing deep neural networks; however, leads to poor results in retrieving images with missing regions. The operators’ dysfunctions, who consider the relationship between the image pixels, statistically extract incomplete information from an image, which in turn reduces the number of image features and or leads to features' inaccurate identification. An attempt has been made to eliminate the problem of missing image information through image inpainting techniques; therefore, a content-based image retrieval method is proposed for images with missing regions. In this method, through image inpainting the crucial missing information is reconstructed. The image dataset is being queried to find similar samples. For this purpose, a two-stage inpainting framework based on encoder-decoder is used in the image retrieval system. Also, the features of each image are extracted from the integration and concatenating of content and semantic features. Through using handcraft features such as color and texture image content information is extracted from the Resnet-50 deep neural network. Finally, similar images are retrieved based on the minimum Euclidean distance. The performance of the image retrieval model with missing regions is evaluated with the average precision criterion on the Paris 6K datasets. The best retrieval results are 60.11%, 50.14%, and 42.43% for retrieving the top one, five, and ten samples after reconstructing the image with the most missing regions with a destruction frequency of 6 Hz, respectively. 

Full-Text [PDF 1167 kb]   (331 Downloads)    
Type of Study: Research | Subject: Information Technology

Add your comments about this article : Your username or Email:
CAPTCHA

Send email to the article author


Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.