Please use this identifier to cite or link to this item:
Title: Personalized Fashion Recommendation with Visual Explanations based on Multimodal Attention Network: Towards Visually Explainable Recommendation
Authors: Xu Chen
Hanxiong Chen
Hongteng Xu
Yongfeng Zhang
Yixin Cao 
Zheng Qin
Hongyuan Zha
Issue Date: 21-Jul-2019
Citation: Xu Chen, Hanxiong Chen, Hongteng Xu, Yongfeng Zhang, Yixin Cao, Zheng Qin, Hongyuan Zha (2019-07-21). Personalized Fashion Recommendation with Visual Explanations based on Multimodal Attention Network: Towards Visually Explainable Recommendation. SIGIR 2019 : 765-774. ScholarBank@NUS Repository.
Abstract: Fashion recommendation has attracted increasing attention from both industry and academic communities. This paper proposes a novel neural architecture for fashion recommendation based on both image region-level features and user review information. Our basic intuition is that: for a fashion image, not all the regions are equally important for the users, i.e., people usually care about a few parts of the fashion image. To model such human sense, we learn an attention model over many pre-segmented image regions, based on which we can understand where a user is really interested in on the image, and correspondingly, represent the image in a more accurate manner. In addition, by discovering such fine-grained visual preference, we can visually explain a recommendation by highlighting some regions of its image. For better learning the attention model, we also introduce user review information as a weak supervision signal to collect more comprehensive user preference. In our final framework, the visual and textual features are seamlessly coupled by a multimodal attention network. Based on this architecture, we can not only provide accurate recommendation, but also can accompany each recommended item with novel visual explanations. We conduct extensive experiments to demonstrate the superiority of our proposed model in terms of Top-N recommendation, and also we build a collectively labeled dataset for evaluating our provided visual explanations in a quantitative manner. ? 2019 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Source Title: SIGIR 2019
ISBN: 9781450361729
DOI: 10.1145/3331184.3331254
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
3331184.3331254.pdf4.03 MBAdobe PDF




checked on Nov 18, 2020

Page view(s)

checked on Nov 20, 2020


checked on Nov 20, 2020

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.