Journal of Guangdong University of Technology ›› 2020, Vol. 37 ›› Issue (04): 27-34.doi: 10.12052/gdutxb.200002

Previous Articles     Next Articles

DIAN: Dual-aspect Item Attention Network for Item-based Recommendation

Zhao Yong-jian, Yang Zhen-guo, Liu Wen-yin   

  1. School of Computers, Guangdong University of Technology, Guangzhou 510006, China
  • Received:2020-12-25 Online:2020-07-11 Published:2020-07-11

Abstract: A dual-aspect item attention network (DIAN) for item-based recommendation is proposed, which jointly takes into account the aspects of importance of historical items in a user profile to the target items and the underlying relations among these items. DIAN consists of two main modules, a neural attentive model for item similarity between historical and target items (NAIS), and a dual normalization self-attention item similarity model for item similarity underlying historical items (SAIS). On one hand, the neural attentive model is introduced to distinguish the different contribution of the historical items in a user profile to the perdition on the target item. On the other hand, a self-attention network is proposed to infer the item-item relationship from users’ historical interactions, which is able to estimate the relative weights of each item in user interaction trajectories, in order to learn better representations for users’ interests. Furthermore, a self-attention network is proposed using a dual normalization mechanism, consisting of a layer focusing on extracting users’ representation from historical items, and a layer making it unaffected by the number of users’ historical items. Extensive experiments conducted on two public benchmarks demonstrate the proposed method outperforms the state-of-the-art recommendation models.

Key words: attention networks, collaborative filtering, self-attention model, dual normalization, recommendation

CLC Number: 

  • TP391
[1] KABBUR S, NING X, KARYPIS G. Fism: factored item similarity models for top-N recommender systems[C]//Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data mining. Seattle: ACM, 2013: 659-667.
[2] HE X, HE Z, SONG J, et al. Nais: neural attentive item similarity model for recommendation [J]. IEEE Transactions on Knowledge and Data Engineering, 2018, 30(12): 2354-2366
[3] PAN R, ZHOU Y, CAO B, et al. One-class collaborative filtering[C]//2008 Eighth IEEE International Conference on Data Mining. Pisa: IEEE, 2008: 502-511.
[4] CREMONESI P, KOREN Y, TURRIN R. Performance of recommender algorithms on top-N recommendation tasks[C]//Proceedings of the 4th ACM Conference on Recommender Systems. Spain: ACM, 2010: 39-46.
[5] CHEN X, ZHANG Y, AI Q, et al. Personalized key frame recommendation[C]//Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. Tokyo: ACM, 2017: 315-324.
[6] HE X, ZHANG H, KAN M Y, et al. Fast matrix factorization for online recommendation with implicit feedback[C]//Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. Pisa: ACM, 2016: 549-558.
[7] 高俊艳, 刘文印, 杨振国. 结合注意力与特征融合的目标跟踪[J]. 广东工业大学学报, 2019, 36(4): 18-23
GAO J Y, LIU W Y, YANG Z G. Object tracking combined with attention and feature fusion [J]. Journal of Guangdong University of Technology, 2019, 36(4): 18-23
[8] 曾碧卿, 韩旭丽, 王盛玉, 等. 基于双注意力卷积神经网络模型的情感分析研究[J]. 广东工业大学学报, 2019, 36(4): 10-17
ZENG B Q, HAN X L, WANG S Y, et al. Sentiment classification based on double attention convolutional neural network model [J]. Journal of Guangdong University of Technology, 2019, 36(4): 10-17
[9] LIN Z, FENG M, SANTOS C N, et al. A structured self-attentive sentence embedding[J]. arXiv preprint arXiv: 1703.03130, 2017.
[10] ZHANG H, GOODFELLOW I, METAXAS D, et al. Self-attention generative adversarial networks[J]. arXiv preprint arXiv: 1805.08318, 2018.
[11] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Advances in Neural Information Processing Systems. Red Hook: NIPS, 2017: 5998-6008.
[12] ZHANG S, TAY Y, YAO L, et al. Next item recommendation with self-attention[J]. arXiv preprint arXiv: 1808.06414, 2018.
[13] SOCHER R, CHEN D, MANNING C D, et al. Reasoning with neural tensor networks for knowledge base completion[C]//Advances In neural Information Processing Systems. Red Hook: NIPS, 2013: 926-934.
[14] HE X, LIAO L, ZHANG H, et al. Neural collaborative filtering[C]//Proceedings of the 26th International Conference on World Wide Web. Perth: ACM, 2017: 173-182.
[15] DUCHI J, HAZAN E, SINGER Y. Adaptive subgradient methods for online learning and stochastic optimization [J]. Journal of Machine Learning Research, 2011, 12(7): 257-269
[16] GENG X, ZHANG H, BIAN J, et al. Learning image and user features for recommendation in social networks[C]//Proceedings of the IEEE International Conference on Computer Vision. Santiago: IEEE, 2015: 4274-4282.
[17] ELKAHKY A M, SONG Y, HE X. A multi-view deep learning approach for cross domain user modeling in recommendation systems[C]//Proceedings of the 24th International Conference on World Wide Web .Florence: ACM, 2015: 278-288.
[18] SARWAR B, KARYPIS G, KONSTAN J, et al. Item-based collaborative filtering recommendation algorithms[C]//Proceedings of The 10th International Conference on World Wide Web. Hong Kong: ACM 2001: 285-295.
[19] RENDLE S, FREUDENTHALER C, GANTNER Z, et al. BPR: bayesian personalized ranking from implicit feedback[J]. arXiv preprint arXiv: 1205.2618, 2012.
[1] Hu Xiao-min, Long Zu-tao, Li Min. A Multi-objective Recommendation Algorithm Based on User Stratification [J]. Journal of Guangdong University of Technology, 2023, 40(01): 10-18.
[2] Yi Min-qi, Liu Hong-wei, Gao Hong-ming. Research on the Factors Influencing the Co-purchase Network of Products on E-commerce Platforms [J]. Journal of Guangdong University of Technology, 2022, 39(03): 16-24.
[3] Yang Da-sen. DPLORE: A Location Recommendation Algorithm for Differential Privacy Protection [J]. Journal of Guangdong University of Technology, 2021, 38(01): 69-74.
[4] Zheng Yi, Liu Yi-xin, Zhang Guang-yu. A Research on the Composition Mechanism and Promotion Strategy of Dynamic Management of New R&D Institutions: A Government Perspective [J]. Journal of Guangdong University of Technology, 2020, 37(02): 30-38.
[5] Peng Jia-en, Deng Xiu-qin, Liu Tai-heng, Liu Fu-chun, Li Wen-zhou. A Recommendation Algorithm of Latent Factor Model Fused with the Social and Tag Information [J]. Journal of Guangdong University of Technology, 2018, 35(04): 45-50.
[6] Lin Sui, Zheng Zhi-hao. A Research of a Recommender System Based on Customer Behavior Modeling by Mining Association Rules [J]. Journal of Guangdong University of Technology, 2018, 35(03): 90-94.
[7] Hu Hui-cheng, Chen Ping-hua. Research on Implicit Trust Relationship Aware Recommendation Algorithm [J]. Journal of Guangdong University of Technology, 2017, 34(03): 43-48.
[8] Zhang Wei, Zhang Si-qin, Song Jing-jing, Teng Shao-hua, Liu Yan. The Many to Many Friend Recommendation of Online Community Based E-CARGO [J]. Journal of Guangdong University of Technology, 2017, 34(03): 36-42.
[9] WANG Yong, YI Ting. A Distance Decay and Score Trends Improved Collaborative Recommendation Algorithm [J]. Journal of Guangdong University of Technology, 2015, 32(2): 38-42.
[10] WANG Ling, FU Xiu-Fen, WANG Xiao-Mu. Hybrid Dynamic Collaborative Filtering Algorithm Based on Big Data Sets [J]. Journal of Guangdong University of Technology, 2014, 31(3): 44-48.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!