The recommendation of the next Point of Interest (POI) has attracted significant attention within the domain of POI recommendations in recent years. Existing methods for next POI recommendation are built on the original check-in sequences of users. Despite effectiveness, the original check-in sequences mix the influences of different contextual factors, which inevitably weakens the model ability of learning user preferences from the complex contextual information. To overcome this issue, we propose a novel Multi-Contextual Sequence-based Attention Network (MCSAN) for next POI recommendations. MCSAN first develops a new con-textual influence-based sampling strategy, which can transform the original check-in sequences into a series of contextual information-aware subsequences. Moreover, the constructed subsequences meticulously capture the impacts of various contextual information from the original check-in sequences. Then, MCSAN leverage the attention-based neural network to learn the representations of POIs from the generated subsequences. Finally, MCSAN develops a new feature fusion method that extracts user preferences from the learned POI presentations adaptively. Extensive experiments conducted on real-world datasets indicate the effectiveness of our proposed MCSAN for the next POI recommendation task, compared to recent representative methods.
Citation: Jing Chen, Weiyu Ye, Shaowei Kang. Learning user preferences from Multi-Contextual Sequence influences for next POI recommendation[J]. Electronic Research Archive, 2024, 32(1): 486-504. doi: 10.3934/era.2024024
The recommendation of the next Point of Interest (POI) has attracted significant attention within the domain of POI recommendations in recent years. Existing methods for next POI recommendation are built on the original check-in sequences of users. Despite effectiveness, the original check-in sequences mix the influences of different contextual factors, which inevitably weakens the model ability of learning user preferences from the complex contextual information. To overcome this issue, we propose a novel Multi-Contextual Sequence-based Attention Network (MCSAN) for next POI recommendations. MCSAN first develops a new con-textual influence-based sampling strategy, which can transform the original check-in sequences into a series of contextual information-aware subsequences. Moreover, the constructed subsequences meticulously capture the impacts of various contextual information from the original check-in sequences. Then, MCSAN leverage the attention-based neural network to learn the representations of POIs from the generated subsequences. Finally, MCSAN develops a new feature fusion method that extracts user preferences from the learned POI presentations adaptively. Extensive experiments conducted on real-world datasets indicate the effectiveness of our proposed MCSAN for the next POI recommendation task, compared to recent representative methods.
| [1] |
Y. Hwangbo, K. J. Lee, B. Jeong, K. Y. Park, Recommendation system with minimized transaction data, Data Sci. Manage., 4 (2021), 40–45. https://doi.org/10.1016/j.dsm.2022.01.001 doi: 10.1016/j.dsm.2022.01.001
|
| [2] |
L. Shi, J. Luo, C. Zhu, F. Kou, G. Cheng, X. Liu, A survey on cross-media search based on user intention understanding in social networks, Inf. Fusion, 91 (2023), 566–581. https://doi.org/10.1016/j.inffus.2022.11.017 doi: 10.1016/j.inffus.2022.11.017
|
| [3] |
L. Shi, J. Du, G. Cheng, L. Xia, Z. Xiong, J. Luo, Cross-media search method based on complementary attention and generative adversarial network for social networks, Int. J. Intell. Syst., 37 (2022), 4393–4416. https://doi.org/10.1002/int.22723 doi: 10.1002/int.22723
|
| [4] |
W. Ji, X. Meng, Y. Zhang, STARec: Adaptive learning with spatiotemporal and activity influence for POI recommendation, ACM Trans. Inf. Syst., 40 (2021), 1–40. https://doi.org/10.1145/3485631 doi: 10.1145/3485631
|
| [5] |
W. Ji, X. Meng, Y. Zhang, SPATM: A social period-aware topic model for personalized venue recommendation, IEEE Trans. Knowl. Data Eng., 34 (2020), 3997–4010. https://doi.org/10.1109/TKDE.2020.3029070 doi: 10.1109/TKDE.2020.3029070
|
| [6] |
L. Shi, G. Song, G. Cheng, X. Liu, A user-based aggregation topic model for understanding user's preference and intention in social network, Neurocomputing, 413 (2020), 1–13. https://doi.org/10.1016/j.neucom.2020.06.099 doi: 10.1016/j.neucom.2020.06.099
|
| [7] | M. Xie, H. Yin, H. Wang, F. Xu, W. Chen, S. Wang, Learning graph-based poi embedding for location-based recommendation, in Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, ACM, (2016), 15–24. https://doi.org/10.1145/2983323.2983711 |
| [8] |
X. Hu, J. Xu, W. Wang, Z. Li, A. Liu, A graph embedding based model for fine-grained POI recommendation, Neurocomputing, 428 (2021), 376–384. https://doi.org/10.1016/j.neucom.2020.01.118 doi: 10.1016/j.neucom.2020.01.118
|
| [9] | T. Yang, H. Gao, C. Yang, C. Shi, Q. Xie, X. Wang, et al., Memory-enhanced period-aware graph neural network for general POI recommendation, in Proceedings of the International Conference on Database Systems for Advanced Applications, Springer, (2023), 462–472. https://doi.org/10.1007/978-3-031-30672-3_31 |
| [10] |
B. Hu, Y. Ye, Y. Zhong, J. Pan, M. Hu, Transmkr: Translation-based knowledge graph enhanced multi-task point-of-interest recommendation, Neurocomputing, 474 (2022), 107–114. https://doi.org/10.1016/j.neucom.2021.11.049 doi: 10.1016/j.neucom.2021.11.049
|
| [11] |
S. Xing, F. Liu, Q. Wang, X. Zhao, T. Li, Content-aware point-of-interest recommendation based on convolutional neural network, Appl. Intell., 49 (2019), 858–871. https://doi.org/10.1007/s10489-018-1276-1 doi: 10.1007/s10489-018-1276-1
|
| [12] |
G. Li, Q. Chen, B. Zheng, H. Yin, Q. V. H. Nguyen, X. Zhou, Group-based recurrent neural networks for POI recommendation, ACM/IMS Trans. Data Sci., 1 (2020), 1–18. https://doi.org/10.1145/3343037 doi: 10.1145/3343037
|
| [13] |
C. Liu, J. Liu, J. Wang, S. Xu, H. Han, Y. Chen, An attention-based spatiotemporal gated recurrent unit network for point-of-interest recommendation, ISPRS Int. J. Geo-Inf., 8 (2019), 355. https://doi.org/10.3390/ijgi8080355 doi: 10.3390/ijgi8080355
|
| [14] |
D. Li, Z. Gong, D. Zhang, A common topic transfer learning model for crossing city POI recommendations, IEEE Trans. Cybern., 49 (2018), 4282–4295. https://doi.org/10.1109/TCYB.2018.2861897 doi: 10.1109/TCYB.2018.2861897
|
| [15] |
Z. Guo, K. Yu, N. Kumar, W. Wei, S. Mumtaz, M. Guizani, Deep-Distributed-Learning-Based POI recommendation under mobile-edge networks, IEEE Internet Things J., 10 (2022), 303–317. https://doi.org/10.1109/JIOT.2022.3202628 doi: 10.1109/JIOT.2022.3202628
|
| [16] |
M. Gan, Y. Ma, Mapping user interest into hyper-spherical space: A novel POI recommendation method, Inf. Process. Manage., 60 (2023), 103169. https://doi.org/10.1016/j.ipm.2022.103169 doi: 10.1016/j.ipm.2022.103169
|
| [17] |
M. B. Hossain, M. S. Arefin, I. H. Sarker, M. Kowsher, P. K. Dhar, T. Koshiba, CARAN: A Context-Aware Recency based Attention Network for point-of-interest recommendation, IEEE Access, 10 (2022), 36299–36310. https://doi.org/10.1109/ACCESS.2022.3161941 doi: 10.1109/ACCESS.2022.3161941
|
| [18] |
Y. C. Chen, T. Thaipisutikul, T. K. Shih, A learning-based POI recommendation with spatiotemporal context awareness, IEEE Trans. Cybern., 5 (2020), 2453–2466. https://doi.org/10.1109/TCYB.2020.3000733 doi: 10.1109/TCYB.2020.3000733
|
| [19] |
P. Han, S. Shang, A. Sun, P. Zhao, K. Zheng, X. Zhang, Point-of-interest recommendation with global and local context, IEEE Trans. Knowl. Data Eng., 34 (2021), 5484–5495. https://doi.org/10.1109/TKDE.2021.3059744 doi: 10.1109/TKDE.2021.3059744
|
| [20] |
X. Li, M. Jiang, H. Hong, L. Liao, A time-aware personalized point-of-interest recommendation via high-order tensor factorization, ACM Trans. Inf. Syst., 35 (2017), 1–23. https://doi.org/10.1145/3057283 doi: 10.1145/3057283
|
| [21] | J. He, X. Li, L. Liao, Category-aware next point-of-interest recommendation via listwise bayesian personalized ranking, in Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, AAAI Press, (2017), 1837–1843. |
| [22] |
J. He, X. Li, L. Liao, Next point-of-interest recommendation via a category-aware Listwise Bayesian Personalized Ranking, J. Comput. Sci., 28 (2018), 206–216. https://doi.org/10.1016/j.jocs.2017.09.014 doi: 10.1016/j.jocs.2017.09.014
|
| [23] |
X. Li, D. Han, J. He, L. Liao, M. Wang, Next and next new POI recommendation via latent behavior pattern inference, ACM Trans. Inf. Syst., 37 (2019), 1–28. https://doi.org/10.1145/3354187 doi: 10.1145/3354187
|
| [24] |
P. Zhao, A. Luo, Y. Liu, J. Xu, Z. Li, F. Zhuang, et al., Where to go next: A spatio-temporal gated network for next poi recommendation, IEEE Trans. Knowl. Data Eng., 34 (2020), 2512–2524. https://doi.org/10.1109/TKDE.2020.3007194 doi: 10.1109/TKDE.2020.3007194
|
| [25] | Y. Wu, K. Li, G. Zhao, X. Qian, Long-and short-term preference learning for next POI recommendation, in Proceedings of the 28th ACM International Conference on Information and Knowledge Management, ACM, (2019), 2301–2304. https://doi.org/10.1145/3357384.3358171 |
| [26] | J. Ni, P. Zhao, J. Xu, J. Fang, Z. Li, X. Xian, et al., Spatio-temporal self-attention network for next POI recommendation, in Web and Big Data: 4th International Joint Conference, Springer, (2020), 409–423. https://doi.org/10.1007/978-3-030-60259-8_30 |
| [27] | K. Zhao, Y. Zhang, H. Yin, J. Wang, K. Zheng, X. Zhou, et al., Discovering subsequence patterns for next POI recommendation, in Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, (2020), 3216–3222. https://doi.org/10.24963/ijcai.2020/445 |
| [28] |
Z. Wang, Y. Zhu, Q. Zhang, H. Liu, C. Wang, T. Liu, Graph-enhanced spatial-temporal network for next POI recommendation, ACM Trans. Knowl. Discovery Data, 16 (2022), 1–21. https://doi.org/10.1145/3513092 doi: 10.1145/3513092
|
| [29] |
J. Fang, X. Meng, URPI-GRU: An approach of next POI recommendation based on user relationship and preference information, Knowledge-Based Syst., 256 (2022), 109848. https://doi.org/10.1016/j.knosys.2022.109848 doi: 10.1016/j.knosys.2022.109848
|
| [30] |
C. Zheng, D. Tao, J. Wang, L. Cui, W. Ruan, S. Yu, Memory augmented hierarchical attention network for next point-of-interest recommendation, IEEE Trans. Comput. Social Syst., 8 (2020), 489–499. https://doi.org/10.1109/TCSS.2020.3036661 doi: 10.1109/TCSS.2020.3036661
|
| [31] |
L. Huang, Y. Ma, Y. Liu, K. He, DAN-SNR: A deep attentive network for social-aware next point-of-interest recommendation, ACM Trans. Internet Technol., 21 (2020), 1–27. https://doi.org/10.1145/3430504 doi: 10.1145/3430504
|
| [32] | Y. Lai, Y. Su, L. Wei, G. Chen, T. Wang, D. Zha, Multi-view Spatial-Temporal Enhanced Hypergraph Network for next POI recommendation, in Database Systems for Advanced Applications, Springer, (2023), 237–252. https://doi.org/10.1007/978-3-031-30672-3_16 |
| [33] | P. Lan, Y. Zhang, H. Xiang, Y. Wang, W. Zhou, Spatio-temporal position-extended and gated-deep network for next POI recommendation, in Database Systems for Advanced Applications, Springer, (2023), 505–520. https://doi.org/10.1007/978-3-031-30672-3_34 |
| [34] | A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, et al., Attention is all you need, in Proceedings of the 31st International Conference on Neural Information Processing Systems, Curran Associates Inc., (2017), 6000–6010. |
| [35] |
T. Wu, R. Zhu, S. Wan, Semantic map guided identity transfer GAN for person re-identification, ACM Trans. Multimedia Comput. Commun. Appl., 2023 (2023). https://doi.org/10.1145/3631355 doi: 10.1145/3631355
|
| [36] | Z. Liu, Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, et al., Swin Transformer: Hierarchical vision transformer using shifted windows, in 2021 IEEE/CVF International Conference on Computer Vision (ICCV), IEEE, (2021), 9992–10002. https://doi.org/10.1109/ICCV48922.2021.00986 |
| [37] | Z. Liu, J. Ning, Y. Cao, Y. Wei, Z. Zhang, S. Lin, et al., Video Swin Transformer, in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2022), 3192–3201. https://doi.org/10.1109/CVPR52688.2022.00320 |
| [38] | J. Devlin, M. W. Chang, K. Lee, K. Toutanova, Bert: Pre-training of deep bidirectional transformers for language understanding, in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics, (2019), 4171–4186. https://doi.org/10.18653/v1/N19-1423 |
| [39] | H. Sun, S. Geng, J. Zhong, H. Hu, K. He, Graph Hawkes Transformer for extrapolated reasoning on temporal knowledge graphs, in Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, (2022), 7481–7493. https://doi.org/10.18653/v1/2022.emnlp-main.507 |
| [40] | C. Ying, T. Cai, S. Luo, S. Zheng, G. Ke, D. He, et al., Do transformers really perform badly for graph representation, in Advances in Neural Information Processing Systems, Curran Associates, Inc., 34 (2021), 28877–28888. |
| [41] | J. Chen, K. Gao, G. Li, K. He, NAGphormer: A tokenized graph transformer for node classification in large graphs, in Proceedings of the Eleventh International Conference on Learning Representations, 2022. |
| [42] |
Q. Li, X. Xu, X. Liu, Q. Chen, An attention-based spatiotemporal GGNN for next POI recommendation, IEEE Access, 10 (2022), 26471–26480. https://doi.org/10.1109/ACCESS.2022.3156618 doi: 10.1109/ACCESS.2022.3156618
|
| [43] | L. Zhang, Z. Sun, Z. Wu, J. Zhang, Y. S. Ong, X. Qu, Next point-of-interest recommendation with inferring multi-step future preferences, in Proceedings of the 31st International Joint Conference on Artificial Intelligence, International Joint Conferences on Artificial Intelligence Organization, (2022), 3751–3757. https://doi.org/10.24963/ijcai.2022/521 |
Figures(7) / Tables(5)
Jing Chen, Weiyu Ye, Shaowei Kang. Learning user preferences from Multi-Contextual Sequence influences for next POI recommendation[J]. Electronic Research Archive, 2024, 32(1): 486-504. doi: 10.3934/era.2024024
DownLoad: