Multimodal Implicit Sentiment Analysis for Tourism Development: A Systematic Literature Review

Authors

  • Yoannes Romando Sipayung Indonesia
  • Mochamad Agung Wibowo Indonesia
  • Ridwan Sanjaya Indonesia
Pages Icon

DOI:

https://doi.org/10.63158/journalisi.v8i1.1436

Keywords:

Multimodal Sentiment Analysis, Implicit Sentiment, Tourism Development, Systematic Literature Review

Abstract

This study aims to examine the application of multimodal approaches in implicit sentiment detection within the tourism sector to support data-driven digital development strategies. This review identifies prevailing trends, methodologies, datasets, and scientific novelties in multimodal sentiment analysis capable of capturing hidden emotions, such as sarcasm and ambiguity, in tourist reviews. Using a systematic literature review approach, ten core studies published between 2020 and 2025 were analyzed to identify prevailing research trends, dominant methodological frameworks, commonly used datasets, and emerging scientific contributions. Results demonstrate that multimodal deep learning models—particularly those employing attention-based fusion and contrastive learning—consistently outperform unimodal approaches in recognizing nuanced tourist emotions that are not explicitly stated in text. Despite these advances, the review reveals a significant gap in tourism-specific and Indonesian-context studies, as well as an overreliance on general-purpose social media datasets. This review provides a conceptual and methodological foundation for implementing multimodal implicit sentiment analysis in tourism decision-making systems, enabling destination managers and policymakers to develop early warning mechanisms for tourist dissatisfaction, enhance destination quality assessment, and support more targeted and sustainable tourism development strategies.

Downloads

Download data is not yet available.

References

[1] K. K. Anele and C. C. Sam-Otuonye, “Sustainable Tourism: Evidence from Lake Toba in North Sumatra, Indonesia,” ASEAN J. Hosp. Tour., vol. 19, no. 1, pp. 52–62, 2021, doi: 10.5614/ajht.2021.19.1.05.

[2] I. W. R. Junaedi et al., “Investment Opportunities and Tourism Business Development in The Village of Siallagan Village, Batak Adat Village,” Int. Bus. Account. Res. J., vol. 7, no. 2, pp. 253–268, 2023.

[3] Y. Wang and H. Bai, “The impact and regional heterogeneity analysis of tourism development on urban-rural income gap,” Econ. Anal. Policy, vol. 80, no. October, pp. 1539–1548, 2023, doi: 10.1016/j.eap.2023.10.031.

[4] D. P. Ramadhani, A. Alamsyah, M. Y. Febrianta, and L. Z. A. Damayanti, “Exploring Tourists’ Behavioral Patterns in Bali’s Top-Rated Destinations: Perception and Mobility,” J. Theor. Appl. Electron. Commer. Res., vol. 19, no. 2, pp. 743–773, 2024, doi: 10.3390/jtaer19020040.

[5] H. Tao, D. Yang, H. Zhou, and Y. Jian, “Travel experiences documented in online reviews influence travelers’ travel intentions,” Sci. Rep., vol. 15, no. 1, pp. 1–13, 2025, doi: 10.1038/s41598-025-25971-9.

[6] E. A. Mensah, D. N. A. Odame, I. Ankrah, T. Obuobisa-Darko, and R. E. Hinson, “From reviews to reflections: Understanding tourist sentiments and satisfaction in African destinations through user-generated content,” Ann. Tour. Res. Empir. Insights, vol. 6, no. 1, 2025, doi: 10.1016/j.annale.2025.100174.

[7] J. G. Martínez-Navalón, V. Gelashvili, and A. Gómez-Ortega, “Evaluation of User Satisfaction and Trust of Review Platforms: Analysis of the Impact of Privacy and E-WOM in the Case of TripAdvisor,” Front. Psychol., vol. 12, no. September, pp. 1–12, 2021, doi: 10.3389/fpsyg.2021.750527.

[8] W. Kim, S. B. Kim, and E. Park, “Mapping tourists’ destination (Dis)satisfaction attributes with user-generated content,” Sustain., vol. 13, no. 22, pp. 1–16, 2021, doi: 10.3390/su132212650.

[9] I. Nawawi, K. F. Ilmawan, M. R. Maarif, and M. Syafrudin, “Exploring Tourist Experience through Online Reviews Using Aspect-Based Sentiment Analysis with Zero-Shot Learning for Hospitality Service Enhancement,” Inf., vol. 15, no. 8, 2024, doi: 10.3390/info15080499.

[10] E. A. Mensah, D. N. A. Odame, I. Ankrah, T. Obuobisa-Darko, and R. E. Hinson, “From reviews to reflections: Understanding tourist sentiments and satisfaction in African destinations through user-generated content,” Ann. Tour. Res. Empir. Insights, vol. 6, no. 1, p. 100174, 2025, doi: 10.1016/j.annale.2025.100174.

[11] A. Budhi and I. G. A. G. Witarsana, “Pengaruh Tripadvisor Electronic Word Of Mouth Terhadap Online Booking Decision Tamu Domestik Di Bali,” J. Kepariwisataan Destin. Hosp. dan Perjalanan, vol. 6, no. 2, pp. 203–218, 2022, doi: 10.34013/jk.v6i2.414.

[12] A. N. Candrea et al., “How Do Visitors to Mountain Museums Think? A Cross-Country Perspective on the Sentiments Decoded from TripAdvisor Reviews,” Electron., vol. 14, no. 8, 2025, doi: 10.3390/electronics14081637.

[13] S. Wei and S. Song, “Sentiment Classification of Tourism Reviews Based on Visual and Textual Multifeature Fusion,” Wirel. Commun. Mob. Comput., vol. 2022, 2022, doi: 10.1155/2022/9940817.

[14] D. Erdoğan et al., “Developing a Deep Learning-Based Sentiment Analysis System of Hotel Customer Reviews for Sustainable Tourism,” Sustain., vol. 17, no. 13, 2025, doi: 10.3390/su17135756.

[15] D. Ariyus, D. Manongga, and I. Sembiring, “Enhancing Sentiment Analysis of Indonesian Tourism Video Content Commentary on TikTok: A FastText and Bi-LSTM Approach,” Eng. Technol. Appl. Sci. Res., vol. 14, no. 6, pp. 18020–18028, 2024, doi: 10.48084/etasr.8859.

[16] S. Wei and S. Song, “Sentiment Classification of Tourism Reviews Based on Visual and Textual Multifeature Fusion,” Wirel. Commun. Mob. Comput., vol. 2022, 2022, doi: 10.1155/2022/9940817.

[17] Kania Alma Tiara, A. Sanjaya, D. M. Sabilla, and Indriana, “Analisis Sentimen Destinasi Wisata Saung Angklung Udjo,” Altasia J. Pariwisata Indones., vol. 6, no. 2, pp. 144–155, 2024, doi: 10.37253/altasia.v6i2.9278.

[18] A. Balahur, J. M. Hermida, and A. Montoyo, “Detecting Implicit Expressions of Sentiment in Text Based on Commonsense Knowledge,” Proc. Annu. Meet. Assoc. Comput. Linguist., pp. 53–60, 2011.

[19] D. Zhou, J. Wang, L. Zhang, and Y. He, “Implicit Sentiment Analysis with Event-Centered Text Representation,” EMNLP 2021 - 2021 Conf. Empir. Methods Nat. Lang. Process. Proc., pp. 6884–6893, 2021, doi: 10.18653/v1/2021.emnlp-main.551.

[20] A. Joshi, P. Bhattacharyya, and M. J. Carman, “Research Question Formation Yun,” vol. 0, no. 0, 2017.

[21] A. Dataset and T. A. Dataset, “Edinburgh Research Explorer From Arabic Sentiment Analysis to Sarcasm Detection : The From Arabic Sentiment Analysis to Sarcasm Detection :,” 2020.

[22] X. Wang, X. Li, Y. Yin, and Y. Li, “Implicit aspect-based generative model for sentiment analysis based on prompt learning,” 2024 5th Int. Conf. Big Data Artif. Intell. Softw. Eng. ICBASE 2024, pp. 94–97, 2024, doi: 10.1109/ICBASE63199.2024.10762313.

[23] M. Chen, K. Ubul, X. Xu, A. Aysa, and M. Muhammat, “Connecting Text Classification with Image Classification: A New Preprocessing Method for Implicit Sentiment Text Classification,” Sensors (Basel)., vol. 22, no. 5, 2022, doi: 10.3390/s22051899.

[24] M. Devani, D. H. Padheriya, V. Jadeja, D. J. Jani, and A. Patel, “Multimodal Sentiment Analysis on Product Review Text and Image Using Machine Learning,” African J. Biomed. Res., vol. 27, no. 4, 2024, doi: 10.53555/ajbr.v27i4s.6119.

[25] K. Zhang, Y. Geng, J. Zhao, J. Liu, and W. Li, “Sentiment analysis of social media via multimodal feature fusion,” Symmetry (Basel)., vol. 12, no. 12, pp. 1–14, 2020, doi: 10.3390/sym12122010.

[26] F. Amalia, U. G. Mada, and K. Kunci, “Multimodalitas dalam unggahan di Twitter yang dianggap mengandung pelecehan seksual,” vol. 6, pp. 781–794, 2023.

[27] Y. Mao, Q. Liu, and Y. Zhang, “Sentiment analysis methods, applications, and challenges: A systematic literature review,” J. King Saud Univ. - Comput. Inf. Sci., vol. 36, no. 4, p. 102048, 2024, doi: 10.1016/j.jksuci.2024.102048.

[28] J. Chen, J. Cong, M. Li, Y. Sun, and J. Zhang, “T-ECBM: a deep learning-based text-image multimodal model for tourist attraction recommendation,” Sci. Rep., vol. 15, no. 1, pp. 1–16, 2025, doi: 10.1038/s41598-025-25630-z.

[29] P. Chen and L. Fu, “Enhancing Multimodal Tourism Review Sentiment Analysis Through Advanced Feature Association Techniques,” Int. J. Inf. Syst. Serv. Sect., vol. 15, no. 1, pp. 1–21, 2024, doi: 10.4018/IJISSS.349564.

[30] Z. Liu, T. Yang, W. Chen, J. Chen, Q. Li, and J. Zhang, “Sentiment analysis of social media comments based on multimodal attention fusion network,” Appl. Soft Comput., vol. 164, no. January, p. 112011, 2024, doi: 10.1016/j.asoc.2024.112011.

[31] Y. Liu, Z. Zheng, B. Zhou, J. Ma, L. Sun, and R. Xia, “Multimodal Sarcasm Detection Based on Multimodal Sentiment Co-training,” Proc. - 2022 IEEE SmartWorld, Ubiquitous Intell. Comput. Auton. Trust. Veh. Scalable Comput. Commun. Digit. Twin, Priv. Comput. Metaverse, Autonomous & Trusted Vehicles, 2022, pp. 508–515, 2022.

[32] J. Y. M. Nip and B. Berthelier, “Social Media Sentiment Analysis,” Encyclopedia, vol. 4, no. 4, pp. 1590–1598, 2024, doi: 10.3390/encyclopedia4040104.

[33] Y. Chen et al., “Mining Social Media Data to Capture Urban Park Visitors’ Perception of Cultural Ecosystem Services and Landscape Factors,” Forests, vol. 15, no. 1, 2024, doi: 10.3390/f15010213.

[34] X. Xiao et al., “Collaborative fine-grained interaction learning for image–text sentiment analysis,” Knowledge-Based Syst., vol. 279, p. 110951, 2023, doi: 10.1016/j.knosys.2023.110951.

[35] H. Hu, Y. Wan, K. Y. Tang, Q. Li, and X. Wang, “Affective-Computing-Driven Personalized Display of Cultural Information for Commercial Heritage Architecture,” Appl. Sci., vol. 15, no. 7, pp. 1–20, 2025, doi: 10.3390/app15073459.

[36] A. Boumhidi, A. Benlahbib, and E. H. Nfaoui, “Aggregating Users’ Online Opinions Attributes and News Influence for Cryptocurrencies Reputation Generation,” J. Univers. Comput. Sci., vol. 29, no. 6, pp. 546–568, 2023, doi: 10.3897/jucs.85610.

[37] H. Yang and J. Chen, “Art appreciation model design based on improved PageRank and ECA-ResNeXt50 algorithm,” PeerJ Comput. Sci., vol. 9, pp. 1–17, 2023, doi: 10.7717/PEERJ-CS.1734.

[38] Y. Han and Z. Xu, “Fostering college students’ mental well-being: the impact of social networking site utilization on emotion management and regulation,” BMC Psychol., vol. 12, no. 1, 2024, doi: 10.1186/s40359-024-02186-7.

[39] N. Silva, P. J. S. Cardoso, and J. M. F. Rodrigues, “Multimodal Sentiment Classifier Framework for Different Scene Contexts,” Appl. Sci., vol. 14, no. 16, 2024, doi: 10.3390/app14167065.

[40] Z. Liu, B. Zhou, D. Chu, Y. Sun, and L. Meng, “Modality translation-based multimodal sentiment analysis under uncertain missing modalities,” Inf. Fusion, vol. 101, no. April 2023, p. 101973, 2024, doi: 10.1016/j.inffus.2023.101973.

[41] G. Mu, Y. Chen, X. Li, L. Dai, and J. Dai, “Semantic enhancement and cross-modal interaction fusion for sentiment analysis in social media,” PLoS One, vol. 20, no. 4 April, pp. 1–26, 2025, doi: 10.1371/journal.pone.0321011.

[42] L. Jixian, A. Gang, S. Zhihao, and S. Xiaoqiang, “Social Media Multimodal Information Analysis based on the BiLSTM-Attention-CNN-XGBoost Ensemble Neural Network,” Int. J. Adv. Comput. Sci. Appl., vol. 13, no. 12, pp. 104–111, 2022, doi: 10.14569/IJACSA.2022.0131215.

Downloads

Published

2026-03-01

Issue

Vol. 8 No. 1 (2026): February

Section

Articles

License

Copyright (c) 2026 Journal of Information Systems and Informatics

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors Declaration

  1. The Authors certify that they have read, understood, and agreed to the Journal of Information Systems and Informatics (JournalISI) submission guidelines, policies, and submission declaration. The submission has been prepared using the provided template.
  2. The Authors certify that all authors have approved the publication of this manuscript and that there is no conflict of interest.
  3. The Authors confirm that the manuscript is their original work, has not received prior publication, is not under consideration for publication elsewhere, and has not been previously published.
  4. The Authors confirm that all authors listed on the title page have contributed significantly to the work, have read the manuscript, attest to the validity and legitimacy of the data and its interpretation, and agree to its submission.
  5. The Authors confirm that the manuscript is not copied from or plagiarized from any other published work.
  6. The Authors declare that the manuscript will not be submitted for publication in any other journal or magazine until a decision is made by the journal editors.
  7. If the manuscript is finally accepted for publication, the Authors confirm that they will either proceed with publication immediately or withdraw the manuscript in accordance with the journal’s withdrawal policies.
  8. The Authors agree that, upon publication of the manuscript in this journal, they transfer copyright or assign exclusive rights to the publisher, including commercial rights

How to Cite

[1]
Y. R. Sipayung, M. A. Wibowo, and R. Sanjaya, “Multimodal Implicit Sentiment Analysis for Tourism Development: A Systematic Literature Review”, journalisi, vol. 8, no. 1, pp. 781–808, Mar. 2026, doi: 10.63158/journalisi.v8i1.1436.

Most read articles by the same author(s)