Integrating Aspect-Based Sentiment Analysis with CSI–IPA for Telecommunications App Development

Siti Hariza Marshella; Dedy Kurniawan; Nabila Rizky Oktadini; Rudi Sanjaya; Putri Eka Sevtiyuni; Naretha Kawadha Pasemah Gumay

doi:10.63158/journalisi.v7i4.1363

Siti Hariza Marshella Universitas Sriwijaya, Indonesia
Dedy Kurniawan Universitas Sriwijaya, Indonesia
Nabila Rizky Oktadini Universitas Sriwijaya, Indonesia
Rudi Sanjaya Universitas Sriwijaya, Indonesia
Putri Eka Sevtiyuni Universitas Sriwijaya, Indonesia
Naretha Kawadha Pasemah Gumay Universitas Sriwijaya, Indonesia

DOI: 10.63158/journalisi.v7i4.1363

Keywords: ABSA; CSI; IPA; Product Development Strategy; Telecommunications

Abstract

This study integrates Aspect-Based Sentiment Analysis with Customer Satisfaction Index (CSI) and Importance Performance Analysis (IPA) to determine priority development features in digital service applications in the telecommunications sector. A total of 10,000 MyIM3 user reviews were analyzed using sentiment analysis with Pseudo-labeling and Fine-Tuned IndoBERT, then from the results of the analysis, negative sentiment was mapped into several topics using LDA. The topic is used to compile question indicators based on the five dimensions of SERVQUAL. After the questionnaire data is declared valid and reliable, CSI and IPA analysis is carried out. A CSI value of 79.22% indicates that user satisfaction is in the "borderline" category, but several aspects still need to be improved, especially system updates (RS3), application attention to user needs (E2), and feature personalization (E3) which are in quadrant I (Concentrate Here). This hybrid approach offers novelty by demonstrating how ABSA and LDA can be systematically integrated with CSI and IPA to provide more comprehensive and user-oriented insights. The limitations of this study include focusing on negative sentiment data for feature exploration, as it is most relevant for identifying problems and opportunities for improvement and development of telecommunication digital services.

Downloads

Download data is not yet available.

References

F. Saputra, Y. Lake, E. T. Taena, 2universitas Timor, and 3universitas Timor, “Pengaruh Kualitas Pelayanan Terhadap Kepuasan Pelanggan Telekomunikasi PT. Telkom Indonesia,” Jurnal Manajemen Bisnis Dan Organisasi (JMBO), vol. Vol 3 No 2, 2024, doi: 10.58290/jmbo.v3i2.327.

Y. Yudiana, A. Y. Agustina, and N. Khofifah, “Prediksi Customer Churn Menggunakan Metode CRISP-DM Pada Industri Telekomunikasi Sebagai Implementasi Mempertahankan Pelanggan,” Indonesian Journal of Islamic Economics and Business, vol. 8, no. 1, pp. 1–20, 2023, doi: 10.30631/ijoieb.v8i1.1710.

O. S. Ighomereho, T. S. Afolabi, and A. O. Oluwakoya, “Impact of E-service quality on customer satisfaction: a study of internet banking for general and maritime services in Nigeria,” Journal of Financial Services Marketing, vol. 28, no. 3, pp. 488–501, Sep. 2023, doi: 10.1057/s41264-022-00164-x.

S. Wahono and H. Ali, “Peranan Data Warehouse, Software Dan Brainware Terhadap Pengambilan Keputusan (Literature Review Executive Support Sistem for Business),” Jurnal Ekonomi Manajemen Sistem Informasi, vol. 3, no. 2, pp. 225–239, 2021, doi: 10.31933/jemsi.v3i1.

A. Syaifullah, “Analisis Perbandingan Pengalaman Pengguna Dan Kualitas Layanan Pada Aplikasi Dana Dan Ovo Menggunakan Metode Ueq Dan Ipa,” Jurnal Teknologi Sistem Informasi dan Aplikasi, 2024, vol. 7, no. 3, pp.1128-1139, 2024, doi: 10.32493/jtsi.v7i3.40512.

T. L. Windyaningrum and C. D. Indrawati, “Integrasi Metode Service Performance (SERVPERF), Importance Performance Analysis (IPA) Dan Customer Satisfaction Index (CSI) Dalam Penentuan Prioritas Pengembangan Lembaga Pendidikan Nonformal,” JUSTER: Jurnal Sains Dan Terapan, vol. 2, no. 1, pp. 112–121, 2023, doi : 10.57218/juster.v2i1.522.

A. R. Maulani, T. Wahyudi, and R. Rahmawati, “Pengukuran Tingkat Kepuasan Konsumen Aplikasi Mypertamina Dengan Metode Servqual, CSI, Dan IPA,” INTEGRATE: Industrial Engineering and Management System, vol. 7, no. 3, pp. 19–25, 2023.

A. N. Febrianto, “Analysis of Google Play Store Reviews Using Natural Language Processing (NLP) and Importance Performance Analysis (IPA) for the Development of Mobile Banking Application Businesses Wondr BNI,” Enrichment: Journal of Multidisciplinary Research and Development, vol. 3, no. 6, pp. 1198–1212, 2025, doi : 10.55324/enrichment.v3i6.501.

R. Marbun, “Analisis Sentimen Ulasan Pengguna Terhadap Aplikasi BRImo BRI pada Situs Google Play Store Menggunakan Metode Naive Bayes dan Customer Satisfaction Index (CSI)", Diss, Universitas Lancang Kuning, 2024.

R. Rosmaladewi, “Pengukuran Kepuasan Pelanggan Lazada Berdasarkan Opinion Mining Menggunakan Algoritma Support Vector Machine, Customer Satisfaction Index dan Importance Performance Analysis,” Tesis, Universitas Hasanuddin, Makassar, Indonesia, 2023.

A. R. Fadilla and P. A. Wulandari, “Literature review analisis data kualitatif: tahap pengumpulan data,” Mitita Jurnal Penelitian, vol. 1, no. 3, pp. 34–46, 2023.

A. Kusumastuti, A. M. Khoiron, and T. A. Achmad, Metode penelitian kuantitatif. Deepublish, 2021.

E. P. Setiani, “The impact of ESG scores on corporate financial performance: Moderating role of gender diversity,” Nominal: Barometer Riset Akuntansi dan Manajemen, vol. 12, no. 1, pp. 128–139, 2023, doi: 10.21831/nominal.v12i1.59778

H. S. : J. S. I. Halomoan Limbong, “Optimasi Analisis Sentimen Ulasan Aplikasi Amikom One Menggunakan SMOTE pada Algoritma Artificial Neural Network Optimization of Sentiment Analysis for Amikom One Application Reviews Using SMOTE with Artificial Neural Network Algorithm,” Sistemasi : Jurnal Sistem Informasi, vol. 13, no. 5, pp. 2540–9719, 2024.

K. C. Astuti, A. Firmansyah, and A. Riyadi, “Implementasi text mining untuk analisis sentimen masyarakat terhadap ulasan aplikasi digital Korlantas Polri pada Google Play Store,” Remik: Riset dan E-Jurnal Manajemen Informatika Komputer, vol. 8, no. 1, pp. 383–394, 2024, doi: 10.33395/remik.v8i1.13421.

A. S. Aribowo, H. Basiron, N. F. A. Yusof, and S. Khomsah, “Cross-domain sentiment analysis model on indonesian youtube comment,” International Journal of Advances in Intelligent Informatics, vol. 7, no. 1, pp. 12–25, 2021, doi: 10.26555/ijain.v7i1.554.

Z. Abidin, A. Junaidi, and Wamiliana, “Text Stemming and Lemmatization of Regional Languages in Indonesia: A Systematic Literature Review,” Journal of Information Systems Engineering and Business Intelligence, vol. 10, no. 2, pp. 217–231, Jun. 2024, doi: 10.20473/jisebi.10.2.217-231.

Rianto, A. B. Mutiara, E. P. Wibowo, and P. I. Santosa, “Improving the accuracy of text classification using stemming method, a case of non-formal Indonesian conversation,” J Big Data, vol. 8, no. 1, Dec. 2021, doi: 10.1186/s40537-021-00413-1.

E. B. Satriawan, S. H. Wijoyo, and D. E. Ratnawati, “Analisis Sentimen Terhadap Pendapat Masyarakat Mengenai Pilkada 2024 Menggunakan Metode Support Vector Machine,” Jurnal Teknologi Informasi dan Ilmu Komputer, vol. 12, no. 4, pp. 809–818, 2025, doi: 10.25126/jtiik.124.

F. R. Andhika, W. Witanti, and P. N. Sabrina, “Analisis Sentimen Menggunakan Metode IndoBERT Pada Ulasan Aplikasi Zoom Menggunakan Fitur Ekstrasi GloVe,” METIK JURNAL (AKREDITASI SINTA 3), vol. 9, no. 2, pp. 439–448, 2025, doi: 10.47002/g38fxb78.

E. Arazo, D. Ortego, P. Albert, N. E. O’connor, and K. Mcguinness, “Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learning,” nternational joint conference on neural networks (IJCNN), pp. 1–8, 2020.

N. Cahyono, N. Nurcahyo, A. Fauzan, and R. Agung, “Analisa Perbandingan Latent Semantic Indexing (LSI) dan Latent Dirichlet Allocation (LDA) untuk Topic Modelling Aplikasi Identitas Kependudukan Digital (IKD),” Building of Informatics, Technology and Science, vol. 6, no. 3, pp. 1638–1647, 2024, doi: 10.47065/bits.v6i3.5970..

F. R. Wilujeng, G. D. Rembulan, D. Andreas, and H. Tannady, “Meningkatkan kepuasan pelanggan pada dua bisnis e-commerce terbesar di Indonesia dengan menggunakan analisis Servqual dan IPA,” Prosiding Seminar Nasional Sains dan Teknologi (Semnastek), vol. 16, pp. 1–9, Nov. 2019.

B. S. Silalahi and F. J. Kaunang, “Analisis Service Quality pada Aplikasi DANA berdasarkan Sudut Pandang Pelanggan di Daerah Bandung Barat Menggunakan Metode Servqual dan Model Kano,” TeIKa: Jurnal Teknologi Informasi dan Komunikasi, vol. 12, no. 02, pp. 121–133, Oct. 2022, doi: 10.36342/teika.v12i02.2957.

M. Agustina, V. Sahfitri, and T. Astuti, “Analysis of Online Transportation User Satisfaction Using the Customer Satisfaction Index (CSI) and Important Performance Analysis (IPA) Methods in Palembang City,” Journal of Information Systems and Informatics, vol. 4, no. 4, pp. 1063–1075, Dec. 2022, doi: 10.51519/journalisi.v4i4.396.

M. M. Rahman, “Sample size determination for survey research and non-probability sampling techniques: A review and set of recommendations,” Journal of Entrepreneurship, Business and Economics, vol. 11, no. 1, pp. 42–62, 2023.

D. Rahmadani, M. L. Hamzah, and E. Saputra, “The Influence of E-Customer Service, Mobile Application Design, Brand Image, and Customer Satisfaction on Interest in Mobile Banking Adoption,” in 2024 4th International Conference on Emerging Smart Technologies and Applications (eSmarTA), IEEE, 2024, pp. 1–6, doi: 10.1109/esmarta62850.2024.10639012.

J. F. Hair, G. T. M. Hult, C. M. Ringle, and Marko. Sarstedt, A primer on partial least squares structural equation modeling (PLS-SEM). Sage, 2017.