Comparative Sentiment Analysis of TheoTown Reviews on Steam and Google Play Store Using Support Vector Machine

Shanda Aura; Dian Novianto

doi:10.57152/malcom.v6i2.2661

Authors

Shanda Aura Institut Sains dan Bisnis Atma Luhur
Dian Novianto Institut Sains dan Bisnis Atma Luhur

DOI:

https://doi.org/10.57152/malcom.v6i2.2661

Keywords:

Google Play Store, Sentiment Analysis, Steam, Support Vector Machine, User Reviews

Abstract

The rapid expansion of the digital gaming industry has led to a substantial increase in player-generated textual reviews across major distribution platforms such as the Google Play Store and Steam. These reviews offer valuable insights into user experiences and perceived game quality; however, their large volume renders manual analysis inefficient. This study explores cross-platform sentiment patterns of TheoTown using a Support Vector Machine (SVM) classification approach. A dataset comprising 24,754 Google Play Store reviews and 1,452 Steam reviews, collected between January 2021 and December 2025, was processed using a structured pipeline that included text cleaning, normalization, tokenization, stopword removal, and stemming, followed by TF-IDF feature extraction. The findings indicate that a linear SVM model delivers consistently strong performance across both platforms, achieving F1 Scores exceeding 97%. Nevertheless, differences appear in probabilistic evaluation, where the Google Play Store dataset attains a higher AUC (0.8501) than Steam (0.6114). Both datasets are highly dominated by positive sentiment (above 94%), yet the Steam model fails to detect negative instances, highlighting the effects of severe class imbalance and limited data. These results emphasize that platform ecosystems influence both sentiment expression and model performance, underscoring the importance of cross-platform analysis.

Downloads

Download data is not yet available.

References

Y. Firmansyah, R. Kurniawan, and Y. A. Wijaya, “Analisis Data Sentimen Pemain Game Role-Playing Game (RPG) Honkai Star Rail dengan Algoritma Naive Bayes,” J. Inform. dan Rekayasa Perangkat Lunak, vol. 6, no. 1, pp. 127–135, 2024.

A. T. Bisono and A. Zulherry, “Analisis Sentimen Game Genshin Impact untuk Mengetahui Reaksi dan Harapan Pemain Menggunakan Metode Naïve Bayes,” sudo J. Tek. Inform., vol. 4, no. 2, pp. 183–193, 2025, doi: 10.56211/sudo.v4i2.1131.

M. Haikal, Martanto, and U. Hayati, “Analisis Sentimen Terhadap Penggunaan Aplikasi Game Online Pubg Mobile,” JATI (Jurnal Mhs. Tek. Inform., vol. 7, no. 6, pp. 3275–3281, 2024.

V. Fazrian, T. Suprapti, and R. Narasati, “Penerapan Algoritma Naive Bayes Terhadap Analisis Sentimen Aplikasi Game Multiplayer Online Battle Arena,” JATI (Jurnal Mhs. Tek. Inform., vol. 8, no. 1, pp. 1005–1012, 2024, doi: 10.36040/jati.v8i1.8432.

A. H. Nurdy, A. Rahim, and Arbansyah, “Analisis Sentimen Ulasan Game Stumble Guys Pada Playstore Menggunakan Algoritma Naïve Bayes,” Teknika, vol. 13, no. 3, pp. 388–395, 2024, doi: 10.34148/teknika.v13i3.993.

M. Haris, A. Suharso, and E. H. Nurkifli, “Analisis Sentimen Pada Game Efootball Di Google Play Store Menggunakan Algoritma Indobert,” JATI (Jurnal Mhs. Tek. Inform., vol. 8, no. 6, pp. 12108–12121, 2024, doi: 10.36040/jati.v8i6.11810.

R. Rahmadani, A. Rahim, and R. Rudiman, “Analisis Sentimen Ulasan ‘Ojol the Game’ Di Google Play Store Menggunakan Algoritma Naive Bayes Dan Model Ekstraksi Fitur Tf-Idf Untuk Meningkatkan Kualitas Game,” J. Inform. dan Tek. Elektro Terap., vol. 12, no. 3, 2024, doi: 10.23960/jitet.v12i3.4988.

Y. S. Wardhana and A. K. Ayundyah Kesumawati, “Implementasi Klasifikasi Naive Bayes dan Pemodelan Topik dengan Latent Dirichlet Allocation untuk Data Ulasan Video Game Lokal Pada Platform Steam,” Emerg. Stat. Data Sci. J., vol. 1, no. 3, pp. 345–353, 2023, doi: 10.20885/esds.vol1.iss.3.art41.

H. Benarafa, M. Benkhalifa, and M. Akhloufi, “An Enhanced SVM Model for Implicit Aspect Identification in Sentiment Analysis Halima,” J. Adv. Inf. Technol., vol. 15, no. 7, pp. 838–852, 2024, doi: 10.12720/jait.15.7.838-852.

M. Tabany and M. Gueffal, “Sentiment Analysis and Fake Amazon Reviews Classification Using SVM Supervised Machine Learning Model,” J. Adv. Inf. Technol., vol. 15, no. 1, pp. 49–58, 2024, doi: 10.12720/jait.15.1.49-58.

M. Isnan, G. N. Elwirehardja, and B. Pardamean, “Sentiment Analysis for TikTok Review Using VADER Sentiment and SVM Model,” Procedia Comput. Sci., vol. 227, pp. 168–175, 2023, doi: 10.1016/j.procs.2023.10.514.

A. Daza, N. D. González Rueda, M. S. Aguilar Sánchez, W. F. Robles Espíritu, and M. E. Chauca Quiñones, “Sentiment Analysis on E-Commerce Product Reviews Using Machine Learning and Deep Learning Algorithms: A Bibliometric Analysisand Systematic Literature Review, Challenges and Future Works,” Int. J. Inf. Manag. Data Insights, vol. 4, no. 2, 2024, doi: 10.1016/j.jjimei.2024.100267.

A. Patel, P. Oza, and S. Agrawal, “Sentiment Analysis of Customer Feedback and Reviews for Airline Services using Language Representation Model,” Procedia Comput. Sci., vol. 218, pp. 2459–2467, 2022, doi: 10.1016/j.procs.2023.01.221.

Z. Jamshidzadeh, M. Ehteram, and H. Shabanian, “Bidirectional Long Short-Term Memory (BILSTM) - Support Vector Machine: A new machine learning model for predicting water quality parameters,” Ain Shams Eng. J., vol. 15, no. 3, 2024, doi: 10.1016/j.asej.2023.102510.

A. Gatera, M. Kuradusenge, G. Bajpai, C. Mikeka, and S. Shrivastava, “Comparison of random forest and support vector machine regression models for forecasting road accidents,” Sci. African, vol. 21, p. e01739, 2023, doi: 10.1016/j.sciaf.2023.e01739.

C. Li, J. Zhou, K. Du, and D. Dias, “Stability prediction of hard rock pillar using support vector machine optimized by three metaheuristic algorithms,” Int. J. Min. Sci. Technol., vol. 33, no. 8, pp. 1019–1036, 2023, doi: 10.1016/j.ijmst.2023.06.001.

R. Yunita and M. Kamayani, “Perbandingan Algoritma SVM Dan Naive Bayes Pada Analisis Sentimen Kebijakan Penghapusan Kewajiban Skripsi,” Indones. J. Comput. Sci., vol. 12, no. 1, pp. 2879–2890, 2023.

W. Ningsih, B. Alfianda, R. Rahmaddeni, and D. Wulandari, “Comparison of Naive Bayes and SVM Algorithms in Twitter Sentiment Analysis on Electric Car Use in Indonesia,” MALCOM Indones. J. Mach. Learn. Comput. Sci., vol. 4, no. 2, pp. 556–562, 2024, doi: 10.57152/malcom.v4i2.1253.

A. Supian, B. T. Revaldo, N. Marhadi, L. Efrizoni, and Rahmaddeni, “Perbandingan Kinerja Naïve Bayes Dan Svm Pada Analisis Sentimen Twitter Ibukota Nusantara,” J. Ilm. Inform., vol. 12, no. 01, pp. 15–21, 2024, doi: 10.33884/jif.v12i01.8721.

A. N. Syafia, M. F. Hidayattullah, and W. Suteddy, “Studi Komparasi Algoritma SVM Dan Random Forest Pada Analisis Sentimen Komentar Youtube BTS,” J. Inform. J. Pengemb. IT, vol. 8, no. 3, pp. 207–212, 2023, doi: 10.30591/jpit.v8i3.5064.

P. Fremmuzar and A. Baita, “Uji Kernel SVM dalam Analisis Sentimen Terhadap Layanan Telkomsel di Media Sosial Twitter,” Komputika J. Sist. Komput., vol. 12, no. 2, pp. 57–66, 2023, doi: 10.34010/komputika.v12i2.9460.

B. A. Maulana, M. J. Fahmi, A. M. Imran, and N. Hidayati, “Analisis Sentimen Terhadap Aplikasi Pluang Menggunakan Algoritma Naive Bayes dan Support Vector Machine (SVM),” MALCOM Indones. J. Mach. Learn. Comput. Sci., vol. 4, no. 2, pp. 375–384, 2024, doi: 10.57152/malcom.v4i2.1206.

A. A. Munandar, Farikhin, and C. E. Widodo, “Sentimen Analisis Aplikasi Belajar Online Menggunakan Klasifikasi SVM,” JOINTECS (Journal Inf. Technol. Comput. Sci., vol. 8, no. 2, p. 77, 2023, doi: 10.31328/jointecs.v8i2.4747.

S. Rabbani, D. Safitri, N. Rahmadhani, A. A. F. Sani, and M. K. Anam, “Perbandingan Evaluasi Kernel SVM untuk Klasifikasi Sentimen dalam Analisis Kenaikan Harga BBM: Comparative Evaluation of SVM Kernels for Sentiment Classification in Fuel Price Increase Analysis,” MALCOM Indones. J. Mach. Learn. Comput. Sci., vol. 3, no. 2, pp. 153–160, 2023.

S. D. Parameswari, M. Lubis, S. Suakanto, Y. Z. Ramadhan, R. N. Amanah, and R. A. Dila, “Studi Perbandingan Naïve Bayes dan Support Vector Machine (SVM) dalam Analisis Sentimen Pengguna Metaverse,” J. Teknol. dan Manaj. Ind. Terap., vol. 4, no. 3, pp. 1059–1065, 2025, doi: 10.55826/jtmit.v4i3.1122.

A. Pangestu, Y. T. Arifin, and R. A. Safitri, “Analisis Sentimen Review Publik Pengguna Game Online Pada Platform Steam Menggunakan Algoritma Naïve Bayes,” JATI (Jurnal Mhs. Tek. Inform., vol. 7, no. 6, pp. 3106–3113, 2024, doi: 10.36040/jati.v7i6.8829.

Harnelia and R. A. Saputra, “Analisis Sentimen Review Skincare Skintific Dengan Algoritma Support Vector Machine (Svm),” J. Inform. dan Tek. Elektro Terap., vol. 12, no. 2, 2024, doi: 10.23960/jitet.v12i2.4095.

D. Atmajaya, A. Febrianti, and H. Darwis, “Metode SVM dan Naive Bayes untuk Analisis Sentimen ChatGPT di Twitter,” Indones. J. Comput. Sci., vol. 12, no. 2, pp. 284–301, 2023, [Online]. Available: http://ijcs.stmikindonesia.ac.id/ijcs/index.php/ijcs/article/view/3135

I. S. K. Idris, Y. A. Mustofa, and I. A. Salihi, “Analisis Sentimen Terhadap Penggunaan Aplikasi Shopee Mengunakan Algoritma Support Vector Machine (SVM),” Jambura J. Electr. Electron. Eng., vol. 5, no. 1, pp. 32–35, 2023, doi: 10.37905/jjeee.v5i1.16830.

S. K. Lubis, M. H. Dar, and F. A. Nasution, “Analisis Sentimen Ulasan Pengguna Aplikasi pada Google Play Store Menggunakan Algoritma Support Vector Machine,” Informatika, vol. 11, no. 2, pp. 120–128, 2024, doi: 10.36987/informatika.v11i2.5860.

N. N. A. Aryanti and O. Suria, “Analisis Sentimen Terhadap Pemutusan Hubungan Kerja Di Indonesia?: Komparasi Indobert Dengan Svm , Random Forest , Dan Decision Tree Dengan Optimasi TF - IDF,” RABIT J. Teknol. dan Sist. Inf. Univrab, vol. 10, no. 2, pp. 1158–1176, 2025, doi: https://doi.org/ 10.36341/rabit.v10i2.6364.

A. Handayani and I. Zufria, “Analisis Sentimen Terhadap Bakal Capres RI 2024 di Twitter Menggunakan Algoritma SVM,” J. Inf. Syst. Res., vol. 5, no. 1, pp. 53–63, 2023, doi: 10.47065/josh.v5i1.4379.

M. R. T. Wardhana, A. Septiandy, I. Sintani, V. S. Anugrah, S. D. Cahya, and Widiatry, “Systematic Review Penggunaan Isolation Forest Dan Support Vector Machine Untuk Anomaly Detection,” JATI (Jurnal Mhs. Tek. Inform., vol. 10, no. 1, pp. 50–56, 2026.