Unsupervised Text Mining of Employee Feedback for Identifying Organizational Strengths and Improvement Areas

Febri Ari Wicaksono; Imam Yuadi

doi:10.57152/malcom.v6i2.2482

Authors

Febri Ari Wicaksono Airlangga University
Imam Yuadi Airlangga University https://orcid.org/0000-0002-7848-1671

DOI:

https://doi.org/10.57152/malcom.v6i2.2482

Keywords:

Clustering, Employee Feedback, Organizational Analytics, Text Mining, Topic Modeling

Abstract

Employee feedback provides rich signals about organizational performance, yet its free-text format makes systematic analysis at scale difficult. This study proposes an unsupervised text mining workflow in Orange Data Mining to extract actionable themes from continuous employee comments by separating two semantic polarities: strength feedback (“What went well?”) and improvement feedback (“What could be improved?”). After cleaning and Indonesian-language preprocessing (Sastrawi stemming, custom stopwords), 3,406 strength and 3,172 improvement entries were represented using TF–IDF. Improvement feedback was clustered using K-Means and assessed with silhouette-based validation, while both feedback types were explored using LDA topic modeling supported by topic coherence checks for interpretability. The results reveal recurring organizational themes related to goal execution and performance, supervision, communication/coordination, and motivation, with notable vocabulary overlap between strengths and areas for improvement. Scientifically, this work demonstrates how polarity-aware unsupervised analytics improves interpretability compared to treating feedback as a single corpus, and practically, it provides a scalable way for managers to transform unstructured feedback into structured insights for targeted improvement initiatives.

Downloads

Download data is not yet available.

References

P. Thakral, P. R. Srivastava, S. S. Dash, S. M. Jasimuddin, and Z. J. Zhang, “Trends in the thematic landscape of HR analytics research: A structural topic modeling approach,” Management Decision, vol. 61, no. 12, pp. 3665–3690, 2023, doi: 10.1108/MD-01-2023-0080.

A. Joshi, S. Sekar, and S. Das, “Decoding employee experiences during pandemic through online reviews,” Personnel Review, vol. 53, no. 1, pp. 288–313, 2024, doi: 10.1108/PR-07-2022-0478.

J. Kim, P.-S. Chang, and S. Yang, “A comparative analysis of job satisfaction prediction models using machine learning: A mixed-method approach,” Data Technologies and Applications, vol. 59, no. 1, pp. 41–60, 2025, doi: 10.1108/DTA-10-2023-0697.

R. Tripathi, M. Thite, and A. Varma, “Appraising the revamped performance management system in Indian IT multinational enterprises: The employee perspective,” Human Resource Management, vol. 60, no. 5, pp. 475–493, 2021, doi: 10.1002/hrm.22061.

A. Malik, P. Budhwar, H. Mohan, and N. R. Srikanth, “How does algorithm-based HR predict employees’ sentiment? Developing an employee experience model through online reviews,” Industrial and Commercial Training, vol. 56, no. 4, pp. 273–289, 2024, doi: 10.1108/ICT-08-2023-0060.

X. Liu, W. Lu, S. Liu, and C. Qin, “Discovering trends and journeys in knowledge-based human resource management: Big data smart literature review based on machine learning,” IEEE Access, vol. 11, pp. 95567–95583, 2023, doi: 10.1109/ACCESS.2023.3296140.

J. R. Saura, D. Ribeiro-Soriano, and D. Palacios-Marqués, “Data-driven strategies in operation management: Mining user-generated content in business models,” Annals of Operations Research, vol. 333, no. 2, pp. 607–629, 2024, doi: 10.1007/s10479-022-04776-3.

L. Xu, M. Xi, and Y. Zhang, “Quantitative evaluation of policies for combining medical and nursing care based on the LDA–PMC model: A comparative analysis of typical Chinese provinces,” Policy Sciences, vol. 57, no. 2, pp. 321–345, 2024, doi: 10.1007/s11115-022-00675-0.

S. Hosseini, M. Farahani, and M. Manthouri, “Deep text clustering using stacked autoencoder and k-means,” Multimedia Tools and Applications, vol. 81, no. 27, pp. 38619–38644, 2022, doi: 10.1007/s11042-022-12155-0.

Y. Ding and H. Li, “Uncovering employee insights: Integrative analysis using structural topic modeling and support vector machines,” Journal of Big Data, vol. 12, no. 1, pp. 1–25, 2025, doi: 10.1186/s40537-025-01100-1.

S. Lee and Y. Choi, “Configurations of resourceful and demanding attributes of organizational culture in US hotels: An innovative approach using topic modeling and fsQCA,” Journal of Innovation & Knowledge, vol. 9, no. 4, Art. no. 100582, 2024, doi: 10.1016/j.jik.2024.100582.

R. M. Kowalski, M. A. Khanbhai, and P. Aikman, “Patients’ written reviews as a resource for public healthcare management: A text mining approach,” Procedia Computer Science, vol. 112, pp. 263–270, 2017, doi: 10.1016/j.procs.2017.08.275.

M. Mahyoub, “Hierarchical text clustering and categorisation using a semi-supervised framework,” in Proc. 12th Int. Conf. Developments in eSystems Engineering (DeSE), 2019, doi: 10.1109/DeSE.2019.00037.

S. A. Hasan, R. Wang, and M. G. Hussain, “Clustering analysis of Bangla news articles with TF-IDF and CV using mini-batch k-means and agglomerative clustering,” in Proc. IEEE CyberneticsCom, 2022, doi: 10.1109/CyberneticsCom55287.2022.9865339.

S. Nadeem and Z. Tayyab, “The interplay between national cultural dimensions and components of a performance management system: A qualitative study from Pakistan,” Canadian Journal of Administrative Sciences, vol. 38, no. 1, pp. 78–92, 2021, doi: 10.1002/cjas.1587.

M. A. Köseoglu, A. K. F. Wong, and S. S. Kim, “Intellectual structure of the hospitality literature via topic modeling analysis,” Journal of Hospitality & Tourism Research, vol. 48, no. 4, pp. 679–708, 2024, doi: 10.1177/10963480221118814.

G. R. Akkartal and F. M?zrak, “Operational efficiency and competitiveness in the global logistics industry: An examination of human resources management strategies,” in Strategic Innovations for Dynamic Supply Chains, Advances in Logistics, Operations, and Management Science. Hershey, PA, USA: IGI Global, 2024, ch. 4, doi: 10.4018/979-8-3693-3575-8.ch004.

X. Mo and Y. Liao, “Analysis of current research in the field of sustainable employment based on latent Dirichlet allocation,” Sustainability, vol. 16, no. 11, Art. no. 4557, 2024, doi: 10.3390/su16114557.

Y. Guo and O. M. Karatepe, “A 30-year journey of hospitality and tourism research: A comprehensive topic modeling analysis,” International Journal of Contemporary Hospitality Management, vol. 36, no. 7, pp. 2232–2258, 2024, doi: 10.1108/IJCHM-01-2023-0109.

Y. Guo and O. M. Karatepe, “Is someone listening to me? A topic modeling approach to analyzing open-ended employee feedback in hospitality,” International Journal of Hospitality Management, vol. 115, Art. no. 104114, 2025, doi: 10.1016/j.ijhm.2025.104114