Empowering Community Work: Using Semi-Supervised Learning to Identify Emerging Community Needs and Service Gaps from Massive Unstructured Text

PDF (553KB), PP.1-12

Views: 0 Downloads: 0

Author(s)

Yih-Chang Chen 1,*

1. Department of Social Work, Chang Jung Christian University, Tainan 711, Taiwan, China

* Corresponding author.

DOI: https://doi.org/10.5815/ijisa.2026.02.01

Received: 23 Oct. 2025 / Revised: 2 Dec. 2025 / Accepted: 23 Jan. 2026 / Published: 8 Apr. 2026

Index Terms

Semi-supervised Learning, Community Needs Assessment, Text Mining, Natural Language Processing, Service Deficiencies

Abstract

Community engagement is essential to social service delivery, yet traditional community needs assessment remains time-consuming and poorly suited for timely monitoring. This study proposes a semi-supervised learning framework to identify emerging community needs and service gaps from massive, mostly unlabeled, unstructured text. We construct an explicit heterogeneous text graph where each record is a document node linked to keyword and need-category nodes; document–document edges are built using a weighted combination of semantic similarity (BERT cosine), lexical overlap (keyword Jaccard), and temporal proximity. A graph neural network with iterative self-training leverages 3% expert-labeled seed data and the remaining unlabeled corpus to classify records into a 10-category need taxonomy. On 176,602 records, the proposed model achieves F1 = 0.895 and Recall = 0.899, outperforming supervised baselines trained on the same labeled ratio by 23.8% (macro-F1). Post-hoc quarterly aggregation of predictions enables trend monitoring and prioritization of service-gap severity for decision support.

Cite This Paper

Yih-Chang Chen, "Empowering Community Work: Using Semi-Supervised Learning to Identify Emerging Community Needs and Service Gaps from Massive Unstructured Text", International Journal of Intelligent Systems and Applications(IJISA), Vol.18, No.2, pp.1-12, 2026. DOI:10.5815/ijisa.2026.02.01

Reference

[1]S. Liu, M. S. Atteraya, and E. Ji, “Community needs assessment for social service delivery in Chengdu, China,” China Journal of Social Work, vol. 17, no. 2, pp. 95-111, 2024.
[2]E. Åhlfeldt, D. Isaksson, and U. Winblad, “Factors explaining program sustainability: A study of the implementation of a social services program in Sweden,” Health & Social Care in the Community, vol. 2023, Art. no. 1458305, 2023.
[3]M. V. H. Alarte, “Community needs assessment in Sitio Sapa, Barangay San Rafael, Rodriguez, Rizal: Basis of social welfare extension program of the University of Rizal System Rodriguez, Rizal,” Asean Social Work Journal, pp. 1-4, 2022.
[4]J. Hall, L. Donelle, D. Laliberte Rudman, J. Baumann, H. Weaver, R. Jones, and A. Trudell, “‘It is important for everyone as humans to feel important, right?’ Findings from a community-based participatory needs assessment with street-level sex workers,” Soc. Work Public Health, vol. 35, no. 1-2, pp. 33–46, 2020.
[5]B. Mehra, R. B. Riter, R. Harris, and J. Canales, “Collaborations to Support the SJ4A Curriculum in Archival Studies and Social Justice Intersections: Training of Community-Embedded Paraprofessional Archivists Who Are Black, Indigenous, and People of Color,” in Proceedings of the ALISE Annual Conference, October 2024.
[6]T. Lamponen and N. Aarnio, “Social workers’ assessment of a child’s need for services as ‘craftwork’ practice,” Journal of Social Work Practice, vol. 38, no. 2, pp. 129–142, 2024.
[7]M. Tseng, D. Rojas, E. Hernandez, M. A. V. Espinoza-Kulick, I. Gilbert, M. Perez, and S. Phelan, “A mixed-methods community needs assessment of Santa Maria and Guadalupe, California,” Discover Social Science and Health, vol. 4, no. 1, p. 69, 2024.
[8]S. M. Sheppard and E. Fuerst, “Reflections on evaluators’ role in community needs assessment,” Gateways, vol. 16, no. 2, pp. 1-14, 2023.
[9]N. Sankofa, “Transformative needs assessment methodology: A mixed approach for organizations serving marginalized communities,” American Journal of Evaluation, vol. 42, pp. 505-522, 2021.
[10]J. Lopez, M. Orejuela, A. Farriss, N. Eliazar-Macke, and I. M. Freytes, “Community needs assessment to inform suicide prevention planning: a near-empty scoping review,” Advances in Mental Health, pp. 1-14, 2025.
[11]M. T. A. Chowdhury, N. Sharma, and A. R. KhudaBukhsh, “Community needs and assets: A computational analysis of community conversations,” in Proceedings of the International AAAI Conference on Web and Social Media, vol. 18, pp. 302–314, May 2024.
[12]H. Nel and W. Roestenburg, “Assessment of a community: promoting an equitable society through inclusion and empowerment,” Social Work/Maatskaplike Werk, vol. 40, no. 2, 2004.
[13]G. Z. Steiner-Lim, D. Karamacoska, G. Abramov, S. Dubois, A. Harley, K. McDonald, and M. I. Hohenberg, “‘I’m on my own, I need support’: Needs assessment of community aged care services,” Int. J. Integr. Care, vol. 23, no. 3, p. 14, 2023.
[14]H. Ravaghi, A. L. Guisset, S. Elfeky, N. Nasir, S. Khani, E. Ahmadnezhad, and Z. Abdi, “A scoping review of community health needs and assets assessment: concepts, rationale, tools and uses,” BMC Health Serv. Res., vol. 23, no. 1, p. 44, Jan. 2023.
[15]S. M. Rizvi, R. Imran, and A. Mahmood, “Text classification using graph convolutional networks: A comprehensive survey,” ACM Computing Surveys, vol. 57, no. 8, pp. 1-38, 2025.
[16]K. Wang, Y. Ding, and S. C. Han, “Graph neural networks for text classification: A survey,” Artificial intelligence review, vol. 57, no. 8, p. 190, 2024.
[17]E. L. S. Perin, M. C. D. Souza, J. D. A. Silva, and E. T. Matsubara, “DynGraph-BERT: Combining BERT and GNN Using Dynamic Graphs for Inductive Semi-Supervised Text Classification,” Informatics, vol. 12, no. 1, p. 20, Feb. 2025.
[18]B. Khemani, S. Patil, K. Kotecha, and S. Tanwar, “A review of graph neural networks: concepts, architectures, techniques, challenges, datasets, applications, and future directions,” Journal of Big Data, vol. 11, p. 18, 2024.
[19]P. Li, X. Fu, J. Chen, and J. Hu, “CoGraphNet for enhanced text classification using word-sentence heterogeneous graph representations and improved interpretability,” Scientific Reports, vol. 15, p. 356, 2025.
[20]W. Jiang and Y. Bai, “SGCL: Semi-supervised graph contrastive learning with confidence propagation algorithm for node classification,” Knowledge-Based Systems, vol. 301, p. 112271, 2024.
[21]J. Chishtie, N. Sapiro, N. Wiebe, L. Rabatach, D. Lorenzetti, A. A. Leung, and C. A. Eastwood, “Use of epic electronic health record system for health care research: scoping review,” Journal of medical Internet research, vol. 25, p. e51003, 2023.
[22]C. Liu, W. Y. C. Wang, and G. Khan, “Digital transformation in measuring social determinants of health: A systematic review,” Journal of Organizational and End User Computing (JOEUC), vol. 35, no. 3, pp. 1-21, 2023.
[23]Y. Shen, J. Yu, J. Zhou, and G. Hu, “Twenty-five years of evolution and hurdles in electronic health records and interoperability in medical research: comprehensive review,” Journal of Medical Internet Research, vol. 27, p. e59024, 2025.
[24]R. Ogrin, C. Meyer, A. Karantzoulis, I. J. Santana, and R. Hampson, “Assessing older community members using a social work tool: Developing an organizational response,” Gerontology and Geriatric Medicine, vol. 8, Art. no. 23337214221119322, 2022.
[25]Y. Kim, S. Park, M.-H. Park, and S. Kim, “Korean adolescents’ coping strategies on self-harm, ADHD, insomnia during COVID-19: text mining of social media big data,” Front. Psychiatry, vol. 14, Nov. 2023, Art. no. 1192123.