International Journal of Intelligent Systems and Applications (IJISA)
IJISA Vol. 18, No. 5, 8 Oct. 2026
Cover page and Table of Contents: PDF (size: 1377KB)
A Comparative Study of Semantic and Syntactic Approaches for Abstractive Text Summarization using BART and T5 Transformers
PDF (1377KB), PP.231-249
Views: 0 Downloads: 0
Author(s)
Manisha Sachin Dabade
1,2,*
Vishal Meshram
3
Index Terms
Natural Language Processing, Text Summarization, Transformer Models, BART, T5, Semantic Features, Syntactic Features
Abstract
Automatic text summarization plays an important role in transforming lengthy documents into concise and informative representations. The abstractive summarization aims to generate sentences that capture the semantic meaning of the source text. This study proposed semantic and syntactic augmentation in transformer-based abstractive summarization using two encoder–decoder models such as a BART-based model enhanced with SpaCy Part-of-Speech analysis and RoBERTa-based semantic embeddings, and a prompt-guided T5 model, in which task-specific textual prompts were appended to the input sequence to guide the summarization process during fine-tuning and inference. Both models were trained and evaluated on the BBC News dataset using ROUGE parameters. The final results show that the T5 model obtained ROUGE-1 of 45.61, ROUGE-2 of 30.12, and ROUGE-L of 45.12. The BART model obtained ROUGE-1 of 44.28, ROUGE-2 of 28.70, and ROUGE-L of 44.72. The results indicate that the prompt-based T5 model combined with linguistic feature augmentation can improve the quality of abstractive summaries. However, as the reference summaries in news datasets contain extractive characteristics, ROUGE-based evaluation reflects lexical overlap in addition to abstractive generation. The final findings show the improved abstractive summarization performance within the constraints of the dataset and evaluation protocol.
Cite This Paper
Manisha Sachin Dabade, Vishal Meshram, "A Comparative Study of Semantic and Syntactic Approaches for Abstractive Text Summarization using BART and T5 Transformers", International Journal of Intelligent Systems and Applications (IJISA), Vol.18, No.5, pp.231-249, 2026. DOI:10.5815/ijisa.2026.05.12
Reference
[1]Babu G. L. A., and Badugu S. “A survey on automatic text summarization. In A. B. Reddy, S. Nagini, V. E. Balas, and K. S. Raju (Eds.)” Proceedings of Third International Conference on Advances in Computer Engineering and Communication Systems (Lecture Notes in Networks and Systems, Vol. 612, Springer. 2023. https://doi.org/10.1007/978-981-19-9228-5_58
[2]Ghanem F. A., Padma M. C., and Alkhatib R. “Automatic short text summarization techniques in social media platforms”, Future Internet, 15(9), 311. 2023. https://doi.org/10.3390/fi15090311
[3]Supriyono, Wibawa, A. P., Suyono, and Kurniawan, F. “A survey of text summarization: Techniques, evaluation and challenges”, Natural Language Processing Journal, 7, 100070. 2024. https://doi.org/10.1016/j.nlp.2024.100070
[4]Rayhan, A., Kinzler, R., and Rayhan, R. “Natural language processing: Transforming how machines understand human language”, The Development of Artificial General Intelligence, Conference on development of Artificial General Intelligence, 2023. https://doi.org/10.13140/RG.2.2.34900.99200
[5]Vaishali, Sehgal, G., and Dixit, P. “A comprehensive study of automatic text summarization techniques”, In 2024 International Conference on Emerging Innovations and Advanced Computing (INNOCOMP), pp. 688–694. 2024. https://doi.org/10.1109/INNOCOMP63224.2024.00119
[6]Raundale, P., and Shekhar, H. “Analytical study of text summarization techniques”, Asian Conference on Innovation in Technology (ASIANCON), pp. 1-4. 2021. https://doi.org/10.1109/ASIANCON51346.2021.9544804
[7]Palliyali, A. W., Al-Khalifa, M. A., Farooq, S., Abinahed, J., Al-Ansari, A., and Jaoua, A. “Comparative study of extractive text summarization techniques”, IEEE/ACS 18th International Conference on Computer Systems and Applications (AICCSA), pp. 1-6. 2021. https://doi.org/10.1109/AICCSA53542.2021.9686867
[8]Dam, M., Roy, S., and Sarkar, D. “Exploring the extractive method of text summarization”, In R. Chaki, A. Cortesi, S. DasGupta, and S. Saha (Eds.), Smart Systems and Wireless Communication (SSWC 2024) (Smart Innovation, Systems and Technologies, Vol. 433, Springer. 2025. https://doi.org/10.1007/978-981-96-1348-9_11
[9]Gulati, V., Kumar, D., Popescu, D. E., and Hemanth, J. D. “Extractive article summarization using integrated TextRank and BM25+ algorithm”, Electronics, 12(2), 372. 2023. https://doi.org/10.3390/electronics12020372
[10]Shakil, H., Farooq, A., and Kalita, J. “Abstractive text summarization: State of the art, challenges, and improvements”, Neurocomputing, 603, 128255. 2024. https://doi.org/10.1016/j.neucom.2024.128255
[11]Suliman, W., Yaseen, A., and Hamada, N. “Advancements in abstractive text summarization: A deep learning approach”, IAES International Journal of Artificial Intelligence (IJ-AI), 14(3), pp. 2315-2327. 2025. https://doi.org/10.11591/ijai.v14.i3.pp2315-2327
[12]Syed, A. A., Gaol, F. L., and Matsuo, T. “A survey of the state-of-the-art models in neural abstractive text summarization”, IEEE Access, 9, 13248–13265. 2021. https://doi.org/10.1109/ACCESS.2021.3052783
[13]Hou, Z., Bi, S., Qi, G., Zheng, Y., Ren, Z., and Li, Y. “Syntax-guided question generation using prompt learning”, Neural Computing and Applications, 36(1), 1–12. 2024. https://doi.org/10.1007/s00521-024-09421-7
[14]Li, J., Zhang, C., Chen, X., Hu, Y., and Liao, P. “Survey on automatic text summarization”, Computer Research and Development, 58(1), pp. 1-21. 2021. https://doi.org/10.7544/issn1000-1239.2021.20190785
[15]Kumar, Y., Kaur, K., and Kaur, S. “Study of automatic text summarization approaches in different languages”, Artificial Intelligence Review, 54(8), 5897–5929. 2021. https://doi.org/10.1007/s10462-021-09964-4
[16]Jang, M., and Kang, P. “Learning-free unsupervised extractive summarization model”, IEEE Access, 9, 14358–14368. 2021. https://doi.org/10.1109/ACCESS.2021.3051237
[17] Tian Shi, Yaser Keneshloo, Naren Ramakrishnan, Chandan K. Reddy, "Neural Abstractive Text Summarization with Sequence-to-Sequence Models", ACM Transactions on Data Science, Volume 2, Issue 1, 2021. Pages 1 - 37. https://doi.org/10.1145/3419106
[18] Li Yuanyuan, Yuan Huang, Weijian Huang, Junhao Yu, and Zheng Huang. "An Abstractive Summarization Model Based on Joint-Attention Mechanism and a Priori Knowledge" Applied Sciences 13, no. 7: 4610. 2023. https://doi.org/10.3390/app13074610
[19]Mojrian, M., and Mirroshandel, S. A. “A novel extractive multi-document text summarization system using quantum-inspired genetic algorithm: MTSQIGA”, Expert Systems with Applications, 171, 114555. 2021. https://doi.org/10.1016/j.eswa.2020.114555
[20]Mutlu, B., Sezer, E. A., and Akcayol, M. A. “Multi-document extractive text summarization: A comparative assessment on features”, Knowledge-Based Systems, 183, 104848. 2019. https://doi.org/10.1016/j.knosys.2019.07.019
[21]Patel, D., Shah, S., and Chhinkaniwala, H. “Fuzzy logic-based multi-document summarization with improved sentence scoring and redundancy removal technique”, Expert Systems with Applications, 134, pp. 167-177. 2019. https://doi.org/10.1016/j.eswa.2019.05.045
[22]Chan, H. P., and King, I. “A condense-then-select strategy for text summarization”, Knowledge-Based Systems, 227, 107235. 2021. https://doi.org/10.1016/j.knosys.2021.107235
[23]Espino, J. Q., Romero-González, R. M., and Herrera-Navarro, A.-M. “A deep look into extractive text summarization”, Journal of Computer and Communications, 9(6), pp. 24-37. 2021. https://doi.org/10.4236/jcc.2021.96002
[24] D. Greene and P. Cunningham. “Practical Solutions to the Problem of Diagonal Dominance in Kernel Document Clustering”, Proc. ICML 2006.
[25]Jide, A., Ajagbe, S., Adeniyi, E., Aworinde, H., Falola, P., and Adigun, M. “EASESUM: An online abstractive and extractive text summarizer using deep learning technique”, IAES International Journal of Artificial Intelligence (IJ-AI), 13(2), pp. 1888-1899. 2024. https://doi.org/10.11591/ijai.v13.i2.pp1888-1899