An Empirical Study on Testing of SOA based Services

Full Text (PDF, 357KB), PP.54-66

Views: 0 Downloads: 0


Abhishek Kumar 1,* Manindra Singh 2

1. Trinity institute of technology & research, Bhopal (M.P), India

2. Samsung Research Institute, Delhi, India

* Corresponding author.


Received: 10 Mar. 2014 / Revised: 6 Jul. 2014 / Accepted: 13 Sep. 2014 / Published: 8 Dec. 2014

Index Terms

SOA, SOA Testing, Testing Perspectives, Testing Challenges, Web Services


Service-Oriented Architecture (SOA) removed the gap between software and business. Today, there is a business transformation among enterprises and they adopt a service based information technology (IT) model. So, testing is necessary for SOA based applications. This paper investigates different type of approaches and techniques that address the testing problems of SOA based services. Here we also investigate the differences between SOA and web services and traditional testing and SOA testing. Various testing levels are also discussed in detail. This paper also expresses various testing perspectives, challenges of SOA testing and review the many testing approaches and identify the problems that improve the testability of SOA based services.

Cite This Paper

Abhishek Kumar, Manindra Singh, "An Empirical Study on Testing of SOA based Services", International Journal of Information Technology and Computer Science(IJITCS), vol.7, no.1, pp.54-66, 2015. DOI:10.5815/ijitcs.2015.01.07


[1]Gerardo Canfora. "Service-Oriented Architectures Testing: A Survey", Lecture Notes in Computer Science, 2009. 

[2]Askarunisa, A., A. M. Abirami, K. Arockia Jackulin Punitha, B. Karthik Selvakumar, and R. Arun kumar. "Sequence-based techniques for black-box test case prioritization for composite service testing", 2010 IEEE International Conference on Computational Intelligence and Computing Research, 2010. 

[3]Andrea Polini. "Automatic Test Data Generation for XML Schema-based Partition Testing", Second International Workshop on Automation of Software Test (AST 07), 05/2007. 

[4]Youssef Bassil. Distributed, cross-platform and regression testing architecture for service-oriented architecture. In proceedings ofAdvance in computer science and its applications(ACSA) (2012), vol. 1.


[6]Jeff Offutt and WuzhiXu. Generating Test Cases for Web Services Using Data Perturbation. In IEEE (2003).

[7]Jeffrey Hasan and Mauricio Duran. Expert Service-Oriented Architecture in C# 2005. Apress, 2006. 

[8]Khan, T. A., and Heckel, R. A Methodology for Model-Based Regression Testing of Web Service. In proceedings of Testing: Academic and Industrial Conference-Practice and Research Techniques, IEEE (2009). 

[9]Leila Naslavsky. " A model-based regression test selection technique", 2009 IEEE International Conference on Software Maintenance, 09/2009.

[10]Mei, Lijun, KeZhai, Bo Jiang, W. K. Chan, and T. H. Tse. "Preemptive Regression Test Scheduling Strategies: A New Testing Approach to Thriving on the Volatile Service Environments", 2012 IEEE 36th Annual Computer Software and Applications Conference, 2012.

[11]Massimiliano Di Penta, Marcello Bruno and Gerardo Canfora. Web service Regression Testing. In RCOST- Research centre on software technology (2007). 

[12]OrestPilskalns, GunayUyan and Anneliese Andrews. Regression Testing UML Design. In Proceedings of the 22nd IEEE international conference on software maintenance (2006). 

[13]Pakinam N. Boghdady. "An enhanced test case generation technique based on activity diagrams", The 2011 International Conference on Computer Engineering & Systems, 11/2011.

[14]Kalamegam, Poonkavithai and Godandapani, Zayaraz. "A Survey on Testing SOA Built using Web Services", International Journal of Software Engineering & Its Applications, 2012.

[15]PrachetBhuyan and Abhishek Kumar. Model Based Regression Testing Approach of Service-Oriented Architecture (SOA) Based Application: A Case Study. In International Journal of Computer Science and Informatics (2013), vol. 3.

[16]Qiulu Yuan. "A model driven approach toward business process test case generation", 2008 10th International Symposium on Web Site Evolution, 10/2008.

[17]Rajanikanta Mohanty, Binod Kumar Pattanayak, Bhagabat Puthal and Durgaprasad Mohapatra. A Road Map to Regression Testing of Service-Oriented Architecture(SOA) Based Applications. In Journal of theoretical and applied information technology (2012), vol. 36. 


[19]Yongbo Wang. "Business Semantics Centric Reliability Testing for Web Services in BPEL", 2010 6th World Congress on Services, 07/2010.

[20]W.T. Tsai, Jerry Gao, Xiao Wei and Yinong Chen.Testability of Software in Service-Oriented Architecture. In Proceedings of the 30th Annual International Computer Software and Applications Conference, IEEE (2006). 

[21]Atkinson, Colin, Florian Barth, Daniel Brenner, and Marcus Schumacher. "Testing Web-Services Using Test Sheets", 2010 Fifth International Conference on Software Engineering Advances, 2010. 

[22]XiaoyingBai and Wenli Dong. WSDL-Based Automatic Test Case Generation for Web Services Testing. In Proceedings of the 2005 IEEE International Workshop on Service-Oriented System Engineering, IEEE (2005). 

[23]SujathaKuppuraju,Aravind Kumar, GeethaPresennaKumari, "Case Study to Verify the Interoperability of a Service Oriented Architecture Stack", IEEE International Conference on Services Computing (SCC 2007), IEEE, 2007. 

[24]Ying Jiang, Ying-Na Li, Shan-Shan Hou and Lu Zhang. Test Data Generation for Web Services Based on Contract Mutation. In Proceedings of Third IEEE International Conference on Secure Software Integration and Reliability Improvement, IEEE (2009). 

[25]ZhangGuangquan, Rong Mei and Zhang Jun. A Business Process of Web Services Testing Method Based on UML 2.0 Activity Diagram. InProceedings of Workshop on Intelligent Information Technology Application, IEEE (2007).

[26]W.T.Tsai, R.Paul, Z.Cao, L.yu, A.Saimi, B.Xiao, "Verification of web services using an enhanced UDDI server", In the Proceedings of The Eighth IEEE International Workshop on Object-Oriented Real-Time Dependable System, IEEE,2003.

[27]Chen, Xin, Nan Ye, Peng Jiang, Lei Bu, and Xuandong Li. "Feedback-Directed Test Case Generation Based on UML Activity Diagrams", 2011 Fifth International Conference on Secure Software Integration and Reliability Improvement - Companion, 2011.

[28]El Ioini, Nabil. "Web Services Open Test Suites", 2011 IEEE World Congress on Services, 2011.

[29]Athira B, Philip Samuel, "Web Services Regression Test Case Prioritization", In proceedings of International Conference on Computer Information Systems and Industrial Management Applications (CISIM), IEEE, 2010.

[30]W. T. Tsai, Y. Chen, R. Paul, N. Liao and H. Huang. Co-operative and Group Testing in Verification of Dynamic Composite Web Services. In Proceedings of the 28th Annual International Computer Software and Applications Conference IEEE (2004).

[31]W. T. Tsai, Ray Pau, Weiwei Song, Zhibin Cao, Coyote:" An XML-Based Framework for Web Services Testing", In the Proceedings of 7th IEEE International Symposium on High Assurance Systems Engineering (HASE’02), IEEE 2002. 

[32]ZHANG, Zhongjie LI, Wei SUN, Zhong Bo JIANG, Xin ZHANG, "BPEL4WS Unit Testing: Framework and Implementation", International Conference on Web Services (ICWS’05), IEEE, 2005. 

[33] 12863121/Service-Level Agreements-in –ServiceOriented –Architecture –Environ-ments.




[37]Vincent, Pierre-Luc; Badri, Linda and Badri, Mourad. "Regression Testing of Object-Oriented Software: Towards a Hybrid Technique", International Journal of Software Engineering & Its Applications,2013. 

[38]SOA and Web Services, technetwork /articles/javase/soa-142870.html. 

[39]Difference Between SOA and Web Services, /difference-between-soa-and-vs-web-services/.

[40]What's the difference between SOA and Web services, /answer/Whats-the-difference-between-SOA-and-Web-services.

[41]Thomas Erl. Service-Oriented Architecture Concept technology and Design. Pearson Education, 2005. 

[42]Lei Xu, Baowen Xu, Zhenqiang Chen, Jixiang Jiang, Huowang Chen," Regression Testing for Web Applications Based on Slicing", 27th Annual International Computer Software and Applications Conference (COMPSAC’03) 0730-3157/03, 2003 IEEE. 

[43]Ravi Prakash Gorthi, Anjaneyulu Pasala, Kailash KP Chanduka and Benny Leong, " Specification-based Approach to Select Regression Test Suite to Validate Changed Software", 2008 15th Asia-Pacific Software Engineering Conference, IEEE, 2008.

[44]Abbas Tarhini, Zahi Ismail, Nashat Mansour, "Regression Testing Web Applications", International Conference on Advanced Computer Theory and Engineering, IEEE, 2008.

[45]Srikanth Inaganti and Sriram Aravamudan, " Testing a SOA Application" BP Trends , April 2008.

[46]Nabil El Ioini, Alberto Sillitti, "Open Web Services Testing",2011 IEEE World Congress on Services.

[47]Prachet Bhuyan, Chandra Prakash Kashyap, Durga Prasad Mohapatra," A Survey of Regression Testing in SOA, "International Journal of Computer Applications (0975 – 8887) Volume 44– No19, April 2012". 

[48]Ebrahim Shamsoddin-Motlagh," A Survey of Service-Oriented Architecture Systems Testing", International Journal of Software Engineering & Applications (IJSEA), Vol.3, No.6, November 2012.

[49]M. Shaban Jokhio, Gillian Dobbie, J. S., and Hu, T. Web services testing via goal and mutation. In Proceedings of IEEE International Conference on Engineering of Complex Computer Systems (2013), pp. 159-162.

[50]Prachet Bhuyan, Abhishek Kumar and D.P. Mohapatra, "SOA testing perspective model for regression testing". In Proceedings of 2013 Nirma University International Conference on Engineering (NUiCONE).