Quality Evaluation of Component-Based Software: An Empirical Approach

Full Text (PDF, 652KB), PP.80-91

Views: 0 Downloads: 0


Prasenjit Banerjee 1,* Anirban Sarkar 1

1. National Institute of Technology, Durgapur, West Bengal-713209, India

* Corresponding author.

DOI: https://doi.org/10.5815/ijisa.2018.12.08

Received: 20 Jul. 2017 / Revised: 16 Oct. 2017 / Accepted: 20 Dec. 2017 / Published: 8 Dec. 2018

Index Terms

Component-based system, component model, component quality metrics, software measurement, empirical validation.


In recent days, component-based software engineering has become popular in the software industry for its reuse property. A suitable component-based software model is crucial for the effective design of the component-based software engineering. Quality assessment, evaluation, and analysis of a component model are highly essential to maintain the efficient design in the development of such system. Quality measurement for the component model will be more accurate, if it can be measured by a set of valid and meaningful metrics. This paper has proposed an empirical approach to validate a set of quality metrics along with a set of quality attributes for the design model of component-based software. In the proposed approach, metrics interdependencies have described using a Chi-Square non-parametric test. This paper has considered six different case studies of a well-known library management system to establish the metrics interdependency along with several quality attributes of a component model. This helps to identify the practically useful set of metrics for the quality assessment of high cohesive and low coupling metrics of the component-based system. A massive dataset has been collected from the 34 students of the institute on these six case studies. The Pearson's correlation method has been applied on the collected data set to identify the several correlations between the set of metrics and the set of quality attributes in terms of operation time. This facilitates to assess different crucial quality attributes of component-based system (CBS) design like complexity, analyzability, expressiveness etc.

Cite This Paper

Prasenjit Banerjee, Anirban Sarkar, "Quality Evaluation of Component-Based Software: An Empirical Approach", International Journal of Intelligent Systems and Applications(IJISA), Vol.10, No.12, pp.80-91, 2018. DOI:10.5815/ijisa.2018.12.08


[1]R. Malhotra, A. Kaur, and Y. Singh, “Empirical validation of object-oriented metrics for predicting fault proneness at different severity levels using support vector machines,” International Journal of System Assurance Engineering and Management, vol. 1, No. 3, pp. 269-281, 2010.
[2]M. H. Olague, H. L. Etzkorn, S. Gholston, and S. Quattlebaum, “Empirical validation of three software metrics suites to predict fault-proneness of object-oriented classes developed using highly iterative or agile software development processes,” IEEE Transactions on Software Engineering, vol. 33, No. 6, pp. 402-419, 2007.
[3]A. Bertolino, and R. Mirandola, “Modeling and analysis of non-functional properties in component-based systems,” Electronic Notes in Theoretical Computer Science, vol. 82, No. 6, pp. 158-168, 2003.
[4]M. Abdellatief, A. B. M. Sultan, A. A. A. Ghani, and M. A. Jabar, “A mapping study to investigate component-based software system metrics,” Journal of systems and software, vol. 86, No. 3, pp. 587-603, 2013.
[5]A. Alvaro, E.S. Almeida, and S. L. Meira, “Quality attributes for a component quality model,” 10th WCOP/19th ECCOP, Glasgow, Scotland, 2005.
[6]J. Chen, H. Wang, Y. Zhou, and D. S. Bruda, “Complexity metrics for component-based software systems,” International Journal of Digital Content Technology and its Applications, vol. 5, No. 3, pp. 235-244, 2011.
[7]N. S. Gill, and L. M. deCesare Sergio. "Measurement of Component-based Software: Some Important Issues.": 373, 2002.
[8]C. Mayerl, K.M. Hüner, J.U. Gaspar, C. Momm, and S. Abeck, “Definition of metric dependencies for monitoring the impact of quality of services on quality of processes,” 2nd IEEE/IFIP International Workshop on Business-Driven IT Management (BDIM'07), pp. 1-10, 2007.
[9]D.E. Geetha, T.S. Kumar, and K.R. Kanth, “Predicting the software performance during feasibility study,” IET software, vol. 5, No. 2, pp. 201-215, 2011.
[10]Y. Yavari, M. Afsharchi, and M. Karami, “Software complexity level determination using software effort estimation use case points metrics,” 5th Malaysian Conference in Software Engineering (MySEC), pp. 257-262, 2011.
[11]X. Cai, M.R. Lyu, K.F. Wong, and R. Ko, “Component-based software engineering: technologies, development frameworks, and quality assurance schemes,” In Proceedings of the Seventh Asia-Pacific Software Engineering Conference (APSEC), IEEE, pp. 372-379, 2000.
[12]F. Brosch, H. Koziolek, B. Buhnova, and R. Reussner, “Architecture-based reliability prediction with the Palladio Component Model,” IEEE Transactions on Software Engineering, vol. 38, No. 6, pp. 1319-1339, 2012.
[13]A. Aloysius, and K. Maheswaran, “A Review on Component Based Software Metrics,” International Journal of Fuzzy Mathematical Archive, vol. 7, No. 2, pp. 185-194, 2015.
[14]A. Koziolek, and R. Reussner, “Towards a generic quality optimization framework for component-based system models,” In Proceedings of the 14th international ACM SIGSOFT symposium on Component based software engineering, ACM, pp. 103-108, 2011.
[15]M. Anjum, M.A. Haque, and N. Ahmad, “Analysis and ranking of software reliability models based on weighted criteria value,” International Journal of Information Technology and Computer Science (IJITCS), vol. 5, No. 2, pp. 1, 2013
[16]L. Grunske, “Early quality prediction of component-based systems–a generic framework,” Journal of Systems and Software, vol. 80, No. 5, pp. 678-686, 2007.
[17]E. Bouwers, J.P. Correia, A. van Deursen, and J. Visser, “Quantifying the analyzability of software architectures,” 9th Working IEEE/IFIP Conference on Software Architecture (WICSA), pp. 83-92, 2011.
[18]P. Rana, and R. Singh, “A Study of Component Based Complexity Metrics,” International Journal of Emerging Research in Management & Technology, vol. 3 No. 11, pp. 159-165, 2014
[19]M. Padmaja, and D.D. Haritha, “Software Effort Estimation using Grey Relational Analysis,” MECS in International Journal of Information Technology and Computer Science, vol. 5, pp. 52-60, 2017.
[20]R.H. Reussner, H.W. Schmidt, and I.H. Poernomo, “Reliability prediction for component-based software architectures,” Journal of systems and software, vol. 66, No. 3, pp. 241-252, 2003.
[21]H. Koziolek, “Performance evaluation of component-based software systems: A survey. Performance Evaluation,” Elsevier, vol. 67, No. 8, pp. 634-658, 2010.
[22]M. Choi, I.J. Kim, J. Hong, and J. Kim, “Component-based metrics applying the strength of dependency between classes,” In Proceedings of the 2009 ACM symposium on Applied Computing, pp. 530-536, 2009.
[23]J. Xu, D. Ho, and L.F. Capretz, “An empirical validation of object-oriented design metrics for fault prediction,” Journal of Computer Science, vol. 4, No. 7, pp. 571-577, 2008.
[24]K.P. Srinivasan, and T. Devi, “Software Metrics Validation Methodologies in Software Engineering,” International Journal of Software Engineering & Applications, vol. 5, No. 6, pp. 87-102, 2014.
[25]M.V. Zelkowitz, “Techniques for Empirical validation,” In Empirical Software Engineering Issues, Critical Assessment and Future Directions, Springer Berlin Heidelberg, pp. 4-9, 2007.
[26]S. Misra, “An approach for the empirical Validation of Software Complexity Measures,” Acta Polytechnica Hungarica, vol. 8, No. 2, pp. 141-160, 2011.
[27]S. Sedigh-Ali, A. Ghafoor, and R. Paul, “Metrics-guided quality management for component-based software systems,” 25th Annual International Computer Software and Applications Conference (COMPSAC), IEEE, pp. 303-308, 2001.
[28]O.P. Rotaru, and M. Dobre, “Reusability metrics for software components,” 3rd ACS/IEEE International Conference on Computer Systems and Applications, IEEE, 24, 2005.
[29]S. Balsamo, A.D. Marco, P. Inverardi, and M. Simeoni, “Model-based performance prediction in software development: A survey”, IEEE Transactions on Software Engineering, vol. 30, No. 5, pp. 295-310, 2004.
[30]S. Becker, L. Grunske, R. Mirandola, and S. Overhage, “Performance prediction of component-based systems”, In Architecting Systems with Trustworthy Components, Springer Berlin Heidelberg, pp. 169-192, 2006.
[31]K. Goševa-Popstojanova, and K.S. Trivedi, “Architecture-based approach to reliability assessment of software systems,” Performance Evaluation, Elsevier, vol. 45, No. 2, pp. 179-204, 2001.
[32]R.S. Pressman, “Software Engineering: A Practitioner's Approach (Sixth, International ed.)”, McGraw-Hill Education Pressman, 388, 2005.
[33]B. Kitchenham, S.L. Pfleeger, and N. Fenton, “Towards a Framework for Software Measurement Validation,” IEEE Transactions on Software Engineering, vol. 21, No. 12, pp. 929-943, 1995.
[34]G.M. Muketha, A.A.A. Ghani, M.H. Selamt, and R. Atan, “A Survey of Business Complexity Metrics,” Information Technology Journal, vol. 9, No. 7, pp. 1336-1344, 2010.
[35]K.P. Srinivasan, and T. Devi,“Design and Development of a Procedure to Test the Effectiveness of Object-Oriented Design,” International Journal of Engineering Research and Industrial Applications, vol. 2, No. 6, pp. 15-25, 2009.
[36]L. Briand, K. El. Emam, and S. Morasca, “Theoretical and empirical validation of software product measures,” Technical Report. ISERN-95-03, International Software Engineering Research Network. Available at http://truerefactor.googlecode.com/svnhistory/r8/trunk/docs/research/darkprog/, 1995.
[37]A.J. Albrecht, and J.E., Gaffney. “Software Function, Source Line of Code and Development Effort Prediction: A Software Science Validation,” IEEE Transaction on Software Engineering, pp. 639-648, November 1983.
[38]C. Jones., “Programming Productivity,” McGraw-Hill, 1986.
[39]S.R. Chidamber, and C.F. Kemerer, “A Metrics Suite for Object Oriented Design,” IEEE Transaction on Software Engineering. vol. 20, No. 6, pp. 476-493, 1994.
[40]“Function Point Counting Practices Manual. Release 4.0,” International Function Point Users Group, 1994.
[41]C.R. Symons, “Function Point Analysis: Difficulties and Improvement,” IEEE Transactions on Software Engineering. vol. 14, No. 1, pp. 2-11, 1988.
[42]T. Vale, I. Crnkovic, E.S. de Almeida, P. A. D. M. S. Neto, Y.C. Cavalcanti, and S.R. de Lemos Meira, “Twenty-eight years of component-based software engineering,” Journal of Systems and Software, vol. 111, pp. 128-148, 2016.