Predicting Software Product Quality: A Systematic Mapping Study

• Sofia Ouhbi ^[1] ; Ali Idri ^[1] ; José Luis Fernández-Alemán ^[2] ; Ambrosio Toval ^[2]
  1. [1] Mohammed V University

     Mohammed V University

     Marruecos

     
  2. [2] Universidad de Murcia

     Universidad de Murcia

     Murcia, España

     
• Localización: Computación y Sistemas (CyS), ISSN 1405-5546, ISSN-e 2007-9737, Vol. 19, Nº. 3, 2015, págs. 547-562
• Idioma: inglés
• Enlaces
  • Texto completo
• Resumen

  • Predicting software product quality (SPQ) is becoming a permanent concern during software life cycle phases. In this paper, a systematic mapping study was performed to summarize the existing SPQ prediction (SPQP) approaches in literature and to organize the selected studies according to seven classification criteria: SPQP approaches, research types, empirical types, data sets used in the empirical evaluation of these studies, artifacts, SQ models, and SQ characteristics. Publication channels and trends were also identified. After identifying 182 documents in ACM Digital Library, IEEE Xplore, ScienceDirect, SpringerLink, and Google scholar, 69 papers were selected. The results show that the main publication source of the papers identified was conference. Data mining techniques are the most frequently SPQP approaches reported in literature. Solution proposal was the main research type identified. The majority of the papers selected were history-based evaluations using existing data which were mainly obtained from open source software projects and domain specific projects. Source code was the main artifact concerned with SPQP approaches. Well-known SQ models were hardly mentioned and reliability is the SQ characteristic through which SPQP was mainly achieved. SPQP-related subject seems to need more investigation from researchers and practitioners. Moreover, SQ models and standards need to be considered more in future SPQP research.

• Referencias bibliográficas
  • (1999). ISO/IEC Standard. ISO-9126 Software Product Evaluation - Quality Characteristics and Guidelines for Their Use.
  • (2007). Guide to the Software Quality Body of Knowledge (SQuBOK). JUSE: The Union of Japanese Scientists and Engineers.
  • (2009). Standish-Group, CHAOS summary.
  • (2011). ISO/IEC 25010 standard. Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) -System...
  • (2013). NASA Metrics Data Program (MDP) Repository.
  • Abran, A.,Moore, J. W.. (2004). Guide to the software engineering body of knowledge (SWE-BOK). IEEE Computer Society.
  • Aggarwal, K.,Singh, Y.,Kaur, A.,Malhotra, R.. (2006). Improving logistic regression predictions of software quality using principal component...
  • Al-Jamimi, H. A.,Ahmed, M.. (2013). International Conference on Information Science and Applications (ICISA). IEEE.
  • Azar, D.,Harmanani, H.,Korkmaz, R.. (2009). A hybrid heuristic approach to optimize rule-based software quality estimation models. Information...
  • Azar, D.,Vybihal, J.. (2011). An ant colony optimization algorithm to improve software quality prediction models: Case of class stability....
  • Baisch, E.,Liedtke, T.. (1997). Comparison of conventional approaches and soft-computing approaches for software quality prediction. IEEE...
  • Banthia, D.,Gupta, A.. (2012). Proceedings of the 27th Annual ACM Symposium on Applied Computing, SAC '12. ACM. New York^eNY NY.
  • Bhatia, N.,Kapoor, N.. (2011). Fuzzy cognitive map based approach for software quality risk analysis. SIGSOFT Software Engineering Notes....
  • Boehm, B. W.,Brown, J. R.,Kaspar, H.,Lipow, M.. (1978). Characteristics of software quality. TRW Softw. Technol. North-HollandAmsterdam.
  • Bouguila, N.,Wang, J. H.,Ben Hamza, A.. (2008). A bayesian approach for software quality prediction. 4th International IEEE Conference Intelligent...
  • Bouktif, S.,Ahmed, F.,Khalil, I.,Antoniol, G.. (2010). A novel composite model approach to improve software quality prediction. Information...
  • Bouktif, S.,Kegl, B.,Sahraoui, H.. (2002). Combining software quality predictive models: An evolutionary approach. International Conference...
  • Bouktif, S.,Sahraoui, H.,Antoniol, G.. (2006). Proceedings of the 8th annual conference on Genetic and evolutionary computation, GECCO '06....
  • Brereton, P.,Kitchenham, B. A.,Budgen, D.,Turner, M.,Khalil, M.. (2007). Lessons from applying the systematic literature review process within...
  • do Prado, H. A.,Bianchi Campos, F.,Ferneda, E.,Nunes Cornelio, N.,Haendchen Filho, A.. (2013). Proceedings of the 16th International Conference...
  • Dromey, R. G.. (1996). Cornering the Chimera. IEEE Software. 13. 33-43
  • Easterbrook, S.,Singer, J.,Storey, M.-A.,Damian, D.. (2008). Guide to advanced empirical software engineering. Springer.
  • Ekanayake, J.,Tappolet, J.,Gall, H. C.,Bernstein, A.. (2009). Proceedings of the 2009 6th IEEE International Working Conference on Mining...
  • Elberzhager, F.,Münch, J.,Nha, V. T. N.. (2012). A systematic mapping study on the combination of static and dynamic quality assurance techniques....
  • Fenton, N. E.,Neil, M.. (1999). A critique of software defect prediction models. IEEE Transactions Software Engineering. 25. 675-689
  • Ganesan, K.,M, K. T.,B, A. E.. (2000). Case-based software quality prediction. International Journal of Software Engineering and Knowledge...
  • Gao, K.,Khoshgoftaar, T. M.,Wang, H.. (2009). Proceedings of the 10th IEEE international conference on Information Reuse & Integration,...
  • Garousi, V.,Mesbah, A.,Betin-Can, A.,Mirshokraie, S.. (2013). A systematic mapping study of web application testing. Information and Software...
  • Gayatri, N.,Nickolas, S.,Reddy, A. V.,Chitra, R.. (2009). Proceedings of the 2009 International Conference on Advances in Recent Technologies...
  • Gokhale, S. S.,Lyu, M. R.. (1997). Regression tree modeling for the prediction of software quality. International Conference on Reliability...
  • González-Barahona, J. M.,Robles, G.. (2012). On the reproducibility of empirical software engineering studies based on data retrieved from...
  • Guo, P.,Lyu, M. R.. (2000). Proceedings of the The First Asia-Pacific Conference on Quality Software (APAQS'00), APAQS '00. IEEE Computer...
  • Gupta, D.,Goyal, V. K.,Mittal, H.. (2012). International Conference on Advanced Computing and Communication Technologies. IEEE Computer Society....
  • Hmood, A.,Rilling, J.. (2013). 2013 IEEE 37th Annual Computer Software and Applications Conference Workshops (COMPSACW). IEEE.
  • Hribar, L.,Duka, D.. (2010). Software component quality prediction using KNN and Fuzzy logic. Proceedings 33rd International Convention on...
  • (2013). ISBSG. International Software Benchmarking Standards Group.
  • Jiang, Y.,Cuki, B.,Menzies, T.,Bartlow, N.. (2008). Proceedings of the 4th international workshop on Predictor models in software engineering,...
  • Jin, C.,Jin, S.-W.,Ye, J.-M.,Zhang, Q.-G.. (2009). Quality prediction model of object-oriented software system using computational intelligence....
  • Jorgensen, M.,Shepperd, M.. (2007). A systematic review of software development cost estimation studies. IEEE Transactions Software Engineering....
  • Kanmani, S.,Uthariaraj, V. R.,Sankaranarayanan, V.,Thambidurai, P.. (2004). Object oriented software quality prediction using general regression...
  • Karg, L. M.,Grottke, M.,Beckhaus, A.. (2011). A systematic literature review of software quality cost research. Journal of Systems and Software....
  • Kaur, A.,Sandhu, P. S.,Bra, A. S.. (2009). Proceedings of the 2009 Second International Conference on Machine Vision, ICMV '09. IEEE Computer...
  • Kaur, D.,Kaur, A.,Gulati, S.,Aggarwal, M.. (2010). A clustering algorithm for software fault prediction. International Conference on Computer...
  • Keivanloo, I.,Forbes, C.,Hmood, A.,Erfani, M.,Neal, C.,Peristerakis, G.,Rilling, J.. (2012). 9th IEEE Working Conference on Mining Software...
  • Keivanloo, I.,Forbes, C.,Rilling, J.,Charland, P.. (2011). Proceedings of the 3rd International Workshop on Search-Driven Development: Users,...
  • Khoshgoftaar, T.,Gao, K.. (2007). Count models for software quality estimation. IEEE Transactions on Reliability. 56. 212-222
  • Khoshgoftaar, T.,Liu, Y.. (2007). A multi-objective software quality classification model using genetic programming. IEEE Transactions on...
  • Khoshgoftaar, T. M.,Allen, E. B.,Halstead, R.,Trio, G. P.,Flass, R. M.. (1998). Using process history to predict software quality. Computer....
  • Khoshgoftaar, T. M.,Allen, E. B.,Jones, W. D.,Hudepohl, J. P.. (1999). Data mining for predictors of software quality. International Journal...
  • Khoshgoftaar, T. M.,Liu, Y.,Seliya, N.. (2004). A multiobjective module-order model for software quality enhancement. IEEE Transactions on...
  • Khoshgoftaar, T. M.,Seliya, N.. (2002). Proceedings of the 8th International Symposium on Software Metrics, METRICS '02. IEEE Computer...
  • Khoshgoftaar, T. M.,Seliya, N.. (2003). Fault prediction modeling for software quality estimation: Comparing commonly used techniques. Empirical...
  • Kitchenham, B.,Brereton, P.. (2013). A systematic review of systematic review process research in software engineering. Information and Software...
  • Kitchenham, B.,Pfleeger, S. L.. (1996). Software quality: The elusive target. IEEE Software. 13. 12-21
  • Landis, J.,Koch, G.. (1977). The measurement of observer agreement for categorical data. Biometrics. 33. 159-174
  • Lewis Nigel, D. C.. (1999). Assessing the evidence from the use of spc in monitoring, predicting & improving software quality. Comput....
  • Liu, Y.,Khoshgoftaar, T. M.,Seliya, N.. (2010). Evolutionary optimization of software quality modeling with multiple repositories. IEEE Transactions...
  • Loh, C. H.,Lee, S. P.. (2009). Proceedings of the 2009 International Conference on Information Management and Engineering, ICIME '09....
  • Lounis, H.,Abdi, M.,Yazid, H.. (2006). Predicting quality attributes via machine-learning algorithms. MENSURA. 72
  • Lyu, M. R.. (2007). 2007 Future of Software Engineering, FOSE '07. IEEE Computer Society. Washington^eDC DC.
  • Margaret, H. D.. (2003). Data mining introductory and advanced topics. Pearsons Education Inc.
  • McCall, J. A.. (2002). Quality Factors. John Wiley & Sons, Inc.
  • Menzies, T.,Caglayan, B.,Kocaguneli, E.,Krall, J.,Peters, F.,Turhan, B.. (2012). The PROMISE Repository of empirical software engineering...
  • Mertik, M.,Lenic, M.,Stiglic, G.,Kokol, P.. (2006). Proceedings of the International Conference on Software Engineering Advances, ICSEA '06....
  • Mockus, A.,Zhang, P.,Li, P. L.. (2005). Proceedings of the 27th international conference on Software engineering, ICSE '05. ACM. New York^eNY...
  • Montagud, S.,Abrahão, S.,Insfran, E.. (2012). A systematic review of quality attributes and measures for software product lines. Software...
  • Moreno García, M. N.,Román, I. R.,García Peñalvo, F. J,Bonilla, M. T.. (2008). An association rule mining method for estimating the impact...
  • Ortega, M.,Pérez, M.,Rojas, T.. (2003). Construction of a systemic quality model for evaluating a software product. Software Quality Control....
  • Ouhbi, S.,Idri, A.,Fernández-Alemán, J. L.,Toval, A.. (2013). 2013 20th Asia-Pacific Software Engineering Conference (APSEC). IEEE.
  • Ouhbi, S.,Idri, A.,Fernández-Alemán, J. L.,Toval, A.. (2014). 2014 Joint Conference of the International Workshop on Software Measurement...
  • Ouhbi, S.,Idri, A.,Fernández-Alemán, J. L.,Toval, A.. (2015). Requirements engineering education: a systematic mapping study. Requirements...
  • Peng, W.,Yao, L.,Miao, Q.. (2009). An approach of software quality prediction based on relationship analysis and prediction model. International...
  • Petersen, K.,Feldt, R.,Mujtaba, S.,Mattsson, M.. (2008). 12th International Conference on Evaluation and Assessment in Software Engineering....
  • Pizzi, N. J.,Summers, A. R.,Pedrycz, W.. (2002). Software quality prediction using median-adjusted class labels. Proceedings of the International...
  • Portillo-Rodríguez, J.,Vizcaíno, A.,Piattini, M.,Beecham, S.. (2012). Tools used in global software engineering: A systematic mapping review....
  • Pressman, R.. (2009). Software engineering: A practitioner's approach.
  • Radjenović, D.,Herićko, M.,Torkar, R.,Živković, A.. (2013). Software fault prediction metrics: A systematic literature review. Information...
  • Radlinski, L.. (2013). An expert-driven bayesian network model for simulating and predicting software quality. eKNOW 2013, The Fifth International...
  • Rana, Z. A.,Shamail, S.,Awais, M. M.. (2008). Proceedings of the 6th international workshop on Software quality, WoSQ '08. ACM. New York^eNY...
  • Rastkar, S.,Murphy, G. C.,Murray, G.. (2010). Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering, volume 1...
  • Sahraoui, H. A.,Boukadoum, M. A.,Chawiche, H. M.,Mai, G.,Serhani, M.. (2002). Proceedings of the 26th International Computer Software and...
  • Schneidewind, N. F.,Nikora, A. P.. (1999). Proceedings of the 10th International Symposium on Software ReliabilityEngineering, ISSRE '99....
  • Seiffert, C.,Khoshgoftaar, T. M.,Van Hulse, J.. (2009). Improving software-quality predictions with data sampling and boosting. Trans. Sys....
  • Seliya, N.,Khoshgoftaar, T. M.. (2007). Software quality analysis of unlabeled program modules with semisupervised clustering. Trans. Sys....
  • Seliya, N.,Khoshgoftaar, T. M.. (2007). Software quality estimation with limited fault data: a semi-supervised learning perspective. Software...
  • Seliya, N.,Khoshgoftaar, T. M.,Zhong, S.. (2004). Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence,...
  • Shafi, S.,Hassan, S. M.,Arshaq, A.,Khan, M. J.,Shamail, S.. (2008). Software quality prediction techniques: A comparative analysis. 4th International...
  • Sinovcic, I.,Hribar, L.. (2010). How to improve software development process using mathematical models for quality prediction and elements...
  • SOLEY, B.,CURTIS, Richard Market. (2013). The Consortium for IT Software Quality (CISQ). Software Quality. Increasing Value in Software and...
  • Tahir, A.,MacDonell, S. G.. (2012). 28th IEEE International Conference on Software Maintenance (ICSM). IEEE.
  • Tan, X.,Peng, X.,Pan, S.,Zhao, W.. (2011). Proceedings of the 2011 18th Working Conference on Reverse Engineering, WCRE '11. IEEE Computer...
  • Thwin, M. M. T.,Quah, T.-S.. (2005). Application of neural networks for software quality prediction using object-oriented metrics. Journal...
  • Vanderose, B.,Habra, N.. (2011). Joint Conference of the International Workshop on Software Measurement and the International Conference on...
  • Verma, G.,Tomar, P.. (2013). Predicting quality using fuzzy model on object-oriented software design. IUP Journal of Computer Sciences. 7.
  • Voas, J.. (2000). Can chaotic methods improve software quality predictions?. IEEE Software. 17. 20-22
  • Wang, Q.,Yu, B.,Zhu, J.. (2004). Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence, ICTAI '04....
  • Wang, Q.,Zhu, J.,Yu, B.. (2007). Proceedings of the 11th international conference on Evaluation and Assessment in Software Engineering, EASE'07....
  • Wang, X.,Zhang, Y.,Zhang, L.,Shi, Y.. (2010). Proceedings of the 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent...
  • Wen, J.,Li, S.,Lin, Z.,Hu, Y.,Huang, C.. (2012). Systematic literature review of machine learning based software development effort estimation...
  • Wohlin, C.,Runeson, P.,Höst, M.,Ohlsson, M. C.,Regnell, B.,Wesslén, A.. (2000). Experimentation in software engineering: an introduction....
  • Wohlin, C.,Runeson, P.,Höst, M.,Ohlsson, M. C.,Regnell, B.,Wesslén, A.. (2012). Experimentation in software engineering. Springer.
  • Xie, T.,Thummalapenta, S.,Lo, D.,Liu, C.. (2009). Data mining for software engineering. Computer. 42. 55-62
  • Xing, F.,Guo, P.,Lyu, M. R.. (2005). Proceedings of the 16th IEEE International Symposium on Software ReliabilityEngineering, ISSRE '05....
  • Xu, Z.,Khoshgoftaar, T. M.. (2001). Software quality prediction for high-assurance network telecommunications systems. The Computer Journal....
  • Yang, B.,Yao, L.,Huang, H.-Z.. (2007). Proceedings of the Third International Conference on Natural Computation. IEEE Computer Society. Washington^eDC...
  • Yang, B.,Yin, Q.,Xu, S.,Guo, P.. (2008). Software quality prediction using affinity propagation algorithm. IEEE International Joint Conference...
  • Yang, W.,Li, L.. (2008). Proceedings of the 2008 First International Conference on Intelligent Networks and Intelligent Systems, ICI-NIS '08....
  • Yuan, X.,Khoshgoftaar, T. M.,Allen, E. B.,Ganesan, K.. (2000). Proceedings of the 3rd IEEE Symposium on Application-Specific Systems and Software...
  • Zheng, J.. (2010). Cost-sensitive boosting neural networks for software defect prediction. Expert Syst. Appl.. 37. 4537-4543
  • Zhong, S.,Khoshgoftaar, T. M.,Seliya, N.. (2004). Proceedings of the Eighth IEEE international conference on High assurance systems engineering,...