Systematic Mapping Studies in Software Engineering
DOI:
https://doi.org/10.46243/jst.2021.v6.i05.pp138-146Keywords:
Systematic Mapping Studies, Systematic Reviews, Evidence Based Software EngineeringAbstract
BACKGROUND: A software engineering systematic map is a defined method to build a classification scheme and structure a software engineering field of interest. The analysis of results focuses on frequencies of publications for categories within the scheme. Thereby, the coverage of the research field can be determined. Different facets of the scheme can also be combined to answer more specific research questions. OBJECTIVE: We describe how to conduct a systematic mapping study in software engineering and provide guidelines. We also compare systematic maps and systematic reviews to clarify how to chose between them. This comparison leads to a set of guidelines for systematic maps. METHOD: We have defined a systematic mapping process and applied it to complete a systematic mapping study. Furthermore, we compare systematic maps with systematic reviews by systematically analyzing existing systematic reviews. RESULTS: We describe a process for software engineering systematic mapping studies and compare it to systematic reviews. Based on this, guidelines for conducting systematic maps are defined. CONCLUSIONS: Systematic maps and reviews are different in terms of goals, breadth, validity issues and implications. Thus, they should be used complementarily and require different methods (e.g., for analysis).
References
Bailey, J., Budgen, D., Turner, M., Kitchenham, B., Brereton, P. & Linkman, S. (2007), Evidence relating to object-oriented software design: A survey, in ‘Proc. of the 1st Int. Symp. on Empirical Software Engineering and Measurement (ESEM 2007)’, pp. 482–484
Budgen, D., Kitchenham, B., Charters, S., Turner, M., Brereton, P. & Linjkman, S. (2007), Preliminary results of a study of the completeness and clarity of structured abstracts, in ‘Proc. of the 11th Int. Conf. on Evaluation and Assessment in Software Engineering 2007’, pp. 64–72
Davis, A. M., Tub´ıo, O´. D., Hickey, A. M., Juzgado, N. J. & Moreno, A. M. (2006), Effectiveness of requirements elicitation techniques: Empirical results derived from a systematic review, in ‘Proc. of the 15th Int. Conf. on Requirements Engineering (RE 2006)’, pp. 176–185
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B. & Sutton, A. (2005), ‘Synthesising qualitative and quantitative evidence: a review of possible methods.’, Journal of Health Services Research and Policy 10(1), 45–53. Dyba˚, T., Kampenes, V. B. & Sjøberg, D. I. K. (2006), ‘A systematic review of statistical power in software engineering experiments’, Information & Software Technology 48(8), 745–755
Glass, R. L., Vessey, I. & Ramesh, V. (2002), ‘Research in software engineering: an analysis of the literature’, Information & Software Technology 44(8), 491–506
Grimstad, S., Jørgensen, M. & Moløkken-Østvold, K. (2006), ‘Software effort estimation terminology: The tower of babel’, Information & Software Technology 48(4), 302–310
Hannay, J. E., Sjøberg, D. I. K. & Dyba˚, T. (2007), ‘A systematic review of theory use in software engineering experiments’, IEEE Trans. Software Eng. 33(2), 87–107. Jørgensen, M. & Shepperd, M. J. (2007), ‘A systematic review of software development cost estimation studies’, IEEE Trans. Software Eng. 33(1), 33–53
Kampenes, V. B., Dyba˚, T., Hannay, J. E. & Sjøberg, D. I. K. (2007), ‘Systematic review: A systematic review of effect size in software engineering experiments’, Information & Software Technology 49(11-12), 1073–1086
Kitchenham, B. (2007), ‘The current state of evidence-based software engineering. keynote int. conf. on evaluation and assessment in software engineering (2007)’
Kitchenham, B. A., Dyba, T. & Jorgensen, M. (2004), Evidence-based software engineering, in ‘Proc. of the 26th Int. Conf. on Software Engineering (ICSE 2006)’, IEEE Computer Society, pp. 273–281
Kitchenham, B. A., Mendes, E. & Travassos, G. H. (2007), ‘Cross versus within-company cost estimation studies: A systematic review’, IEEE Trans. Software Eng. 33(5), 316–329
Kitchenham, B. & Charters, S. (2007), Guidelines for performing systematic literature reviews in software engineering, Technical Report EBSE-2007-01, School of Computer Science and Mathematics, Keele University
MacDonell, S. G. & Shepperd, M. J. (2007), Comparing local and global software effort estimation models-reflections on a systematic review, in ‘Proc. of the 1st Int. Symp. on Empirical Software Engineering and Measurement (ESEM 2007)’, pp. 401–409
Mendes, E. (2005), A systematic review of web engineering research, in ‘Proc. of the Int. Symp. on Empirical Software Engineering (ISESE 2005)’, pp. 498–507
Mujtaba, S., Petersen, K., Feldt, R. & Mattsson, M. (2008), Software product line variability: A systematic mapping study, in ‘submission’. Sjøberg, D. I. K., Hannay, J. E., Hansen, O., Kampenes, V. B., Karahasanovic, A., Liborg, N.-K. & Rekdal, A. C. (2005), ‘A survey of controlled experiments in software engineering’, IEEE Trans
Software Eng. 31(9), 733–753
Wieringa, R., Maiden, N. A. M., Mead, N. R. & Rolland, C. (2006), ‘Requirements engineering paper classification and evaluation criteria: a proposal and a discussion’, Requir. Eng. 11(1), 102–107
