An experimental search-based approach to cohesion metric evaluation |
| |
Authors: | Mel Ó Cinnéide Iman Hemati Moghadam Mark Harman Steve Counsell Laurence Tratt |
| |
Affiliation: | 1.School of Computer Science,University College Dublin,Dublin,Ireland;2.Department of Computer Science,University College London,London,England;3.Department of Computer Science,Brunel University,London,UK;4.Department of Informatics,King’s College London,London,England |
| |
Abstract: | In spite of several decades of software metrics research and practice, there is little understanding of how software metrics relate to one another, nor is there any established methodology for comparing them. We propose a novel experimental technique, based on search-based refactoring, to ‘animate’ metrics and observe their behaviour in a practical setting. Our aim is to promote metrics to the level of active, opinionated objects that can be compared experimentally to uncover where they conflict, and to understand better the underlying cause of the conflict. Our experimental approaches include semi-random refactoring, refactoring for increased metric agreement/disagreement, refactoring to increase/decrease the gap between a pair of metrics, and targeted hypothesis testing. We apply our approach to five popular cohesion metrics using ten real-world Java systems, involving 330,000 lines of code and the application of over 78,000 refactorings. Our results demonstrate that cohesion metrics disagree with each other in a remarkable 55 % of cases, that Low-level Similarity-based Class Cohesion (LSCC) is the best representative of the set of metrics we investigate while Sensitive Class Cohesion (SCOM) is the least representative, and we discover several hitherto unknown differences between the examined metrics. We also use our approach to investigate the impact of including inheritance in a cohesion metric definition and find that doing so dramatically changes the metric. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |
|