Random test case generation and manual unit testing: substitute or complement in retrofitting tests for legacy code?

Autoren Rudolf Ramler
Martina Schmidt
Dietmar Winkler
Editoren V. Cortellessa. H. Muccini
O. Demirors
TitelRandom test case generation and manual unit testing: substitute or complement in retrofitting tests for legacy code?
BuchtitelProceedings of the 38th Euromicro Conference on Software Engineering and Advanced Applications (SEAA 2012)
Typin Konferenzband
VerlagIEEE Computer Society
AbteilungPQE
ISBN978-0-7695-4790-9
MonatSeptember
Jahr2012
Seiten286-293
SCCH ID#1230
Abstract

Unit testing of legacy code is often characterized by the goal to find a maximum number of defects with minimal effort. In context of restrictive time frames and limited resources, approaches for generating test cases promise increased defect detection effectiveness. This paper presents the results of an empirical study investigating the effectiveness of (a) manual unit testing conducted by 48 master students within a time limit of 60 minutes and (b) tool-supported random test case generation with Randoop. Both approaches have been applied on a Java collection class library containing 35 seeded defects. With the specific settings, where time and resource restrictions limit the performance of manual unit testing, we found that (1) the number of defects detected by random test case generation is in the range of manual unit testing and, furthermore, (2) the randomly generated test cases detect different defects than manual unit testing. Therefore, random test case generation seems a useful aid to jump start manual unit testing of legacy code.