| Title | Defects4J: A Database of existing faults to enable controlled testing studies for Java programs |
| Publication Type | Conference Paper |
| Year of Publication | 2014 |
| Authors | Just R, Jalali D, Ernst MD |
| Conference Name | ISSTA 2014, Proceedings of the 2014 International Symposium on Software Testing and Analysis |
| Pagination | 437–440 |
| Date or Month Published | July |
| Conference Location | San Jose, CA, USA |
| Abstract | Empirical studies in software testing research may not be comparable, reproducible, or characteristic of practice. One reason is that real bugs are too infrequently used in software testing research. Extracting and reproducing real bugs is challenging and as a result hand-seeded faults or mutants are commonly used as a substitute. \par This paper presents Defects4J, a database and extensible framework providing real bugs to enable reproducible studies in software testing research. The initial version of Defects4J contains 357 real bugs from 5 real-world open source programs. Each real bug is accompanied by a comprehensive test suite that can expose (demonstrate) that bug. Defects4J is extensible and builds on top of each program's version control system. Once a program is configured in Defects4J, new bugs can be added to the database with little or no effort. \par Defects4J features a framework to easily access faulty and fixed program versions and corresponding test suites. This framework also provides a high-level interface to common tasks in software testing research, making it easy to conduct and reproduce empirical studies. Defects4J is publicly available at \urlhttps://defects4j.org. |
| Notes | Tool demo |
| Downloads | https://defects4j.org/ Defects4J website
https://homes.cs.washington.edu/~mernst/pubs/bug-database-issta2014.pdf PDF
|
| Citation Key | JustJE2014 |
