Jumble Java Byte Code to Measure the Effectiveness of Unit Tests

Irvine, Sean A.; Pavlinic, Tin; Trigg, Leonard E.; Cleary, John G.; Inglis, Stuart J.; Utting, Mark

doi:10.1109/TAIC.PART.2007.38

Files

Jumblev5.pdf

241.8Kb

Irvine, S. A., Pavlinic, T., Trigg, L., Cleary, J.G., Inglis, S. & Utting, M.(2007). Jumble java byte code to measure the effectiveness of unit tests. In Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques – MUTATION, September 10-14, 2007. (pp. 169-175). Washington, DC, USA: IEEE Computer Society.

Permanent Research Commons link: https://hdl.handle.net/10289/1828

Abstract

Jumble is a byte code level mutation testing tool for Java which inter-operates with JUnit. It has been designed to operate in an industrial setting with large projects. Heuristics have been included to speed the checking of mutations, for example, noting which test fails for each mutation and running this first in subsequent mutation checks. Significant effort has been put into ensuring that it can test code which uses custom class loading and reflection. This requires careful attention to class path handling and coexistence with foreign class-loaders. Jumble is currently used on a continuous basis within an agile programming environment with approximately 370,000 lines of Java code under source control. This checks out project code every fifteen minutes and runs an incremental set of unit tests and mutation tests for modified classes. Jumble is being made available as open source.

Date

2007

Type

Conference Contribution

Publisher

IEEE Computer Society

Rights

This article has been published in Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques – MUTATION, September 10-14, 2007. ©2007 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

Collections

Computing and Mathematical Sciences Papers [1410]