A Framework for Improved Regression Testing Based Upon CTest and CDash

Lowekamp, Bradley1*,Chen, David
1.Lockheed Martin Contractor for Office of High Performance Computing and Communications National Library of Medicine
Abstract
A Framework for Improved Regression Testing Based Upon CTest and CDash

Abstract

The existing CMake and CTest environment provides an excellent platform for execution and submission of software quality tests. However, there is little support or aid for regression type tests provided to lessen the burden of writing tests and verifying the results. We propose an additional facility to compare measurements generated by a software quality test to a based-line result. Our approach enables the ability to use multiple images as measurements, along with integer, floating point and string values for regression tests. We describe a new testing class framework which provides the functionality of reading, writing, comparing and differentiating named measurements.

Keywords

regressionXMLCTesttesting
Manuscript
Source Code and Data

Source Code and Data

IJTestingFrameworkDocumentLaTeXCDashDisplay.eps3.2 MBInsightArticle.cls4.1 KBInsightCDashDisplay.eps5 MBInsightJournal.ist220 BInsightJournal.bib157.9 KBInsightJournal.sty35.2 KBMakefile1.1 KBalgorithm.sty2.2 KBTestingFramework.tex16.4 KBalgorithmic.sty5.4 KBamssymb.sty14.9 KBfancyhdr.sty14.4 KBfloatflt.sty10.8 KBfncychap.sty10.1 KBitkFlowDiagram.eps1 MBitkNewFlowDiagram.eps985.2 KBpicins.sty17.4 KBtimes.sty857 BSourceCMakeLists.txt2 KBIJMacros.txt3.4 KBCTestConfig.cmake579 BUtilitiesFileUtilitiesCMakeLists.txt338 BFileUtilities.h2.3 KBFileUtilities.cpp2.8 KBFileUtilitiesConfigure.h.in540 BPathName.cpp8 KBPathName.h5.2 KBitktfCMakeLists.txt790 BTestingCMakeLists.txt2.2 KBDataitktfTest3.png5.2 KBvm_head_coronal.jpg21.9 KBvm_head_coronal.png17.5 KBvm_head_coronal_diff.jpg22.3 KBvm_head_coronal_diff.png17.7 KBXMLitktfMeasurementFileImageInsightTest1.xml342 BitktfMeasurementFileImageInsightTest2.xml360 BitktfMeasurementFileImageInsightTest3.xml229 BitktfMeasurementFileImageInsightTest4.xml240 BitktfMeasurementInsightRegionTest.xml653 BitktfMeasurementFileImageInsightTest1.cxx654 BitktfMeasurementFileImageInsightTest2.cxx1.2 KBitktfMeasurementFileImageInsightTest4.cxx2.1 KBitktfMeasurementFileImageInsightTest3.cxx1.1 KBitktfMeasurementInsightRegionTest.cxx883 BitktfCompareVisitor.cxx4.2 KBitktfCompareVisitor.h1.7 KBitktfDifferenceVisitor.cxx9.6 KBitktfDifferenceVisitor.h1.4 KBitktfFilterWatcher.h3.8 KBitktfRegression.cxx2.1 KBitktfRegression.h4.9 KBitktfRegressionSupport.h.in520 BTestingFrameworkCMakeLists.txt582 BtestsCMakeLists.txt1.8 KBdataplain.txt60 Bvm_head_coronal.jpg21.9 KBvm_head_coronal.png17.5 KBtfRegressionTestOutputTest1.cxx1 KBtfHeaderTest.cxx232 BtfRegressionTestOutputTest2.cxx1.1 KBtfRegressionTestTest1.cxx427 BtfRegressionTestTest2.cxx928 BtfRegressionTestTest3.cxx1.6 KBtfRegressionTestTest4.cxx1.1 KBtfTestSupport.h.in268 BxmltfRegressionTestOutputTest1.xml131 BtfRegressionTestOutputTest2.xml131 BtfRegressionTestTest1.xml131 BtfRegressionTestTest2.xml657 BtfRegressionTestTest3.xml668 BtfRegressionTestTest4.xml425 BTestFrameworkConfigure.h.in538 BtfBase64.cpp8.9 KBtfBase64.h10.9 KBtfDiff.cpp15.4 KBtfDiff.h3.4 KBtfMeasurement.cpp15.9 KBtfMeasurement.h17.4 KBtfMeasurementVisitor.cpp5 KBtfMeasurementVisitor.h5.4 KBtfRegressionTest.cpp19.4 KBtfRegressionTest.h9.2 KBXMLitktfShiftScaleInPlaceImageFilterTest.xml2 KBitktfFilterWatcher.h3.8 KBitktfRegressionSupport.h.in520 BitktfShiftScaleInPlaceImageFilterTest.cxx5.3 KBtfPipeToXML.cxx2.6 KB

Select a file to preview