Difference between revisions of "Slicer-3.6-QA"
From Slicer Wiki
| Line 56: | Line 56: | ||
|style="background:white"|??||style="width:33%"| DiffusionTensorMathematics ||no||yes and no||yes and yes|| 56.2% || 5||Raul San Jose Estepar|| | |style="background:white"|??||style="width:33%"| DiffusionTensorMathematics ||no||yes and no||yes and yes|| 56.2% || 5||Raul San Jose Estepar|| | ||
|- | |- | ||
| − | |style="background: | + | |style="background:gold"|Gold||style="width:33%"| OrientImage ||complete||yes and yes||yes and yes|| 85.7% || 0 ||Bill Lorensen|| |
|- | |- | ||
|style="background:white"|??||style="width:33%"| LinearRegistration ||complete||yes and no||yes and yes|| 66.7% || 4 ||Daniel Blezek|| | |style="background:white"|??||style="width:33%"| LinearRegistration ||complete||yes and no||yes and yes|| 66.7% || 4 ||Daniel Blezek|| | ||
| Line 64: | Line 64: | ||
|style="background:white"|??||style="width:33%"| AffineRegistration ||complete||yes and no||yes and yes||style="background:red"| 1.4% || 82 || Casey Goodlett|| | |style="background:white"|??||style="width:33%"| AffineRegistration ||complete||yes and no||yes and yes||style="background:red"| 1.4% || 82 || Casey Goodlett|| | ||
|- | |- | ||
| − | |style="background: | + | |style="background:gold"|Gold||style="width:33%"| BSplineDeformableRegistration ||complete||yes and yes||yes and yes|| 82.3% || 6 || Bill Lorensen|| |
|- | |- | ||
| − | |style="background: | + | |style="background:gold"|Gold||style="width:33%"| TestGridTransformRegistration ||no||no||yes and yes || 90.7% || 0 ||Yinglin Lee|| |
|- | |- | ||
|style="background:white"|??||style="width:33%"| CheckerBoard ||complete||yes and yes||yes and yes|| 67.4% || 0 ||Bill Lorensen|| | |style="background:white"|??||style="width:33%"| CheckerBoard ||complete||yes and yes||yes and yes|| 67.4% || 0 ||Bill Lorensen|| | ||
| Line 72: | Line 72: | ||
|style="background:white"|??||style="width:33%"| ResampleScalarVolume ||complete||yes and yes||yes and yes|| 57.1% || 0 ||Bill Lorensen|| | |style="background:white"|??||style="width:33%"| ResampleScalarVolume ||complete||yes and yes||yes and yes|| 57.1% || 0 ||Bill Lorensen|| | ||
|- | |- | ||
| − | |style="background: | + | |style="background:gold"|Gold||style="width:33%"| PolyDataToLabelmap ||no||yes and yes||yes and yes|| 87.9% || 0 ||Nicole Aucoin, Xiaodong Tao|| |
|- | |- | ||
|style="background:white"|??||style="width:33%"| GaussianBlurImageFilter ||complete||yes and no||yes and yes|| 55.9% || 0 ||Julien Jomier, Stephen Aylward|| | |style="background:white"|??||style="width:33%"| GaussianBlurImageFilter ||complete||yes and no||yes and yes|| 55.9% || 0 ||Julien Jomier, Stephen Aylward|| | ||
|- | |- | ||
| − | |style="background: | + | |style="background:gold"|Gold||style="width:33%"| ConfidenceConnected/SimpleRegionGrowing ||no||yes and no||yes and yes|| 87.5% || 0 ||Jim Miller|| |
|- | |- | ||
| − | |style="background: | + | |style="background:gold"|Gold||style="width:33%"| ExecutionModelTour ||no||yes and yes||yes and yes|| 87.2% || 0 ||Daniel Blezek, Bill Lorensen|| |
|- | |- | ||
| − | |style="background: | + | |style="background:gold"|Gold||style="width:33%"| ImageReadDicomWrite ||no||yes and yes||yes and yes|| 86.1% || 0 ||Bill Lorensen|| |
|- | |- | ||
|style="background:white"|??||style="width:33%"| CurvatureAnisotropicDiffusion ||complete||yes and yes||yes and yes|| 64.3% || 0 ||Bill Lorensen|| | |style="background:white"|??||style="width:33%"| CurvatureAnisotropicDiffusion ||complete||yes and yes||yes and yes|| 64.3% || 0 ||Bill Lorensen|| | ||
| Line 92: | Line 92: | ||
|style="background:white"|??||style="width:33%"| HistogramMatching ||complete||yes and yes||yes and yes|| 65.0% || 0 ||Bill Lorensen|| | |style="background:white"|??||style="width:33%"| HistogramMatching ||complete||yes and yes||yes and yes|| 65.0% || 0 ||Bill Lorensen|| | ||
|- | |- | ||
| − | |style="background: | + | |style="background:gold"|Gold||style="width:33%"| OtsuThresholdImageFilter ||no||yes and yes||yes and yes|| 100% || 0 ||Bill Lorensen|| |
|- | |- | ||
| − | |style="background: | + | |style="background:gold"|Gold||style="width:33%"| OtsuThresholdSegmentation ||complete||yes and no||yes and yes|| 90.9% || 0 ||Bill Lorensen|| |
|- | |- | ||
|style="background:white"|??||style="width:33%"| Subtract ||complete||yes and yes||yes and yes|| 71.7% || 0 ||Bill Lorensen|| | |style="background:white"|??||style="width:33%"| Subtract ||complete||yes and yes||yes and yes|| 71.7% || 0 ||Bill Lorensen|| | ||
| Line 100: | Line 100: | ||
|style="background:white"|??||style="width:33%"| Multiply ||no||yes and no||yes and yes|| 77.6% || 0 ||Bill Lorensen|| | |style="background:white"|??||style="width:33%"| Multiply ||no||yes and no||yes and yes|| 77.6% || 0 ||Bill Lorensen|| | ||
|- | |- | ||
| − | |style="background: | + | |style="background:gold"|Gold||style="width:33%"| Add ||complete||yes and yes||yes and yes|| 84.9% || 0 ||Bill Lorensen|| |
|- | |- | ||
|style="background:white"|??||style="width:33%"| Threshold ||no||yes and no||yes and yes|| 55.8% || 0 ||Nicole Aucoin|| | |style="background:white"|??||style="width:33%"| Threshold ||no||yes and no||yes and yes|| 55.8% || 0 ||Nicole Aucoin|| | ||
Revision as of 13:58, 23 April 2010
Home < Slicer-3.6-QAReturn to Slicer 3.6 documentation
- This page contains our assessment of the Slicer 3.6 modules
- See also the module culling event at the end of April 2010
Contents
Testing Status
Core Modules
| Score | Name | Documentation | Help [1] | Acknowledgment [2] | Current Owner |
|---|---|---|---|---|---|
| ?? | Camera | complete | yes, no link | no | Sebastien Barre |
| ?? | Volumes | complete | yes and yes | yes and yes | Steve Pieper |
| ?? | Diffusion Editor | complete | yes and yes | no | CF Westin |
| ?? | Models | complete | yes and yes | yes and yes | Alex Yarmarkovich |
| ?? | Measurements | complete | yes and yes | no and yes | Nicole Aucoin |
| ?? | Fiducials | complete | yes and yes | no | Nicole Aucoin |
| ?? | Data | complete | yes and yes | yes and yes | Steve Pieper |
| ?? | Slices | complete | no | no | Jim Miller |
| ?? | Colors | complete | yes and no | yes and no | Nicole Aucoin |
| ?? | Interactive Editor | complete | no and yes | yes and no | Steve Pieper |
| ?? | ROI Module | complete | no and yes | no and yes | Alex Yarmarkovich |
| ?? | Volume Rendering | complete | yes and yes | no and yes | Yanling Liu |
Application CLI Modules
| Score | Name | Documentation | Help [1] | Acknowledgment [2] | Test coverage [3] | valgrind errors | Current Owner | Comments [4] |
|---|---|---|---|---|---|---|---|---|
| Gold | my module | complete | yes and yes | yes, yes, yes | 80% | 0 | ||
| ?? | DiffusionWeightedTest | no | no | yes and yes | 69.8% | 0 | Raul San Jose Estepar | |
| ?? | DiffusionTensorEstimation | complete | yes and no | yes and yes | 79.7% | 9 | Raul San Jose Estepar | |
| ?? | DiffusionTensorMathematics | no | yes and no | yes and yes | 56.2% | 5 | Raul San Jose Estepar | |
| Gold | OrientImage | complete | yes and yes | yes and yes | 85.7% | 0 | Bill Lorensen | |
| ?? | LinearRegistration | complete | yes and no | yes and yes | 66.7% | 4 | Daniel Blezek | |
| ?? | RigidRegistration | no | yes and no | yes and yes | 1.0% | 92 | Daniel Blezek | |
| ?? | AffineRegistration | complete | yes and no | yes and yes | 1.4% | 82 | Casey Goodlett | |
| Gold | BSplineDeformableRegistration | complete | yes and yes | yes and yes | 82.3% | 6 | Bill Lorensen | |
| Gold | TestGridTransformRegistration | no | no | yes and yes | 90.7% | 0 | Yinglin Lee | |
| ?? | CheckerBoard | complete | yes and yes | yes and yes | 67.4% | 0 | Bill Lorensen | |
| ?? | ResampleScalarVolume | complete | yes and yes | yes and yes | 57.1% | 0 | Bill Lorensen | |
| Gold | PolyDataToLabelmap | no | yes and yes | yes and yes | 87.9% | 0 | Nicole Aucoin, Xiaodong Tao | |
| ?? | GaussianBlurImageFilter | complete | yes and no | yes and yes | 55.9% | 0 | Julien Jomier, Stephen Aylward | |
| Gold | ConfidenceConnected/SimpleRegionGrowing | no | yes and no | yes and yes | 87.5% | 0 | Jim Miller | |
| Gold | ExecutionModelTour | no | yes and yes | yes and yes | 87.2% | 0 | Daniel Blezek, Bill Lorensen | |
| Gold | ImageReadDicomWrite | no | yes and yes | yes and yes | 86.1% | 0 | Bill Lorensen | |
| ?? | CurvatureAnisotropicDiffusion | complete | yes and yes | yes and yes | 64.3% | 0 | Bill Lorensen | |
| ?? | GradientAnisotropicDiffusion | complete | yes and yes | yes and yes | 63.4% | 0 | Bill Lorensen | |
| ?? | MedianImageFilter | complete | yes and yes | yes and yes | 51.1% | 0 | Bill Lorensen | |
| ?? | DWIDicomLoad | complete | yes and yes | yes and yes | 0% | (disabled) | Kerstin Kessel | |
| ?? | HistogramMatching | complete | yes and yes | yes and yes | 65.0% | 0 | Bill Lorensen | |
| Gold | OtsuThresholdImageFilter | no | yes and yes | yes and yes | 100% | 0 | Bill Lorensen | |
| Gold | OtsuThresholdSegmentation | complete | yes and no | yes and yes | 90.9% | 0 | Bill Lorensen | |
| ?? | Subtract | complete | yes and yes | yes and yes | 71.7% | 0 | Bill Lorensen | |
| ?? | Multiply | no | yes and no | yes and yes | 77.6% | 0 | Bill Lorensen | |
| Gold | Add | complete | yes and yes | yes and yes | 84.9% | 0 | Bill Lorensen | |
| ?? | Threshold | no | yes and no | yes and yes | 55.8% | 0 | Nicole Aucoin | |
| ?? | Mask | complete | yes and no | yes and yes | 80.0% | 0 | Nicole Aucoin | |
| ?? | Cast | complete | yes and no | yes and yes | 14.6% | 0 | Nicole Aucoin | |
| ?? | VotingBinaryHoleFillingImageFilter | complete | yes and yes | yes and yes | 100% | 0 | Bill Lorensen | |
| ?? | ModelMaker | complete | yes and yes | yes and yes | 57.4% | 1 | Nicole Aucoin | |
| ?? | MultipleModelsExample | no | yes and no | yes and yes | 1.9% | 50 | Nicole Aucoin | |
| ?? | GrayscaleModelMaker | no | yes and no | yes and yes | 82.1% | 1 | Bill Lorensen | |
| ?? | MergeModels | no | yes and yes | yes and yes | 62.7% | 0 | Nicole Aucoin, Daniel Haehn | |
| ?? | GrayscaleFillHoleImageFilter | complete | yes and yes | yes and yes | 57.1% | 0 | Bill Lorensen | |
| ?? | GrayscaleGrindPeakImageFilter | complete | yes and yes | yes and yes | 64.5% | 0 | Bill Lorensen | |
| ?? | LabelMapSmoothing | no | yes and no | yes and yes | 87.9% | 0 | Dirk Padfield, Josh Cates, Ross Whitaker | |
| ?? | ImageLabelCombine | complete | yes and no | yes and no | 7.5% | 50 | Alex Yarmarkovich | |
| ?? | ResampleVolume2 | no | yes and yes | yes and yes | 46.8% | 0 | Francois Budin | |
| ?? | ZeroCrossingBasedEdgeDetectionImageFilter | no | yes and no | yes and yes | 62.5% | 0 | Elliot Uvero | |
| ?? | FreesurferSurfaceSectionExtraction | no | yes and no | yes and yes | 60.0% | 62 | Katharina Quintus |
Testing Partition
Most Slicer modules have a GUI component and a Data Processing component.
Testing GUI components is still a challenge, so we will focus here on testing the Data Processing components. This can be done in most cases by partitioning the module into a GUI section and a Data Processing section, where the second one usually takes the form of a C++ class (although that is not a requirement).
The data processing section can be tested by using standard CTest/CMake mechanisms. Basically by adding ADD_TEST() entries to the CMakeLists.txt file of the module.
Luis Ibanez' scoring system
The following scoring will be applied to the data processing sections of all modules:
| Score | Code Coverage | Valgrind Errors | Documentation | Tutorial |
|---|---|---|---|---|
| Gold | > 80% | 0 | yes | yes |
| Silver | > 70% | < 10 | yes | yes |
| Bronze | > 60% | < 50 | yes | yes |
| Clay | > 50% | < 100 | yes | yes |
| Coal | < 50% | > 100 | yes | yes |
| Hazard | unknown | unknown | no | no |
The code coverage and Valgrind error must be the ones reported on the Nightly Slicer Dashboard. Anecdotal data is not acceptable.
