Difference between revisions of "Slicer-3.6-QA"
(→Part B) |
m (→Part B) |
||
Line 139: | Line 139: | ||
!Score!!Name<ref>list produced with the script Slicer3/Scripts/generateListOfModules.sh </ref>!!Documentation!!Help <ref>including link to website documentation</ref>!!Acknowledgment <ref>including name of author and of supervisor</ref> !!Test coverage <ref>in % for non-interactive part</ref>!!valgrind errors!!Current Owner!!Comments <ref>Test coverage percentage determined by: [# lines code covered / total # lines of code (covered and non-covered) *100] of relevant .cxx and .h files</ref>!!3.6 Documentation Name <ref>http://wiki.slicer.org/slicerWiki/index.php/Documentation-3.6</ref> | !Score!!Name<ref>list produced with the script Slicer3/Scripts/generateListOfModules.sh </ref>!!Documentation!!Help <ref>including link to website documentation</ref>!!Acknowledgment <ref>including name of author and of supervisor</ref> !!Test coverage <ref>in % for non-interactive part</ref>!!valgrind errors!!Current Owner!!Comments <ref>Test coverage percentage determined by: [# lines code covered / total # lines of code (covered and non-covered) *100] of relevant .cxx and .h files</ref>!!3.6 Documentation Name <ref>http://wiki.slicer.org/slicerWiki/index.php/Documentation-3.6</ref> | ||
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Mask Image || || || || | + | |style="background:white"| ||style="width:33%"| Mask Image || || || || 82% || TBF || author ||| |n/a || |
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Median Filter || || || || | + | |style="background:white"| ||style="width:33%"| Median Filter || || || || 57% || TBF || author ||| |n/a || |
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Merge Models || || || || | + | |style="background:white"| ||style="width:33%"| Merge Models || || || || 87% || TBF || author ||| |n/a || |
|- | |- | ||
|style="background:white"| ||style="width:33%"| Mesh Contour Segmentation || || || || TBF || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| Mesh Contour Segmentation || || || || TBF || TBF || author ||| |n/a || | ||
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Model Maker || || || || | + | |style="background:white"| ||style="width:33%"| Model Maker || || || || 41% || TBF || author ||| |n/a || |
|- | |- | ||
|style="background:white"| ||style="width:33%"| MRI Bias Field Correction || || || || TBF || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| MRI Bias Field Correction || || || || TBF || TBF || author ||| |n/a || | ||
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Multiple models example || || || || | + | |style="background:white"| ||style="width:33%"| Multiple models example || || || || 2.5% || TBF || author ||| |n/a || |
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Multiply Images || || || || | + | |style="background:white"| ||style="width:33%"| Multiply Images || || || || 80% || TBF || author ||| |n/a || |
|- | |- | ||
|style="background:white"| ||style="width:33%"| N4ITK MRI Bias correction || || || || TBF || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| N4ITK MRI Bias correction || || || || TBF || TBF || author ||| |n/a || | ||
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Orient Images || || || || | + | |style="background:white"| ||style="width:33%"| Orient Images || || || || 88% || TBF || author ||| |n/a || |
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Otsu Threshold Segmentation || || || || | + | |style="background:white"| ||style="width:33%"| Otsu Threshold Segmentation || || || || 91% || TBF || author ||| |n/a || |
|- | |- | ||
|style="background:white"| ||style="width:33%"| Otsu Threshold || || || || 100% || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| Otsu Threshold || || || || 100% || TBF || author ||| |n/a || | ||
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| PolyData To Label Map || || || || | + | |style="background:white"| ||style="width:33%"| PolyData To Label Map || || || || 89% || TBF || author ||| |n/a || |
|- | |- | ||
|style="background:white"| ||style="width:33%"| Register Images BatchMake || || || || TBF || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| Register Images BatchMake || || || || TBF || TBF || author ||| |n/a || | ||
Line 173: | Line 173: | ||
|style="background:white"| ||style="width:33%"| Resample DTI Volume || || || || 100% || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| Resample DTI Volume || || || || 100% || TBF || author ||| |n/a || | ||
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Resample Scalar/Vector/DWI Volume || || || || | + | |style="background:white"| ||style="width:33%"| Resample Scalar/Vector/DWI Volume || || || || 43% || TBF || author ||| |n/a || |
|- | |- | ||
|style="background:white"| ||style="width:33%"| Resample Scalar Volume BatchMake || || || || TBF || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| Resample Scalar Volume BatchMake || || || || TBF || TBF || author ||| |n/a || | ||
Line 181: | Line 181: | ||
|style="background:white"| ||style="width:33%"| Rician LMMSE Image Filter || || || || TBF || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| Rician LMMSE Image Filter || || || || TBF || TBF || author ||| |n/a || | ||
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Rigid registration || || || || | + | |style="background:white"| ||style="width:33%"| Rigid registration || || || || 61% || TBF || author ||| |n/a || |
|- | |- | ||
|style="background:white"| ||style="width:33%"| Robust Statistics Segmentation || || || || TBF || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| Robust Statistics Segmentation || || || || TBF || TBF || author ||| |n/a || | ||
Line 193: | Line 193: | ||
|style="background:white"| ||style="width:33%"| Simple region growing || || || || TBF || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| Simple region growing || || || || TBF || TBF || author ||| |n/a || | ||
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Subtract Images || || || || | + | |style="background:white"| ||style="width:33%"| Subtract Images || || || || 76% || TBF || author ||| |n/a || |
|- | |- | ||
|style="background:white"| ||style="width:33%"| Test GridTransform registration || || || || 100 || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| Test GridTransform registration || || || || 100 || TBF || author ||| |n/a || | ||
|- | |- | ||
− | |style="background:white"| ||style="width:33%"| Threshold Image || || || || | + | |style="background:white"| ||style="width:33%"| Threshold Image || || || || 59% || TBF || author ||| |n/a || |
|- | |- | ||
|style="background:white"| ||style="width:33%"| Transform From Fiducials || || || || TBF || TBF || author ||| |n/a || | |style="background:white"| ||style="width:33%"| Transform From Fiducials || || || || TBF || TBF || author ||| |n/a || |
Revision as of 04:14, 4 May 2010
Home < Slicer-3.6-QAReturn to Slicer 3.6 documentation
- This page contains our assessment of the Slicer 3.6 modules
- See also the module culling event at the end of April 2010
Contents
Testing Status
Core Modules
Score | Name | Documentation | Help [1] | Acknowledgment [2] | Current Owner |
---|---|---|---|---|---|
?? | Camera | complete | yes, no link | no | Sebastien Barre |
?? | Welcome | complete | yes and yes | yes and yes | Wendy Plesniak |
?? | Volumes | complete | yes and yes | yes and yes | Steve Pieper |
?? | Diffusion Editor | complete | yes and yes | no | CF Westin |
?? | Models | complete | yes and yes | yes and yes | Alex Yarmarkovich |
?? | Measurements | complete | yes and yes | yes and yes | Nicole Aucoin |
?? | Fiducials | complete | yes and yes | yes and yes | Nicole Aucoin |
?? | Data | complete | yes and yes | yes and yes | Steve Pieper |
?? | Slices | complete | yes and yes | yes and yes | Jim Miller |
?? | Colors | complete | yes and yes | yes and yes | Nicole Aucoin |
?? | Interactive Editor | complete | no and yes | yes and no | Steve Pieper |
?? | ROI Module | complete | no and yes | no and yes | Alex Yarmarkovich |
?? | Volume Rendering | complete | yes and yes | no and yes | Yanling Liu |
?? | PET/CT Fusion | complete | yes and yes | yes and yes | Wendy Plesniak |
Application CLI Modules
Version of 04-29-2010
Slicer 3.6 QA table 2010 04 29
Version of 05-2010
Part A
Score | Name[1] | Documentation | Help [2] | Acknowledgment [3] | Test coverage [4] | valgrind errors | Current Owner | Comments [5] | 3.6 Documentation Name [6] |
---|---|---|---|---|---|---|---|---|---|
1Gold | my module | complete | yes and yes | yes, yes, yes | 80% | 0 | |||
ACPC Transform | 75% | 1 | Nicole Aucoin | |n/a | |||||
Add Images | TBF | TBF | author | |n/a | |||||
Affine registration | TBF | TBF | author | |n/a | |||||
BRAINSDemonWarp | TBF | TBF | author | |n/a | |||||
BRAINSFit | TBF | TBF | author | |n/a | |||||
BRAINSResample | TBF | TBF | author | |n/a | |||||
BRAINSROIAuto - Foreground masking tool | TBF | TBF | author | |n/a | |||||
BRAINSVectorDemonWarping | TBF | TBF | author | |n/a | |||||
Cast Image | TBF | TBF | author | |n/a | |||||
CheckerBoard Filter | TBF | TBF | author | |n/a | |||||
Create a DICOM Series | TBF | TBF | author | |n/a | |||||
Curvature Anisotropic Diffusion | TBF | TBF | author | |n/a | |||||
Deformable BSpline registration | TBF | TBF | author | |n/a | |||||
Dicom to Nrrd Converter | TBF | TBF | author | |n/a | |||||
Diffusion Tensor Estimation | TBF | TBF | author | |n/a | |||||
Diffusion Tensor Scalar Measurements | TBF | TBF | author | |n/a | |||||
EMSegment BatchMake | TBF | TBF | author | |n/a | |||||
EMSegment Command-line | TBF | TBF | author | |n/a | |||||
EMSegment Simple | TBF | TBF | author | |n/a | |||||
Execution Model Tour | TBF | TBF | author | |n/a | |||||
Extract Skeleton | TBF | TBF | author | |n/a | |||||
Gaussian Blur BatchMake | TBF | TBF | author | |n/a | |||||
Gaussian Blur | TBF | TBF | author | |n/a | |||||
Gradient Anisotropic Diffusion | TBF | TBF | author | |n/a | |||||
Grayscale Fill Hole | TBF | TBF | author | |n/a | |||||
Grayscale Grind Peak | TBF | TBF | author | |n/a | |||||
Grayscale Model Maker | TBF | TBF | author | |n/a | |||||
Histogram Matching | TBF | TBF | author | |n/a | |||||
Image Label Combine | TBF | TBF | author | |n/a | |||||
Joint Rician LMMSE Image Filter | TBF | TBF | author | |n/a | |||||
Labelmap Seeding | TBF | TBF | author | |n/a | |||||
Label Map Smoothing | TBF | TBF | author | |n/a | |||||
Linear registration | TBF | TBF | author | |n/a |
- ↑ list produced with the script Slicer3/Scripts/generateListOfModules.sh
- ↑ including link to website documentation
- ↑ including name of author and of supervisor
- ↑ in % for non-interactive part
- ↑ Test coverage percentage determined by: [# lines code covered / total # lines of code (covered and non-covered) *100] of relevant .cxx and .h files
- ↑ http://wiki.slicer.org/slicerWiki/index.php/Documentation-3.6
Part B
Score | Name[1] | Documentation | Help [2] | Acknowledgment [3] | Test coverage [4] | valgrind errors | Current Owner | Comments [5] | 3.6 Documentation Name [6] |
---|---|---|---|---|---|---|---|---|---|
Mask Image | 82% | TBF | author | |n/a | |||||
Median Filter | 57% | TBF | author | |n/a | |||||
Merge Models | 87% | TBF | author | |n/a | |||||
Mesh Contour Segmentation | TBF | TBF | author | |n/a | |||||
Model Maker | 41% | TBF | author | |n/a | |||||
MRI Bias Field Correction | TBF | TBF | author | |n/a | |||||
Multiple models example | 2.5% | TBF | author | |n/a | |||||
Multiply Images | 80% | TBF | author | |n/a | |||||
N4ITK MRI Bias correction | TBF | TBF | author | |n/a | |||||
Orient Images | 88% | TBF | author | |n/a | |||||
Otsu Threshold Segmentation | 91% | TBF | author | |n/a | |||||
Otsu Threshold | 100% | TBF | author | |n/a | |||||
PolyData To Label Map | 89% | TBF | author | |n/a | |||||
Register Images BatchMake | TBF | TBF | author | |n/a | |||||
Register Images MultiRes (Experimental) | TBF | TBF | author | |n/a | |||||
Register Images | TBF | TBF | author | |n/a | |||||
Resample DTI Volume | 100% | TBF | author | |n/a | |||||
Resample Scalar/Vector/DWI Volume | 43% | TBF | author | |n/a | |||||
Resample Scalar Volume BatchMake | TBF | TBF | author | |n/a | |||||
Resample Scalar Volume | TBF | TBF | author | |n/a | |||||
Rician LMMSE Image Filter | TBF | TBF | author | |n/a | |||||
Rigid registration | 61% | TBF | author | |n/a | |||||
Robust Statistics Segmentation | TBF | TBF | author | |n/a | |||||
ROISelect | TBF | TBF | author | |n/a | |||||
Simple DWI IO Test | TBF | TBF | author | |n/a | |||||
Simple IO Test | TBF | TBF | author | |n/a | |||||
Simple region growing | TBF | TBF | author | |n/a | |||||
Subtract Images | 76% | TBF | author | |n/a | |||||
Test GridTransform registration | 100 | TBF | author | |n/a | |||||
Threshold Image | 59% | TBF | author | |n/a | |||||
Transform From Fiducials | TBF | TBF | author | |n/a | |||||
Unbiased Non Local Means filter for DWI | TBF | TBF | author | |n/a | |||||
Voting Binary Hole Filling | 100% | TBF | author | |n/a |
- ↑ list produced with the script Slicer3/Scripts/generateListOfModules.sh
- ↑ including link to website documentation
- ↑ including name of author and of supervisor
- ↑ in % for non-interactive part
- ↑ Test coverage percentage determined by: [# lines code covered / total # lines of code (covered and non-covered) *100] of relevant .cxx and .h files
- ↑ http://wiki.slicer.org/slicerWiki/index.php/Documentation-3.6
Testing Partition
Most Slicer modules have a GUI component and a Data Processing component.
Testing GUI components is still a challenge, so we will focus here on testing the Data Processing components. This can be done in most cases by partitioning the module into a GUI section and a Data Processing section, where the second one usually takes the form of a C++ class (although that is not a requirement).
The data processing section can be tested by using standard CTest/CMake mechanisms. Basically by adding ADD_TEST() entries to the CMakeLists.txt file of the module.
Luis Ibanez' scoring system
The following scoring will be applied to the data processing sections of all modules:
Score | Code Coverage | Valgrind Errors | Documentation | Tutorial |
---|---|---|---|---|
1Gold | > 80% | 0 | yes | yes |
2Silver | > 70% | < 10 | yes | yes |
3Bronze | > 60% | < 50 | yes | yes |
4Clay | > 50% | < 100 | yes | yes |
5Coal | < 50% | > 100 | yes | yes |
6Hazard | unknown | unknown | no | no |
The code coverage and Valgrind error must be the ones reported on the Nightly Slicer Dashboard. Anecdotal data is not acceptable.