Documentation/Nightly/Developers/QtTesting

Overview

QtTesting provides us a testing framework to test our application. It complements unit tests, by testing the application in its globality.

Following is a step by step guide to create slicer unit test, or module unit test, using this framework, which can be run as part of a nightly build automatic testing.

Write a 3DSlicer test using QtTesting

QtTesting framework can also be use to create module test.
Use the description below, but instead of Slicer4/Applications/SlicerApp/Testing all the path start by Slicer4/Path/To/The/Modules/Testing

Following is the different step to create a test using QtTesting framework.

Create your XML script

See QtTesting user Wiki to know how to create this xml script.
Save the xml script to Slicer4/Applications/SlicerApp/Data/Input/MY_TUTORIAL_NAME_tutorial.xml

Create a Python script

This Python test will start 3DSlicer and run the previously recorded xml script

Create a python file with the following lines

   import os
   import slicer
   import ApplicationsSlicerAppData as data
   filepath = data.input + '/MYTUTORIALNAME.xml')     ex : NeurosurgicalPlanningTutorial.xml
   testUtility = slicer.app.testingUtility()
   success = testUtility.playTests(filepath)
   if not success :
     raise Exception('Failed to finished properly the play back !')

Save to the directory Slicer4/Applications/SlicerApp/Testing/Python/MYTUTORIALNAME.py

Add the test in CMake

Adding the test in CMake will allow the test to be run with CTest and will also be run by the dashboard machines every nights.

Edit the file Slicer4/Applications/SlicerApp/Testing/Python/CMakeLists.txt
Add your test at the end of the Slicer_USE_QTTESTING condition and add the name in the set_tests_properties function :

   if(Slicer_USE_QTTESTING)
     {   
     ...
     slicer_add_python_test(
       SCRIPT MYTUTORIALNAME.py
       SLICER_ARGS --launcher-no-splash --qt-testing)
     set_tests_properties(
       py_NeurosurgicalPlanningTutorial
       py_DiffusionTensorImagingTutorial
       ....
       py_MYTUTORIALNAME
       ...
       PROPERTIES RUN_SERIAL ON
       )
     }

You just wrote a Slicer Unit Test using QtTesting framework !

Run your test

You can either use directly CTest or the pyhton script created.

Using CTest

Linux	Mac	Windows
You need to open a terminal. Then type in the terminal: $ cd path/to/Slicer4-Superbuild/Slicer-build $ ctest -R MYTUTORIALNAME -VV	You need to open a terminal. Start -> Microsoft Visual Studio 2008 -> Visual Studio Tools -> Visual Studio 2008 Command Prompt Then type in the terminal: $ cd path\to\Slicer4-Superbuild\Slicer-build $ path\to\cmake\ctest.exe -R MYTUTORIALNAME -VV

Using the python script

Linux	Mac	Windows
You need to open a terminal. Then type in the terminal: $ cd path/to/Slicer4/Application/SlicerApp/Testing/Python $ python MY_TEST_NAME.py	You need to open a terminal. Start -> Microsoft Visual Studio 2008 -> Visual Studio Tools -> Visual Studio 2008 Command Prompt Then type in the terminal: $ cd path\to\Slicer4\Applicaiton\SlicerApp\Testing\Python $ path\to\Slicer4-Superbuild\python-build\PCBuild\python.exe MY_TEST_NAME.py

Create custom translator/player

After created a custom widget, it might be possible that all its actions are not properly recorded, or played.
QtTesting provides us basic translator and player template, to create our custom translator and player according to the widget.

You can use the following command to create those basic files.

Linux	Mac	Windows
You need to open a terminal. Then type in the terminal: $ cd path/to/Slicer4-Superbuild/CTK-build/QtTesting/Utilities/Scripts $ python TranslatorPlayerWizard.py MY_WIDGET_NAME $ cd ../MY_WIDGET_NAME	You need to open a terminal. Start -> Microsoft Visual Studio 2008 -> Visual Studio Tools -> Visual Studio 2008 Command Prompt Then type in the terminal: $ cd path\to\Slicer4-Superbuild $ python-build\PCBuild\python.exe CTK-build\QtTesting\Utilities\Scripts\TranslatorPlayerWizard.py MY_WIDGET_NAME $ cd ../MY_WIDGET_NAME

Open bugs

Work in progress, following the two bug trackers :

Slicer issues

QtTesting issues