zephyrproject-rtos/zephyr
0
0
Fork 0
mirror of https://github.com/zephyrproject-rtos/zephyr synced 2025-08-10 13:46:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
6cc7ea51e4
zephyr/scripts/tests/sanitycheck
History
Christian Taedcke b2be804421 sanitycheck: Fix xml testsuite attribute skipped 
In the junit output the attribute containing the number of skipped tests
must be named "skipped" instead of "skip".
See e.g. https://github.com/junit-team/junit5/blob/main/platform-tests/
src/test/resources/jenkins-junit.xsd#L95

Signed-off-by: Christian Taedcke <christian.taedcke@lemonbeat.com>
2020-08-13 11:51:19 +02:00
..
test_data
conftest.py sanitycheck: Testcases for report functions of TestSuite Class 2020-07-03 12:20:35 -04:00
README.md doc: Fix path to requirements 2020-07-30 16:40:29 +02:00
test_reporting_testsuite.py sanitycheck: Fix xml testsuite attribute skipped 2020-08-13 11:51:19 +02:00
test_sanitycheck.py
test_testinstance.py sanitycheck: Modify expected_subcases 2020-08-03 19:46:15 -04:00
test_testsuite_class.py sanitycheck: support only_tags for boards 2020-07-20 17:44:16 -04:00

README.md

Sanitycheck Testing

Running the tests require the environment variable ZEPHYR_BASE to be set.

Sanitycheck Testsuite are located in $ZEPHYR_BASE/scripts/tests directory with all the data files in $ZEPHYR_BASE/scripts/test_data directory.

Dependencies

Install all the dependencies using

pip install -r $ZEPHYR_BASE/scripts/requirements-build-test.txt

Executing testsuite

The testcases can be executed from the root directory using

pytest $ZEPHYR_BASE/scripts/tests/sanitycheck

Sanitycheck Coverage

The coverage for all the tests can be run using the command below. This will collect all the tests available.

coverage run -m pytest $ZEPHYR_BASE/scripts/tests/sanitycheck/

Then we can generate the coverage report for just sanitylib script using

coverage report -m $ZEPHYR_BASE/scripts/sanity_chk/sanitylib.py

To generate the coverage report for sanitycheck script use below command

coverage report -m $ZEPHYR_BASE/scripts/sanitycheck

The html coverage report for sanitycheck can be generated using

coverage html sanitycheck

If needed,the full coverage html report can be generated in every run of "pytest" in the tests directory using configuration file (setup.cfg).

Organization of tests

  • conftest.py: Contains common fixtures for use in testing the sanitycheck tool.
  • test_sanitycheck.py : Contains basic testcases for environment variables, verifying testcase & platform schema's.
  • test_testsuite_class.py : Contains testcases for Testsuite class (except reporting functionality) in sanitylib.py.
  • test_testinstance.py : Contains testcases for Testinstance and Testcase class.
  • test_reporting_testsuite.py : Contains testcases for reporting fucntionality of Testsuite class of sanitycheck.