zephyr/tests
Marc Herbert 4afcc0f8af sanitycheck: CONFIG_TEST_USERSPACE / userspace tag cleanup
- Delete CONFIG_TEST_USERSPACE=n no-ops because it's the default
since commit 7b1ee5cf13

- Some tests have a "userspace" tag pretending to TEST_USERSPACE but
don't and vice versa: fix missing or spurious "userspace" tags in
testcase.yaml files.

Tests have a _spurious_ "userspace" tag when they PASS this command
cause none should pass:

  ./scripts/sanitycheck --tag=userspace -p qemu_x86 \
      --extra-args=CONFIG_TEST_USERSPACE=n  \
      --extra-args=CONFIG_USERSPACE=n | tee userspace.log

All tests run by this command must either fail to build or fail to run
with some userspace related error. Shortcut to look at all test
failures:

 zephyr_failure_logs() {
     awk '/see.*log/ {print $2}' "$@"
 }

Tests _missing_ "userspace" tag FAIL to either build or to run with some
userspace related error when running this:

  ./scripts/sanitycheck --exclude=userspace -p qemu_x86 \
      --extra-args=CONFIG_TEST_USERSPACE=n  \
      --extra-args=CONFIG_USERSPACE=n | tee excludeuserspace.log

Note the detection methods above are not 100% perfect because some
flexible tests like tests/kernel/queue/src/main.c evade them with #ifdef
CONFIG_USERSPACE smarts. Considering they never break, it is purely the
test author's decision to include or not such flexible tests in the
"userspace" subset.

Signed-off-by: Marc Herbert <marc.herbert@intel.com>
2019-05-30 08:45:39 -04:00
..
application_development file2hex.py: new --gzip-mtime option that defaults to zero + test 2019-04-17 08:27:40 -04:00
benchmarks latency_measure: Fix bug where the wrong prj.conf file was used 2019-05-30 08:27:47 -04:00
bluetooth tests/bluetooth/tester: remove spurious CONFIG_GPIO=y 2019-05-22 10:54:40 -04:00
boards samples: usb: Correct USB HID device name 2019-04-28 12:22:23 -04:00
booting/stub
cmsis_rtos_v1 tests: cmsis_v1: properly set stack size 2019-05-02 15:42:33 -04:00
cmsis_rtos_v2 lib: cmsis_v2: set default dynamic stack size 2019-05-02 15:42:33 -04:00
crypto tests: mbedtls: Call mbedtls_platform_set_printf() only if needed 2019-05-23 09:27:59 -04:00
drivers drivers/flash/flash_simulator: Allow unaligned read 2019-05-28 11:24:48 +02:00
kernel sanitycheck: CONFIG_TEST_USERSPACE / userspace tag cleanup 2019-05-30 08:45:39 -04:00
lib Build: Build with newlib-nano c library 2019-05-15 10:46:44 -05:00
misc
net sanitycheck: CONFIG_TEST_USERSPACE / userspace tag cleanup 2019-05-30 08:45:39 -04:00
posix sanitycheck: CONFIG_TEST_USERSPACE / userspace tag cleanup 2019-05-30 08:45:39 -04:00
shell shell: add test for new built-in command 2019-05-24 11:04:42 +02:00
subsys subsys/settings: Add const modifier to the value pointer 2019-05-29 10:11:12 -04:00
unit misc: Always test the portable version of the math_extras.h functions. 2019-05-14 19:53:30 -05:00
ztest