u-boot.git/test/py/conftest.py, branch v2022.10

vpl: Support running vpl tests

2022-05-02T13:58:13+00:00

Add support for these to the pytest system.

Signed-off-by: Simon Glass

test/py: Relax the naming rules for unit tests

2021-11-28T23:51:51+00:00

At present the collection function used by pytest is quite strict on the
naming of the functions it detects. In particular it requires the name of
the test to be repeated in the function name.

This is not enforced anywhere else, but instead the tests are silently
omitted from the pytest run. This affects a few dozen tests.

The rule does not seem to have any particular purpose. Relax it, so that
all tests that use the UNIT_TEST() macro will run, regardless of the name
of the test function.

Signed-off-by: Simon Glass

test/py: improve regular expression for ut subtest symbol matcher

2021-05-24T18:21:30+00:00

Improve the regular expression that matches unittest symbols in
u-boot.sym.

Currently we do not enforce no prefix in symbol string, but with the
soon to come change in linker lists declaring lists and entries with the
__ADDRESSABLE macro (because of LTO), the symbol file will contain for
every symbol of the form
  _u_boot_list_2_ut_X_2_Y
also symbol
  __UNIQUE_ID___addressable__u_boot_list_2_ut_X_2_YN,
(where N at the end is some number).

In order to avoid matching these additional symbols, ensure that the
character before "_u_boot_list_2_ut" is not a symbol name character.

Signed-off-by: Marek Behún 
Reviewed-by: Simon Glass

test: Rename all linker lists to have a ut_ prefix

2021-03-12T14:57:30+00:00

At present each test suite has its own portion of the linker_list section
of the image, but other lists are interspersed. This makes it hard to
enumerate all the available tests without knowing the suites that each one
is in.

Place all tests together in a single contiguous list by giving them
common prefix not used elsewhere in U-Boot. This makes it possible to find
the start and end of all tests.

Signed-off-by: Simon Glass

test/py: fix runtest wrapper for pytest 6

2021-02-01T21:33:02+00:00

The implementation of pytest_runtest_protocol() must call
pytest_runtest_logstart() and pytest_runtest_logfinish(). This appears to
be necessary even in pytest 5.2.1 judging by the default version of
pytest_runtest_protocol(), but evidently some form of code reorganization
in pytest only made this have a practical effect in the newer version. I'd
previously been under the impression that 100% of the required work of
pytest_runtest_protocol() was handled by the fact it called
runtestprotocol() as its implementation. However, it appears that custom
implementations do need to do a little more than this.

Reported-by: Heinrich Schuchardt 
Signed-off-by: Stephen Warren 
Reviewed-by: Simon Glass

pytest: Collect SPL unit tests

2020-10-29T20:42:18+00:00

Add a new test_spl fixture to handle running SPL unit tests.

Signed-off-by: Simon Glass

test/py: use actual core count for parallel builds

2020-06-02T17:06:07+00:00

When building U-Boot we should not blindly use make -j8 but consider the
actual core count given by os.cpu_count().

Signed-off-by: Heinrich Schuchardt 
Reviewed-by: Simon Glass 
Acked-by: Stephen Warren

test/py: Allow using buildman to build U-Boot

2020-04-11T01:36:36+00:00

It is a pain to have to set the CROSS_COMPILE environment variable when
using test.py's --build option. It is possible to get this using the -A
option from buildman. But it seems better to just use buildman to do the
build when it is available.

However using buildman adds a new dependency to the test system which we
want to avoid. So leave the default as is and add a flag to make it use
buildman.

Note that most of these changes relate to test.py and the parts of the
travis/gitlab/azure scripts which relate to running test and building a
suitable U-Boot to run the tests on.

Signed-off-by: Simon Glass 
Reviewed-by: Tom Rini

test/py: Fix broken 'notbuildconfigspec' marker

2020-01-07T17:08:19+00:00

Consider the following test sample:

@pytest.mark.buildconfigspec('fit')
@pytest.mark.notbuildconfigspec('generate_acpi_table')
def test_sample(u_boot_console):

Whatever the argument of the 'notbuildconfigspec' is,
the test ends up being skipped with the message:

('/uboot/test/py/conftest.py', 463,
 'Skipped: .config feature "fit" enabled')

Signed-off-by: Cristian Ciocaltea 
Signed-off-by: Heinrich Schuchardt

test.py: Make search for autoconf.mk more permissive

2019-12-10T13:02:49+00:00

Buildman doesn't store this file in the same directory as a normal build.
Update the conftest code to handle both cases.

Change-Id: I1fd0e56054d7dc77394a7589336aa0991bd0133d
Signed-off-by: Simon Glass