u-boot.git/test/py/conftest.py, branch v2022.01

test/py: improve regular expression for ut subtest symbol matcher

2021-05-24T18:21:30+00:00

Improve the regular expression that matches unittest symbols in
u-boot.sym.

Currently we do not enforce no prefix in symbol string, but with the
soon to come change in linker lists declaring lists and entries with the
__ADDRESSABLE macro (because of LTO), the symbol file will contain for
every symbol of the form
  _u_boot_list_2_ut_X_2_Y
also symbol
  __UNIQUE_ID___addressable__u_boot_list_2_ut_X_2_YN,
(where N at the end is some number).

In order to avoid matching these additional symbols, ensure that the
character before "_u_boot_list_2_ut" is not a symbol name character.

Signed-off-by: Marek Behún 
Reviewed-by: Simon Glass

test: Rename all linker lists to have a ut_ prefix

2021-03-12T14:57:30+00:00

At present each test suite has its own portion of the linker_list section
of the image, but other lists are interspersed. This makes it hard to
enumerate all the available tests without knowing the suites that each one
is in.

Place all tests together in a single contiguous list by giving them
common prefix not used elsewhere in U-Boot. This makes it possible to find
the start and end of all tests.

Signed-off-by: Simon Glass

test/py: fix runtest wrapper for pytest 6

2021-02-01T21:33:02+00:00

The implementation of pytest_runtest_protocol() must call
pytest_runtest_logstart() and pytest_runtest_logfinish(). This appears to
be necessary even in pytest 5.2.1 judging by the default version of
pytest_runtest_protocol(), but evidently some form of code reorganization
in pytest only made this have a practical effect in the newer version. I'd
previously been under the impression that 100% of the required work of
pytest_runtest_protocol() was handled by the fact it called
runtestprotocol() as its implementation. However, it appears that custom
implementations do need to do a little more than this.

Reported-by: Heinrich Schuchardt 
Signed-off-by: Stephen Warren 
Reviewed-by: Simon Glass

pytest: Collect SPL unit tests

2020-10-29T20:42:18+00:00

Add a new test_spl fixture to handle running SPL unit tests.

Signed-off-by: Simon Glass

test/py: use actual core count for parallel builds

2020-06-02T17:06:07+00:00

When building U-Boot we should not blindly use make -j8 but consider the
actual core count given by os.cpu_count().

Signed-off-by: Heinrich Schuchardt 
Reviewed-by: Simon Glass 
Acked-by: Stephen Warren

test/py: Allow using buildman to build U-Boot

2020-04-11T01:36:36+00:00

It is a pain to have to set the CROSS_COMPILE environment variable when
using test.py's --build option. It is possible to get this using the -A
option from buildman. But it seems better to just use buildman to do the
build when it is available.

However using buildman adds a new dependency to the test system which we
want to avoid. So leave the default as is and add a flag to make it use
buildman.

Note that most of these changes relate to test.py and the parts of the
travis/gitlab/azure scripts which relate to running test and building a
suitable U-Boot to run the tests on.

Signed-off-by: Simon Glass 
Reviewed-by: Tom Rini

test/py: Fix broken 'notbuildconfigspec' marker

2020-01-07T17:08:19+00:00

Consider the following test sample:

@pytest.mark.buildconfigspec('fit')
@pytest.mark.notbuildconfigspec('generate_acpi_table')
def test_sample(u_boot_console):

Whatever the argument of the 'notbuildconfigspec' is,
the test ends up being skipped with the message:

('/uboot/test/py/conftest.py', 463,
 'Skipped: .config feature "fit" enabled')

Signed-off-by: Cristian Ciocaltea 
Signed-off-by: Heinrich Schuchardt

test.py: Make search for autoconf.mk more permissive

2019-12-10T13:02:49+00:00

Buildman doesn't store this file in the same directory as a normal build.
Update the conftest code to handle both cases.

Change-Id: I1fd0e56054d7dc77394a7589336aa0991bd0133d
Signed-off-by: Simon Glass

test/py: Manual python3 fixes

2019-10-30T21:48:47+00:00

- Modern pytest is more visible in telling us about parameters that we
  had not described, so describe a few more.
- ConfigParser.readfp(...) is now configparser.read_file(...)
- As part of the "strings vs bytes" conversions in Python 3, we use the
  default encoding/decoding of utf-8 but in some places tell Python to
  replace problematic conversions rather than throw a fatal error.
- Fix a typo noticed while doing the above ("tot he" -> "to the").
- As suggested by Stephen, re-alphabetize the import list
- Per Heinrich, replace how we write contents in test_fit.py

Reviewed-by: Simon Glass 
Tested-by: Stephen Warren 
Tested-by: Simon Glass  [on sandbox]
Signed-off-by: Tom Rini

test/py: Automated conversion to Python 3

2019-10-30T21:48:47+00:00

Use the 2to3 tool to perform numerous automatic conversions from Python
2 syntax to Python 3.  Also fix whitespace problems that Python 3
catches that Python 2 did not.

Reviewed-by: Stephen Warren 
Reviewed-by: Simon Glass 
Tested-by: Stephen Warren 
Tested-by: Simon Glass  [on sandbox]
Signed-off-by: Tom Rini