u-boot.git/test/py/conftest.py, branch v2018.03

test/py: Allow any unit test suite to be found

2017-12-02T23:32:58+00:00

The u-boot.sym file is scanned to find unit test suites for execution. At
present it only finds those whose names start with 'dm' or 'env'. This
code is buried in the bowels of the test code so when adding a new suite
it is not easy to discover why it is ignored by the test framework.

There seems to be no need to make this restriction. Drop it.

Signed-off-by: Simon Glass 
Acked-by: Stephen Warren

test/py: add skip marker for reliance on tools

2017-09-29T18:07:53+00:00

Some tests use external tools (executables) during their operation. Add
a test.py mark to indicate this. This allows those tests to be skipped if
the required tool is not present.

Signed-off-by: Stephen Warren

test/py: provide more information about test skip reason

2017-09-29T18:07:52+00:00

When skipping tests, explicitly mention the board type or config option
that caused the skip. This will help people understand/fix any issues.

Signed-off-by: Stephen Warren

test/py: expose config and log as session scoped fixture

2016-11-21T19:07:27+00:00

If a test uses a fixture which is expensive to setup, the fixture can
possibly created with session or module scope. As u_boot_console has
function scope, it can not be used in this case.

Signed-off-by: Stefan Brüns 
Acked-by: Stephen Warren

test/py: ensure a log section exists for skipped tests

2016-10-23T22:33:17+00:00

In pytest 3, runtestprotocol() may not call pytest_runtest_setup() if
the test is skipped. That call is required to create a section for the
test in the log file. If this is skipped, the call to log.end_section()
at the tail of pytest_runtest_protocol() will throw an exception. This
patch ensures that a log section always exists, both to avoid the
exception and to ensure that a consistently structured log file is
always created.

Cc: Stefan Brüns 
Reported-by: Stefan Brüns 
Signed-off-by: Stephen Warren 
Tested-by: Tom Rini

Merge git://git.denx.de/u-boot-dm

2016-07-15T12:06:22+00:00

test/py: Handle testing with the sandbox_spl board

2016-07-15T02:40:24+00:00

This board can sometimes be used for tests. Handle it the same way as
sandbox.

Note: I plan to drop the sandbox_spl board at some point and merge its
features into sandbox. So this commit may not be necessary.

Signed-off-by: Simon Glass

test/py: Allow tests to control the sandbox device-tree file

2016-07-14T22:22:33+00:00

Normally tests will run with the test.dtb file designed for this purpose.
However, the verified boot tests need to run with their own device-tree
file, containing a public key.

Make the device-tree file a config option so that it can be adjusted by
tests. The default is to keep the current behaviour.

Signed-off-by: Simon Glass 
Reviewed-by: Teddy Reed

test/py: print summary in test order

2016-02-15T20:58:28+00:00

Use lists rather than sets to record the status of tests. This causes
the test summary in the HTML file to be generated in the same order as
the tests are (or would have been) run. This makes it easier to locate
the first failed test. The log for this test might have interesting
first clues re: interaction with the environment (e.g. hardware flashing,
serial console, ...) and may help tracking down external issues.

Signed-off-by: Stephen Warren 
Acked-by: Simon Glass

test/py: don't import pexpect

2016-02-15T20:58:27+00:00

The code replaced pexpect with custom code long ago. Don't import the
unused module so it doesn't need to be installed.

Signed-off-by: Stephen Warren 
Acked-by: Simon Glass