[0/3] testimage/oeqa: Add ability to export tests to decouple them from the build system

Submitted by Stanacar, StefanX on Feb. 3, 2014, 7:22 p.m. | Patch ID: 66275


Message ID cover.1391454072.git.stefanx.stanacar@intel.com
State New
Headers show


git://git.yoctoproject.org/poky-contrib stefans/export

Commit Message

Stanacar, StefanX Feb. 3, 2014, 7:22 p.m.

These patches add the ability to export and run tests outside of the build.
As tests used to query values from the data storage this exports parts of d
and makes them avaiable in a json file, so tests don't need to change to
make them exportable. Tests exported are the ones defined in TEST_SUITES regardless
of layer.
Starting the target (in the default case qemu) is still handled by the build system, as before,
so keep that in mind.

Simplest way to test this is with a qemu image that you manually start.
For an already build image use this in local.conf:
TEST_TARGET = "simpleremote"
Export the tests: bitbake core-image-sato -c testimage 
Then: runqemu core-image-sato
And: cd tmp/testimage/core-image-sato && ./runexported.py testdata.json

In the default case (TEST_EXPORT_ONLY = "0") nothing really changes
so no tests should start failing because of this.


The following changes since commit 76f52a81f600fe7dfee0987db361e973b9ab71f8:

  insane: Fix python function whitespace changes (2014-02-03 16:16:30 +0000)

are available in the git repository at:

  git://git.yoctoproject.org/poky-contrib stefans/export

Stefan Stanacar (3):
  testimage: add ability to export tests
  lib/oeqa: add module for running tests outside of the build system
  oeqa/utils: targetbuild: don't use bb.fetch anymore

 meta/classes/testimage.bbclass     | 107 ++++++++++++++++++++++++----
 meta/lib/oeqa/oetest.py            |  17 ++---
 meta/lib/oeqa/runexported.py       | 140 +++++++++++++++++++++++++++++++++++++
 meta/lib/oeqa/utils/targetbuild.py |  27 +++----
 4 files changed, 246 insertions(+), 45 deletions(-)
 create mode 100755 meta/lib/oeqa/runexported.py