Patchwork [0/3] testimage/oeqa: Add ability to export tests to decouple them from the build system

login
register
mail settings
Submitter Stanacar, StefanX
Date Feb. 3, 2014, 7:22 p.m.
Message ID <cover.1391454072.git.stefanx.stanacar@intel.com>
Download mbox
Permalink /patch/66275/
State New
Headers show

Pull-request

git://git.yoctoproject.org/poky-contrib stefans/export

Comments

Stanacar, StefanX - Feb. 3, 2014, 7:22 p.m.
Hello,

These patches add the ability to export and run tests outside of the build.
As tests used to query values from the data storage this exports parts of d
and makes them avaiable in a json file, so tests don't need to change to
make them exportable. Tests exported are the ones defined in TEST_SUITES regardless
of layer.
Starting the target (in the default case qemu) is still handled by the build system, as before,
so keep that in mind.

Simplest way to test this is with a qemu image that you manually start.
For an already build image use this in local.conf:
TEST_EXPORT_ONLY = "1"
TEST_TARGET = "simpleremote"
TEST_TARGET_IP = "192.168.7.2"
TEST_SERVER_IP = "192.168.7.1"
Export the tests: bitbake core-image-sato -c testimage 
Then: runqemu core-image-sato
And: cd tmp/testimage/core-image-sato && ./runexported.py testdata.json

In the default case (TEST_EXPORT_ONLY = "0") nothing really changes
so no tests should start failing because of this.

Cheers,
Stefan


The following changes since commit 76f52a81f600fe7dfee0987db361e973b9ab71f8:

  insane: Fix python function whitespace changes (2014-02-03 16:16:30 +0000)

are available in the git repository at:

  git://git.yoctoproject.org/poky-contrib stefans/export
  http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=stefans/export

Stefan Stanacar (3):
  testimage: add ability to export tests
  lib/oeqa: add module for running tests outside of the build system
  oeqa/utils: targetbuild: don't use bb.fetch anymore

 meta/classes/testimage.bbclass     | 107 ++++++++++++++++++++++++----
 meta/lib/oeqa/oetest.py            |  17 ++---
 meta/lib/oeqa/runexported.py       | 140 +++++++++++++++++++++++++++++++++++++
 meta/lib/oeqa/utils/targetbuild.py |  27 +++----
 4 files changed, 246 insertions(+), 45 deletions(-)
 create mode 100755 meta/lib/oeqa/runexported.py