| Message ID | 20201204200737.7072-23-alex.kanavin@gmail.com |
|---|---|
| State | New |
| Headers | show |
diff --git a/meta/conf/distro/include/ptest-packagelists.inc b/meta/conf/distro/include/ptest-packagelists.inc index ce13368c2e..90272a70af 100644 --- a/meta/conf/distro/include/ptest-packagelists.inc +++ b/meta/conf/distro/include/ptest-packagelists.inc @@ -60,6 +60,7 @@ PTESTS_FAST_remove_mips64 = "qemu-ptest" # bash-ptest \ # Test outcomes are non-deterministic by design # ifupdown-ptest \ # Tested separately in lib/oeqa/selftest/cases/imagefeatures.py # mdadm-ptest \ # Tests rely on non-deterministic sleep() amounts +# lttng-tools-ptest \ # multiple sporadic failures, lack of expertise in the project to look into them #" PTESTS_SLOW = "\ @@ -73,7 +74,6 @@ PTESTS_SLOW = "\ gstreamer1.0-ptest \ libevent-ptest \ libinput-ptest \ - lttng-tools-ptest \ openssh-ptest \ openssl-ptest \ perl-ptest \
This is the patch that disables the sporadically failing stuff: http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/meta/recipes-kernel/lttng/lttng-tools/0001-tests-regression-disable-the-tools-live-tests.patch And this is the bug I had filed upstream: https://bugs.lttng.org/issues/1217 As no movement occurred on that bug since Jan, I am not keen on filing additional bugs, but you can see the additional, currently occuring failures here: https://autobuilder.yocto.io/pub/non-release/20201204-4/testresults/qemux86-64-ptest/lttng-tools.log Alex On Fri, 4 Dec 2020 at 21:39, Jonathan Rajotte-Julien < jonathan.rajotte-julien@efficios.com> wrote: > Hi, > > Upstream here. > > Always happy to give input as long as we are put in the loop. > Also bugs/sporadic test failure can be reported on our mailing list [1] > and bug tracker[2]. > > [1] https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev > [2] https://bugs.lttng.org/ > > We understand that the burden can be quite high for a project such as > lttng given we end up doing weird > testing due to the nature of our work and that we are human ;). > Still we are always interested in getting info about "sporadic" failures. > > To be clear, we are not against this patch. We understand the burden > associated with testing lttng. > > Cheers > > ----- Original Message ----- > > From: "Alexander Kanavin" <alex.kanavin@gmail.com> > > To: "openembedded-core" <openembedded-core@lists.openembedded.org> > > Cc: "Alexander Kanavin" <alex.kanavin@gmail.com> > > Sent: Friday, December 4, 2020 3:07:36 PM > > Subject: [OE-core] [PATCH 23/23] ptest-packagelists.inc: exclude > lttng-tools-ptest > > > These tests have been failing for a long time (and even more failing > > tests are already patched out); no one in YP has the > > expertise to fix the issues, so until upstream steps in, let's take > > them out, and try to reach the goal of hard ptest failures so that > > ptest regressions are caught as they happen. > > > > Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> > > --- > > meta/conf/distro/include/ptest-packagelists.inc | 2 +- > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > diff --git a/meta/conf/distro/include/ptest-packagelists.inc > > b/meta/conf/distro/include/ptest-packagelists.inc > > index ce13368c2e..90272a70af 100644 > > --- a/meta/conf/distro/include/ptest-packagelists.inc > > +++ b/meta/conf/distro/include/ptest-packagelists.inc > > @@ -60,6 +60,7 @@ PTESTS_FAST_remove_mips64 = "qemu-ptest" > > # bash-ptest \ # Test outcomes are non-deterministic by design > > # ifupdown-ptest \ # Tested separately in > > lib/oeqa/selftest/cases/imagefeatures.py > > # mdadm-ptest \ # Tests rely on non-deterministic sleep() amounts > > +# lttng-tools-ptest \ # multiple sporadic failures, lack of > expertise in the > > project to look into them > > #" > > > > PTESTS_SLOW = "\ > > @@ -73,7 +74,6 @@ PTESTS_SLOW = "\ > > gstreamer1.0-ptest \ > > libevent-ptest \ > > libinput-ptest \ > > - lttng-tools-ptest \ > > openssh-ptest \ > > openssl-ptest \ > > perl-ptest \ > > -- > > 2.29.2 > > > > > > > > > -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#145319): https://lists.openembedded.org/g/openembedded-core/message/145319 Mute This Topic: https://lists.openembedded.org/mt/78718062/1003190 Group Owner: openembedded-core+owner@lists.openembedded.org Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [mhalstead@linuxfoundation.org] -=-=-=-=-=-=-=-=-=-=-=-
These tests have been failing for a long time (and even more failing tests are already patched out); no one in YP has the expertise to fix the issues, so until upstream steps in, let's take them out, and try to reach the goal of hard ptest failures so that ptest regressions are caught as they happen. Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> --- meta/conf/distro/include/ptest-packagelists.inc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- 2.29.2 -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#145317): https://lists.openembedded.org/g/openembedded-core/message/145317 Mute This Topic: https://lists.openembedded.org/mt/78718062/3616849 Group Owner: openembedded-core+owner@lists.openembedded.org Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [michael@yoctoproject.org] -=-=-=-=-=-=-=-=-=-=-=-