[23/23] ptest-packagelists.inc: exclude lttng-tools-ptest

Submitted by Alexander Kanavin on Dec. 4, 2020, 8:07 p.m. | Patch ID: 178795

Details

Message ID 20201204200737.7072-23-alex.kanavin@gmail.com
State New
Headers show

Commit Message

Alexander Kanavin Dec. 4, 2020, 8:07 p.m.
These tests have been failing for a long time (and even more failing
tests are already patched out); no one in YP has the
expertise to fix the issues, so until upstream steps in, let's take
them out, and try to reach the goal of hard ptest failures so that
ptest regressions are caught as they happen.

Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>

---
 meta/conf/distro/include/ptest-packagelists.inc | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

-- 
2.29.2
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#145317): https://lists.openembedded.org/g/openembedded-core/message/145317
Mute This Topic: https://lists.openembedded.org/mt/78718062/3616849
Group Owner: openembedded-core+owner@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [michael@yoctoproject.org]
-=-=-=-=-=-=-=-=-=-=-=-

Patch hide | download patch | download mbox

diff --git a/meta/conf/distro/include/ptest-packagelists.inc b/meta/conf/distro/include/ptest-packagelists.inc
index ce13368c2e..90272a70af 100644
--- a/meta/conf/distro/include/ptest-packagelists.inc
+++ b/meta/conf/distro/include/ptest-packagelists.inc
@@ -60,6 +60,7 @@  PTESTS_FAST_remove_mips64 = "qemu-ptest"
 #    bash-ptest \ # Test outcomes are non-deterministic by design
 #    ifupdown-ptest \ # Tested separately in lib/oeqa/selftest/cases/imagefeatures.py
 #    mdadm-ptest \ # Tests rely on non-deterministic sleep() amounts
+#    lttng-tools-ptest \ # multiple sporadic failures, lack of expertise in the project to look into them
 #"
 
 PTESTS_SLOW = "\
@@ -73,7 +74,6 @@  PTESTS_SLOW = "\
     gstreamer1.0-ptest \
     libevent-ptest \
     libinput-ptest \
-    lttng-tools-ptest \
     openssh-ptest \
     openssl-ptest \
     perl-ptest \

Comments

Alexander Kanavin Dec. 4, 2020, 8:48 p.m.
This is the patch that disables the sporadically failing stuff:
http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/meta/recipes-kernel/lttng/lttng-tools/0001-tests-regression-disable-the-tools-live-tests.patch

And this is the bug I had filed upstream:
https://bugs.lttng.org/issues/1217

As no movement occurred on that bug since Jan, I am not keen on filing
additional bugs, but you can see the additional, currently occuring
failures here:
https://autobuilder.yocto.io/pub/non-release/20201204-4/testresults/qemux86-64-ptest/lttng-tools.log

Alex


On Fri, 4 Dec 2020 at 21:39, Jonathan Rajotte-Julien <
jonathan.rajotte-julien@efficios.com> wrote:

> Hi,

>

> Upstream here.

>

> Always happy to give input as long as we are put in the loop.

> Also bugs/sporadic test failure can be reported on our mailing list [1]

> and bug tracker[2].

>

> [1] https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

> [2] https://bugs.lttng.org/

>

> We understand that the burden can be quite high for a project such as

> lttng given we end up doing weird

> testing due to the nature of our work and that we are human ;).

> Still we are always interested in getting info about "sporadic" failures.

>

> To be clear, we are not against this patch. We understand the burden

> associated with testing lttng.

>

> Cheers

>

> ----- Original Message -----

> > From: "Alexander Kanavin" <alex.kanavin@gmail.com>

> > To: "openembedded-core" <openembedded-core@lists.openembedded.org>

> > Cc: "Alexander Kanavin" <alex.kanavin@gmail.com>

> > Sent: Friday, December 4, 2020 3:07:36 PM

> > Subject: [OE-core] [PATCH 23/23] ptest-packagelists.inc: exclude

> lttng-tools-ptest

>

> > These tests have been failing for a long time (and even more failing

> > tests are already patched out); no one in YP has the

> > expertise to fix the issues, so until upstream steps in, let's take

> > them out, and try to reach the goal of hard ptest failures so that

> > ptest regressions are caught as they happen.

> >

> > Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>

> > ---

> > meta/conf/distro/include/ptest-packagelists.inc | 2 +-

> > 1 file changed, 1 insertion(+), 1 deletion(-)

> >

> > diff --git a/meta/conf/distro/include/ptest-packagelists.inc

> > b/meta/conf/distro/include/ptest-packagelists.inc

> > index ce13368c2e..90272a70af 100644

> > --- a/meta/conf/distro/include/ptest-packagelists.inc

> > +++ b/meta/conf/distro/include/ptest-packagelists.inc

> > @@ -60,6 +60,7 @@ PTESTS_FAST_remove_mips64 = "qemu-ptest"

> > #    bash-ptest \ # Test outcomes are non-deterministic by design

> > #    ifupdown-ptest \ # Tested separately in

> > lib/oeqa/selftest/cases/imagefeatures.py

> > #    mdadm-ptest \ # Tests rely on non-deterministic sleep() amounts

> > +#    lttng-tools-ptest \ # multiple sporadic failures, lack of

> expertise in the

> > project to look into them

> > #"

> >

> > PTESTS_SLOW = "\

> > @@ -73,7 +74,6 @@ PTESTS_SLOW = "\

> >     gstreamer1.0-ptest \

> >     libevent-ptest \

> >     libinput-ptest \

> > -    lttng-tools-ptest \

> >     openssh-ptest \

> >     openssl-ptest \

> >     perl-ptest \

> > --

> > 2.29.2

> >

> >

> >

> > 

>
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#145319): https://lists.openembedded.org/g/openembedded-core/message/145319
Mute This Topic: https://lists.openembedded.org/mt/78718062/1003190
Group Owner: openembedded-core+owner@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [mhalstead@linuxfoundation.org]
-=-=-=-=-=-=-=-=-=-=-=-