From patchwork Thu Mar 21 20:15:56 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ross Burton X-Patchwork-Id: 41357 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 044C7C6FD1F for ; Thu, 21 Mar 2024 20:16:05 +0000 (UTC) Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by mx.groups.io with SMTP id smtpd.web11.7394.1711052162257429985 for ; Thu, 21 Mar 2024 13:16:02 -0700 Authentication-Results: mx.groups.io; dkim=none (message not signed); spf=pass (domain: arm.com, ip: 217.140.110.172, mailfrom: ross.burton@arm.com) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 124E51007 for ; Thu, 21 Mar 2024 13:16:36 -0700 (PDT) Received: from oss-tx204.lab.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.121.207.14]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 7EE9A3F762 for ; Thu, 21 Mar 2024 13:16:01 -0700 (PDT) From: ross.burton@arm.com To: openembedded-core@lists.openembedded.org Subject: [PATCH 1/2] tcl: improve run-ptest Date: Thu, 21 Mar 2024 20:15:56 +0000 Message-Id: <20240321201557.2309256-1-ross.burton@arm.com> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Thu, 21 Mar 2024 20:16:05 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/197427 From: Ross Burton By setting ERROR_ON_FAILURES we don't need to grep the output to know if the tests failed. By default the log runner will print the failed test case, so we don't need to store the log at all. Set the skipped tests across multiple lines so that it's easier to see what skips are related to what bugs, and to avoid very long lines. Use basename instead of awk to get the test name. Signed-off-by: Ross Burton --- meta/recipes-devtools/tcltk/tcl/run-ptest | 24 ++++++++++++++--------- 1 file changed, 15 insertions(+), 9 deletions(-) diff --git a/meta/recipes-devtools/tcltk/tcl/run-ptest b/meta/recipes-devtools/tcltk/tcl/run-ptest index 87e025fce12..affce9ab815 100644 --- a/meta/recipes-devtools/tcltk/tcl/run-ptest +++ b/meta/recipes-devtools/tcltk/tcl/run-ptest @@ -3,19 +3,25 @@ # clock.test needs a timezone to be set export TZ="Europe/London" export TCL_LIBRARY=library +export ERROR_ON_FAILURES=1 # Some tests are overly strict with timings and fail on loaded systems. -# See bugs #14825 #14882 #15081 #15321. -SKIPPED_TESTS='async-* cmdMZ-6.6 event-* exit-1.* socket-* socket_inet-*' +SKIP="" +# 15321 +SKIP="$SKIP async-\* event-\*" +# 14882 +SKIP="$SKIP cmdMZ-6.6" +# 15081 +SKIP="$SKIP exit-1.\*" +# 14825 +SKIP="$SKIP socket-\* socket_inet-\*" -for i in `ls tests/*.test | awk -F/ '{print $2}'`; do - ./tcltest tests/all.tcl -file $i -skip "$SKIPPED_TESTS" >$i.log 2>&1 - grep -q -F -e "Files with failing tests:" -e "Test files exiting with errors:" $i.log +for i in tests/*.test; do + i=$(basename $i) + ./tcltest tests/all.tcl -file $i -skip "$SKIP" if [ $? -eq 0 ]; then - echo "FAIL: $i" - cat $i.log - else echo "PASS: $i" + else + echo "FAIL: $i" fi - rm -f $i.log done From patchwork Thu Mar 21 20:15:57 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ross Burton X-Patchwork-Id: 41356 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 05751CD11DB for ; Thu, 21 Mar 2024 20:16:05 +0000 (UTC) Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by mx.groups.io with SMTP id smtpd.web10.7626.1711052162720822058 for ; Thu, 21 Mar 2024 13:16:02 -0700 Authentication-Results: mx.groups.io; dkim=none (message not signed); spf=pass (domain: arm.com, ip: 217.140.110.172, mailfrom: ross.burton@arm.com) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 99D3F1063 for ; Thu, 21 Mar 2024 13:16:36 -0700 (PDT) Received: from oss-tx204.lab.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.121.207.14]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 0E0633F762 for ; Thu, 21 Mar 2024 13:16:01 -0700 (PDT) From: ross.burton@arm.com To: openembedded-core@lists.openembedded.org Subject: [PATCH 2/2] tcl: skip I/O channel 46.1 Date: Thu, 21 Mar 2024 20:15:57 +0000 Message-Id: <20240321201557.2309256-2-ross.burton@arm.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20240321201557.2309256-1-ross.burton@arm.com> References: <20240321201557.2309256-1-ross.burton@arm.com> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Thu, 21 Mar 2024 20:16:05 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/197428 From: Ross Burton This test, which is in both the io and chanio test suites, has short timeouts which can trigger on loaded systems. [ YOCTO #15407 #15421 ] Signed-off-by: Ross Burton --- meta/recipes-devtools/tcltk/tcl/run-ptest | 2 ++ 1 file changed, 2 insertions(+) diff --git a/meta/recipes-devtools/tcltk/tcl/run-ptest b/meta/recipes-devtools/tcltk/tcl/run-ptest index affce9ab815..a403a74bb64 100644 --- a/meta/recipes-devtools/tcltk/tcl/run-ptest +++ b/meta/recipes-devtools/tcltk/tcl/run-ptest @@ -13,6 +13,8 @@ SKIP="$SKIP async-\* event-\*" SKIP="$SKIP cmdMZ-6.6" # 15081 SKIP="$SKIP exit-1.\*" +# 15407 15421 +SKIP="$SKIP \*io-46.1" # 14825 SKIP="$SKIP socket-\* socket_inet-\*"