From patchwork Fri Oct 13 16:52:03 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ross Burton X-Patchwork-Id: 32148 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8C5EECDB47E for ; Fri, 13 Oct 2023 16:52:11 +0000 (UTC) Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by mx.groups.io with SMTP id smtpd.web10.43943.1697215929226279956 for ; Fri, 13 Oct 2023 09:52:09 -0700 Authentication-Results: mx.groups.io; dkim=none (message not signed); spf=pass (domain: arm.com, ip: 217.140.110.172, mailfrom: ross.burton@arm.com) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 3A71D11FB; Fri, 13 Oct 2023 09:52:49 -0700 (PDT) Received: from oss-tx204.lab.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.121.207.14]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 52B773F5A1; Fri, 13 Oct 2023 09:52:08 -0700 (PDT) From: ross.burton@arm.com To: meta-arm@lists.yoctoproject.org Cc: nd@arm.com Subject: [PATCH 1/3] arm/oeqa/selftest: tag all tests with "meta-arm" Date: Fri, 13 Oct 2023 17:52:03 +0100 Message-Id: <20231013165205.1678618-1-ross.burton@arm.com> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 13 Oct 2023 16:52:11 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/meta-arm/message/5121 From: Ross Burton Tag all of the tests in meta-arm so that they can be selectively ran without needing to explicitly list them. Signed-off-by: Ross Burton --- meta-arm/lib/oeqa/selftest/cases/runfvp.py | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/meta-arm/lib/oeqa/selftest/cases/runfvp.py b/meta-arm/lib/oeqa/selftest/cases/runfvp.py index d60aa3c4..61ce2ab9 100644 --- a/meta-arm/lib/oeqa/selftest/cases/runfvp.py +++ b/meta-arm/lib/oeqa/selftest/cases/runfvp.py @@ -7,10 +7,12 @@ import tempfile import unittest.mock from oeqa.selftest.case import OESelftestTestCase +from oeqa.core.decorator import OETestTag runfvp = pathlib.Path(__file__).parents[5] / "scripts" / "runfvp" testdir = pathlib.Path(__file__).parent / "tests" +@OETestTag("meta-arm") class RunFVPTests(OESelftestTestCase): def setUpLocal(self): self.assertTrue(runfvp.exists()) @@ -51,6 +53,7 @@ class RunFVPTests(OESelftestTestCase): # test-parameter sets one argument, add another manually self.run_fvp(testdir / "test-parameter.json", "--", "--parameter", "board.dog=woof") +@OETestTag("meta-arm") class ConfFileTests(OESelftestTestCase): def test_no_exe(self): from fvp import conffile @@ -80,6 +83,7 @@ class ConfFileTests(OESelftestTestCase): self.assertTrue("env" in conf) +@OETestTag("meta-arm") class RunnerTests(OESelftestTestCase): def create_mock(self): return unittest.mock.patch("subprocess.Popen") From patchwork Fri Oct 13 16:52:04 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ross Burton X-Patchwork-Id: 32149 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9BE75C41513 for ; Fri, 13 Oct 2023 16:52:11 +0000 (UTC) Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by mx.groups.io with SMTP id smtpd.web10.43946.1697215930335577581 for ; Fri, 13 Oct 2023 09:52:10 -0700 Authentication-Results: mx.groups.io; dkim=none (message not signed); spf=pass (domain: arm.com, ip: 217.140.110.172, mailfrom: ross.burton@arm.com) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id E45EF139F; Fri, 13 Oct 2023 09:52:49 -0700 (PDT) Received: from oss-tx204.lab.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.121.207.14]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 00EDD3F5A1; Fri, 13 Oct 2023 09:52:08 -0700 (PDT) From: ross.burton@arm.com To: meta-arm@lists.yoctoproject.org Cc: nd@arm.com Subject: [PATCH 2/3] CI: don't hardcode the selftest tests to run Date: Fri, 13 Oct 2023 17:52:04 +0100 Message-Id: <20231013165205.1678618-2-ross.burton@arm.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20231013165205.1678618-1-ross.burton@arm.com> References: <20231013165205.1678618-1-ross.burton@arm.com> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 13 Oct 2023 16:52:11 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/meta-arm/message/5122 From: Ross Burton Just execute all tests with the meta-arm tag, instead of hardcoding the list of tests. Also run two tests in parallel as there's no reason to limit it to one. Signed-off-by: Ross Burton --- .gitlab-ci.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml index 0466c096..e1845be5 100644 --- a/.gitlab-ci.yml +++ b/.gitlab-ci.yml @@ -234,7 +234,7 @@ selftest: extends: .setup script: - KASFILES=./ci/qemuarm64.yml:./ci/selftest.yml:lockfile.yml - - kas shell --update --force-checkout $KASFILES -c 'oe-selftest --num-processes 1 --run-tests runfvp' + - kas shell --update --force-checkout $KASFILES -c 'oe-selftest --num-processes 2 --select-tag meta-arm --run-all-tests' # Validate layers are Yocto Project Compatible check-layers: From patchwork Fri Oct 13 16:52:05 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ross Burton X-Patchwork-Id: 32150 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id BA15FCDB483 for ; Fri, 13 Oct 2023 16:52:11 +0000 (UTC) Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by mx.groups.io with SMTP id smtpd.web10.43947.1697215930511807940 for ; Fri, 13 Oct 2023 09:52:10 -0700 Authentication-Results: mx.groups.io; dkim=none (message not signed); spf=pass (domain: arm.com, ip: 217.140.110.172, mailfrom: ross.burton@arm.com) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 9B38911FB; Fri, 13 Oct 2023 09:52:50 -0700 (PDT) Received: from oss-tx204.lab.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.121.207.14]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id ABAFF3F5A1; Fri, 13 Oct 2023 09:52:09 -0700 (PDT) From: ross.burton@arm.com To: meta-arm@lists.yoctoproject.org Cc: nd@arm.com Subject: [PATCH 3/3] CI: also run the _qemutiny testcase for poky-tiny Date: Fri, 13 Oct 2023 17:52:05 +0100 Message-Id: <20231013165205.1678618-3-ross.burton@arm.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20231013165205.1678618-1-ross.burton@arm.com> References: <20231013165205.1678618-1-ross.burton@arm.com> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 13 Oct 2023 16:52:11 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/meta-arm/message/5123 From: Ross Burton The terribly named qemutiny test case tries to login to the target over the serial console. It's designed for poky-tiny, so add it to the tests we run in poky-tiny builds. Signed-off-by: Ross Burton --- ci/poky-tiny.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/ci/poky-tiny.yml b/ci/poky-tiny.yml index d869c557..f1763010 100644 --- a/ci/poky-tiny.yml +++ b/ci/poky-tiny.yml @@ -5,7 +5,7 @@ distro: poky-tiny local_conf_header: hacking: | - TEST_SUITES = "ping" + TEST_SUITES = "_qemutiny ping" extrapackages: | # Intentionally blank to prevent perf from being added to the image in base.yml