From patchwork Wed Jul 26 16:22:06 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Mittal, Anuj" X-Patchwork-Id: 27953 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 40C57C04A94 for ; Wed, 26 Jul 2023 16:22:31 +0000 (UTC) Received: from mga12.intel.com (mga12.intel.com [192.55.52.136]) by mx.groups.io with SMTP id smtpd.web11.15664.1690388543744120259 for ; Wed, 26 Jul 2023 09:22:24 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@intel.com header.s=Intel header.b=kH6jbr4h; spf=pass (domain: intel.com, ip: 192.55.52.136, mailfrom: anuj.mittal@intel.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1690388544; x=1721924544; h=from:to:subject:date:message-id:in-reply-to:references: mime-version:content-transfer-encoding; bh=Z/3uymY/U31mw8WJWRMpzmQAS0FyuE1M+8j+r1+QVcs=; b=kH6jbr4hvXP+sPYdaOnmGoDYB9oj703j7v0IFcSmnq07fbFg0h43XnCH 79k5AAgc9T3kGD4/qGSWk1qOvnSO1Pc8K0RNnttNBLFjCfmo+HNwnlmYg cuMcuQTWmgHiLG01zxG0RMP4x4eEVJ0IFehY1tq2DcjAYYpyrViAbMPuM Ey1B+TvTGTOxS3sWAWwVOrZiEmuFDhbedg+XndwWSKwID8ThwaTmWDUeg BcJELe9GnCnxp6DgIY0AsD1uodEDNDTvbtDvt68aUHbRSIYHRs0Iqu0Z0 w37zzhaWa4vBXIKr3imLSVRU8cCt6l1O21SWLLckWNIXxFdV6v/8tXhTA g==; X-IronPort-AV: E=McAfee;i="6600,9927,10783"; a="347676109" X-IronPort-AV: E=Sophos;i="6.01,232,1684825200"; d="scan'208";a="347676109" Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by fmsmga106.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jul 2023 09:22:24 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10783"; a="816745732" X-IronPort-AV: E=Sophos;i="6.01,232,1684825200"; d="scan'208";a="816745732" Received: from anmitta2-mobl3.gar.corp.intel.com (HELO anmitta2-mobl3.intel.com) ([10.215.151.246]) by fmsmga003-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jul 2023 09:22:23 -0700 From: Anuj Mittal To: openembedded-core@lists.openembedded.org Subject: [PATCH 1/4] glibc/check-test-wrapper: don't emit warnings from ssh Date: Thu, 27 Jul 2023 00:22:06 +0800 Message-ID: <20230726162209.131855-2-anuj.mittal@intel.com> X-Mailer: git-send-email 2.41.0 In-Reply-To: <20230726162209.131855-1-anuj.mittal@intel.com> References: <20230726162209.131855-1-anuj.mittal@intel.com> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 26 Jul 2023 16:22:31 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/184892 Dont fill up the test log with ssh warning about having added the host to list of known hosts. Also helps fix a test case failure where stderr log was being compared to a known value. Signed-off-by: Anuj Mittal --- meta/recipes-core/glibc/glibc/check-test-wrapper | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/recipes-core/glibc/glibc/check-test-wrapper b/meta/recipes-core/glibc/glibc/check-test-wrapper index 6ec9b9b29e..5cc993f718 100644 --- a/meta/recipes-core/glibc/glibc/check-test-wrapper +++ b/meta/recipes-core/glibc/glibc/check-test-wrapper @@ -58,7 +58,7 @@ elif targettype == "ssh": user = os.environ.get("SSH_HOST_USER", None) port = os.environ.get("SSH_HOST_PORT", None) - command = ["ssh", "-o", "UserKnownHostsFile=/dev/null", "-o", "StrictHostKeyChecking=no"] + command = ["ssh", "-o", "UserKnownHostsFile=/dev/null", "-o", "StrictHostKeyChecking=no", "-o", "LogLevel=quiet"] if port: command += ["-p", str(port)] if not host: From patchwork Wed Jul 26 16:22:07 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Mittal, Anuj" X-Patchwork-Id: 27952 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 40C27C001DC for ; Wed, 26 Jul 2023 16:22:31 +0000 (UTC) Received: from mga12.intel.com (mga12.intel.com [192.55.52.136]) by mx.groups.io with SMTP id smtpd.web11.15664.1690388543744120259 for ; Wed, 26 Jul 2023 09:22:25 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@intel.com header.s=Intel header.b=I6Vf546K; spf=pass (domain: intel.com, ip: 192.55.52.136, mailfrom: anuj.mittal@intel.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1690388545; x=1721924545; h=from:to:subject:date:message-id:in-reply-to:references: mime-version:content-transfer-encoding; bh=E8tr38ov4hzLNE0e+1wOHtrA7VLo5g2OwBmJeFvpQUY=; b=I6Vf546KTOq/gQEPpB+267sr4IKNMf/ydVru7vhasXpCHU6uTDYNRuaW AT9d5Gx5gnXNqyA1ufrNYaRjjmr8gMrYQmAgk6+a8bHewbbWscgvcL7ux P0TRbRQ/LDfBpRhMugs85M6uY1WKGwsNQkpYQd2JYcV7LawWcHfO+jc1u llQzDMJHnF1CPuoylLug5vL55wv3kfHXBNnKZETN6OoFH+/V/sIgtaca/ FdsQjggVNcXqZWtTzBFizAny/9aPqou34j5nn+aogDe3Z0HF6RuMUiPmX 6MqM6ZZ1Z6+KTnWVMrlbwmS0jKZ/NEQ1gJmpa8VZSrsVkx+rrIoL9J+7w g==; X-IronPort-AV: E=McAfee;i="6600,9927,10783"; a="347676128" X-IronPort-AV: E=Sophos;i="6.01,232,1684825200"; d="scan'208";a="347676128" Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by fmsmga106.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jul 2023 09:22:25 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10783"; a="816745734" X-IronPort-AV: E=Sophos;i="6.01,232,1684825200"; d="scan'208";a="816745734" Received: from anmitta2-mobl3.gar.corp.intel.com (HELO anmitta2-mobl3.intel.com) ([10.215.151.246]) by fmsmga003-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jul 2023 09:22:24 -0700 From: Anuj Mittal To: openembedded-core@lists.openembedded.org Subject: [PATCH 2/4] selftest/cases/glibc.py: increase the memory for testing Date: Thu, 27 Jul 2023 00:22:07 +0800 Message-ID: <20230726162209.131855-3-anuj.mittal@intel.com> X-Mailer: git-send-email 2.41.0 In-Reply-To: <20230726162209.131855-1-anuj.mittal@intel.com> References: <20230726162209.131855-1-anuj.mittal@intel.com> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 26 Jul 2023 16:22:31 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/184893 Some of the tests trigger OOM and fail. Increase the amount of memory available so we dont run into these issues. Signed-off-by: Anuj Mittal --- meta/lib/oeqa/selftest/cases/glibc.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oeqa/selftest/cases/glibc.py b/meta/lib/oeqa/selftest/cases/glibc.py index 4ec4b85d67..c300aef913 100644 --- a/meta/lib/oeqa/selftest/cases/glibc.py +++ b/meta/lib/oeqa/selftest/cases/glibc.py @@ -65,7 +65,7 @@ class GlibcSelfTestBase(OESelftestTestCase, OEPTestResultTestCase): bitbake("core-image-minimal") # start runqemu - qemu = s.enter_context(runqemu("core-image-minimal", runqemuparams = "nographic")) + qemu = s.enter_context(runqemu("core-image-minimal", runqemuparams = "nographic", qemuparams = "-m 1024")) # validate that SSH is working status, _ = qemu.run("uname") From patchwork Wed Jul 26 16:22:08 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Mittal, Anuj" X-Patchwork-Id: 27954 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2FBF7C41513 for ; Wed, 26 Jul 2023 16:22:31 +0000 (UTC) Received: from mga12.intel.com (mga12.intel.com [192.55.52.136]) by mx.groups.io with SMTP id smtpd.web11.15664.1690388543744120259 for ; Wed, 26 Jul 2023 09:22:26 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@intel.com header.s=Intel header.b=CuHC4hOH; spf=pass (domain: intel.com, ip: 192.55.52.136, mailfrom: anuj.mittal@intel.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1690388546; x=1721924546; h=from:to:subject:date:message-id:in-reply-to:references: mime-version:content-transfer-encoding; bh=K76+N09KfTlyVRZGXiZsqGC8faGZr/RZjqzJhegOYYg=; b=CuHC4hOH11ETmMjbofzoOQ1JGOEYpDhmkZNYyHy/LNpSCgyWk0RaL1Fd FvhKUyHppOCK3Wtsz8Nje9qQx8L21hEj65hVn9xgq3quR5FtWuACBtent m9wcKv4yptwOSjue+PqvLfbTmV+SCa/tIAupDKhUtlkyIrT/RKF1A6VfN kqJkHQmNmSDV8P58olmlIkr9vAJJ37HiYooUKDgyNbV8Sl0A+4716jBM2 H2ea0jlG0Q+bsY42O5fWWF7V92QksC/XNHsOR41jXKfFzVQ+g4Ee/bGHs geJ9TR4NRdSXon6Drk3QRq/p4NtAzidDBcsELV9BStwoJu//OwMI1pRxl g==; X-IronPort-AV: E=McAfee;i="6600,9927,10783"; a="347676139" X-IronPort-AV: E=Sophos;i="6.01,232,1684825200"; d="scan'208";a="347676139" Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by fmsmga106.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jul 2023 09:22:26 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10783"; a="816745740" X-IronPort-AV: E=Sophos;i="6.01,232,1684825200"; d="scan'208";a="816745740" Received: from anmitta2-mobl3.gar.corp.intel.com (HELO anmitta2-mobl3.intel.com) ([10.215.151.246]) by fmsmga003-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jul 2023 09:22:25 -0700 From: Anuj Mittal To: openembedded-core@lists.openembedded.org Subject: [PATCH 3/4] oeqa/utils/nfs: allow requesting non-udp ports Date: Thu, 27 Jul 2023 00:22:08 +0800 Message-ID: <20230726162209.131855-4-anuj.mittal@intel.com> X-Mailer: git-send-email 2.41.0 In-Reply-To: <20230726162209.131855-1-anuj.mittal@intel.com> References: <20230726162209.131855-1-anuj.mittal@intel.com> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 26 Jul 2023 16:22:31 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/184894 Allows setting up NFS over TCP as well. Signed-off-by: Anuj Mittal --- meta/lib/oeqa/utils/nfs.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/meta/lib/oeqa/utils/nfs.py b/meta/lib/oeqa/utils/nfs.py index b66ed42a58..903469bfee 100644 --- a/meta/lib/oeqa/utils/nfs.py +++ b/meta/lib/oeqa/utils/nfs.py @@ -12,7 +12,7 @@ from oeqa.utils.commands import bitbake, get_bb_var, Command from oeqa.utils.network import get_free_port @contextlib.contextmanager -def unfs_server(directory, logger = None): +def unfs_server(directory, logger = None, udp = True): unfs_sysroot = get_bb_var("RECIPE_SYSROOT_NATIVE", "unfs3-native") if not os.path.exists(os.path.join(unfs_sysroot, "usr", "bin", "unfsd")): # build native tool @@ -26,7 +26,7 @@ def unfs_server(directory, logger = None): exports.write("{0} (rw,no_root_squash,no_all_squash,insecure)\n".format(directory).encode()) # find some ports for the server - nfsport, mountport = get_free_port(udp = True), get_free_port(udp = True) + nfsport, mountport = get_free_port(udp), get_free_port(udp) nenv = dict(os.environ) nenv['PATH'] = "{0}/sbin:{0}/usr/sbin:{0}/usr/bin:".format(unfs_sysroot) + nenv.get('PATH', '') From patchwork Wed Jul 26 16:22:09 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Mittal, Anuj" X-Patchwork-Id: 27951 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2FBBEC0015E for ; Wed, 26 Jul 2023 16:22:31 +0000 (UTC) Received: from mga12.intel.com (mga12.intel.com [192.55.52.136]) by mx.groups.io with SMTP id smtpd.web11.15664.1690388543744120259 for ; Wed, 26 Jul 2023 09:22:27 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@intel.com header.s=Intel header.b=nlEf1+eV; spf=pass (domain: intel.com, ip: 192.55.52.136, mailfrom: anuj.mittal@intel.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1690388547; x=1721924547; h=from:to:subject:date:message-id:in-reply-to:references: mime-version:content-transfer-encoding; bh=L7iCDKh1NMoOE0vC0zhF0rFuFdljNvS+YGH2hDLYfME=; b=nlEf1+eVIx+ppTt0YdYT7cPxguohQFwtdbc8Mliuht+0v19qObAxeSKA gZeQ8BkcQNeOqCZnAnjXCd6uQ6M328j0w4AXRI8SSKkCCIKyeRIexomgS Khax/QEFb5i+pshShSsUJD/SFIH/MGRDEbKrI6ufQxQbu57poXHnYqxA8 TWa4aaUn5Yf9jERQy/ATP0mm0mVZy48ygw5zhX3+EBKAxLH0K/W5f7uXI wF7j/HPy6HZwFUMxFiVdEzx2PUGNyBlAKAJnDxjZHucFxPuDs1IYHWzGg eNfJkFa57NMZi6zYoGgpmlf/y6RutTriH6isc7qsjaehg2d0ItIOe7Vdj Q==; X-IronPort-AV: E=McAfee;i="6600,9927,10783"; a="347676157" X-IronPort-AV: E=Sophos;i="6.01,232,1684825200"; d="scan'208";a="347676157" Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by fmsmga106.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jul 2023 09:22:27 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10783"; a="816745743" X-IronPort-AV: E=Sophos;i="6.01,232,1684825200"; d="scan'208";a="816745743" Received: from anmitta2-mobl3.gar.corp.intel.com (HELO anmitta2-mobl3.intel.com) ([10.215.151.246]) by fmsmga003-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jul 2023 09:22:26 -0700 From: Anuj Mittal To: openembedded-core@lists.openembedded.org Subject: [PATCH 4/4] selftest/cases/glibc.py: switch to using NFS over TCP Date: Thu, 27 Jul 2023 00:22:09 +0800 Message-ID: <20230726162209.131855-5-anuj.mittal@intel.com> X-Mailer: git-send-email 2.41.0 In-Reply-To: <20230726162209.131855-1-anuj.mittal@intel.com> References: <20230726162209.131855-1-anuj.mittal@intel.com> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 26 Jul 2023 16:22:31 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/184895 This provides a more reliable test execution when running tests that write a large buffer/file and significantly reduces the localedata test failures. Signed-off-by: Anuj Mittal --- meta/lib/oeqa/selftest/cases/glibc.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/meta/lib/oeqa/selftest/cases/glibc.py b/meta/lib/oeqa/selftest/cases/glibc.py index c300aef913..924df6c5a6 100644 --- a/meta/lib/oeqa/selftest/cases/glibc.py +++ b/meta/lib/oeqa/selftest/cases/glibc.py @@ -45,7 +45,7 @@ class GlibcSelfTestBase(OESelftestTestCase, OEPTestResultTestCase): with contextlib.ExitStack() as s: # use the base work dir, as the nfs mount, since the recipe directory may not exist tmpdir = get_bb_var("BASE_WORKDIR") - nfsport, mountport = s.enter_context(unfs_server(tmpdir)) + nfsport, mountport = s.enter_context(unfs_server(tmpdir, udp = False)) # build core-image-minimal with required packages default_installed_packages = [ @@ -74,7 +74,7 @@ class GlibcSelfTestBase(OESelftestTestCase, OEPTestResultTestCase): # setup nfs mount if qemu.run("mkdir -p \"{0}\"".format(tmpdir))[0] != 0: raise Exception("Failed to setup NFS mount directory on target") - mountcmd = "mount -o noac,nfsvers=3,port={0},udp,mountport={1} \"{2}:{3}\" \"{3}\"".format(nfsport, mountport, qemu.server_ip, tmpdir) + mountcmd = "mount -o noac,nfsvers=3,port={0},mountport={1} \"{2}:{3}\" \"{3}\"".format(nfsport, mountport, qemu.server_ip, tmpdir) status, output = qemu.run(mountcmd) if status != 0: raise Exception("Failed to setup NFS mount on target ({})".format(repr(output)))