From patchwork Sun Apr 2 22:29:33 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 22112 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 07612C76196 for ; Sun, 2 Apr 2023 22:30:01 +0000 (UTC) Received: from mail-pj1-f49.google.com (mail-pj1-f49.google.com [209.85.216.49]) by mx.groups.io with SMTP id smtpd.web10.56516.1680474598942557401 for ; Sun, 02 Apr 2023 15:29:59 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=MNRri8O5; spf=pass (domain: gmail.com, ip: 209.85.216.49, mailfrom: ticotimo@gmail.com) Received: by mail-pj1-f49.google.com with SMTP id f6-20020a17090ac28600b0023b9bf9eb63so28631185pjt.5 for ; Sun, 02 Apr 2023 15:29:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680474598; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=C1Di7NEm4GZJyoy8lcAI9tVaB+M+mxS5IYCwNwyMNBs=; b=MNRri8O5pPkA/juWQjbtvot/xeRAS0XGTqIhWIHiVmO5SY2qehT8KcuuaYvwmeQV9A 3rCdzqCbmUpeTaq11vhvQC6XsxnHkBJtQZGHkDQivH1m8DakeSMVSxN6C//JFEvx0wVg wTm8+qsTyS7IBKcj+xz6eQG011+NED4MGXjmW+mW8QbBay7xQxcAvUYb3VaHSnYFc5xO 1OohIvVkYJ82sFjyZjvOmkBJtWncZCKuvvFAqTo1T+NRHLIr9anQc+ptR/66uE8Lz3h0 wVcCcX+wLkTkYy2U8JtfCOydKeRqc6JxXAiPFKv8wnvS3cZ79GDVluJnk+owwOeuutNj ERtg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680474598; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=C1Di7NEm4GZJyoy8lcAI9tVaB+M+mxS5IYCwNwyMNBs=; b=WBFKeGFTS8x4Hia+UGHyCTIOrnrvBMxTW1T6eiZtgXxkYpjvzapQGd/z0yWAbdLurk KlrTsnnCFBk0ZnhGye1A5RbH6NXkzTUuA75kDd3UwyjpcW65AczzGRiTqTuVpb9SoxFZ ws5w5D1v1hX7YFCWT8m6HjRgDa5DSJKBYI+ZxTCvzHxvqBH5wXNJIny5IUnbGV/BSgs5 q3gbKmykaGVGNax22VCqL/txQO7g46a2NcSCW/xF4CGTGnHb+kGN1gcjt1oqPQ1EXUdH NBHNYJY2NLTxPsCUinpFMyKKRLHGj6LG/WQ2nYIXp/HykhpIDo6QUoPTxICbkypKqFwR S+pQ== X-Gm-Message-State: AO0yUKVpKk9VHVxPJmZqw3PnIhJoJYbqMk+XzrPJ3TL3HDyJwkmZ2DJ0 59UjmD9Bul70VFX7nXPB2tFYyqG7pbw= X-Google-Smtp-Source: AK7set8o9IDEmaAUsldz3IXWHo7KOQGqzLuvnCSR+082oNpgSAKVCOo6u37PlUjtGP9B4spMRYVDNw== X-Received: by 2002:a05:6a20:6a8f:b0:d9:adc3:6a6e with SMTP id bi15-20020a056a206a8f00b000d9adc36a6emr26069139pzb.56.1680474598049; Sun, 02 Apr 2023 15:29:58 -0700 (PDT) Received: from chiron.. ([2601:1c0:ca00:cea0:c5a7:cc15:fd65:db07]) by smtp.gmail.com with ESMTPSA id x47-20020a056a000bef00b0062cc53e5db9sm5404357pfu.197.2023.04.02.15.29.57 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 02 Apr 2023 15:29:57 -0700 (PDT) From: Tim Orling X-Google-Original-From: Tim Orling To: openembedded-devel@lists.openembedded.org Subject: [meta-oe][PATCH 01/11] cli11: do not inherit ptest Date: Sun, 2 Apr 2023 15:29:33 -0700 Message-Id: <6398e3aa0ee8033489c2e86752d7cda5693d3e2f.1680473253.git.tim.orling@konsulko.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sun, 02 Apr 2023 22:30:01 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-devel/message/101879 This recipe provides no run-ptest script. Signed-off-by: Tim Orling --- meta-oe/recipes-support/cli11/cli11_2.3.2.bb | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/meta-oe/recipes-support/cli11/cli11_2.3.2.bb b/meta-oe/recipes-support/cli11/cli11_2.3.2.bb index b9ff914da..7c6b2547c 100644 --- a/meta-oe/recipes-support/cli11/cli11_2.3.2.bb +++ b/meta-oe/recipes-support/cli11/cli11_2.3.2.bb @@ -15,11 +15,10 @@ S = "${WORKDIR}/git" do_configure:prepend() { mkdir -p ${S}/tests/catch2 - cp ${DL_DIR}/catch.hpp ${S}/tests/catch2/catch.hpp + cp ${DL_DIR}/catch.hpp ${S}/tests/catch2/catch.hpp } inherit cmake -inherit ptest # cli11 is a header only C++ library, so the main package will be empty. RDEPENDS:${PN}-dev = "" From patchwork Sun Apr 2 22:29:34 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 22115 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id DBC62C76196 for ; Sun, 2 Apr 2023 22:30:10 +0000 (UTC) Received: from mail-pg1-f181.google.com (mail-pg1-f181.google.com [209.85.215.181]) by mx.groups.io with SMTP id smtpd.web11.56494.1680474601046998486 for ; Sun, 02 Apr 2023 15:30:01 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=Yz5LoFnp; spf=pass (domain: gmail.com, ip: 209.85.215.181, mailfrom: ticotimo@gmail.com) Received: by mail-pg1-f181.google.com with SMTP id d22so16389182pgw.2 for ; Sun, 02 Apr 2023 15:30:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680474600; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=5rGfd6Z5zhiiTfeHMj/4lRjQ5mQhS9Y+lGiSWnkA680=; b=Yz5LoFnpWnRZwq5QytkkYC7S9gYumMCNdcmLenRUqpdi2McZzZuMX74Q2DYjfL7I92 kGH+VRwhNAFjbhkTXu1W2ZD244eabhxKCxZjzQBQxF7Ee7gQXvlnCsK0hWzJdro5lHqD r5anTcS4dTvhqPau72qo9h2YUUQY+s1Cs6dMpCOFXRpwFETieQ+sVICGE4hHcE/GU+L4 +hregqucHg1kz4hKe5y3V0kz+LxMn9HBEGBMFxmG8k/P9J0fUHSmk51hGfCUNUVYZQPH LS36c/nWCPtHbP1lawxVPI62LEnT66Jlkv5IWqSsvR0kWANDschrpYmQ1KhfISTDVYif 0v+Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680474600; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=5rGfd6Z5zhiiTfeHMj/4lRjQ5mQhS9Y+lGiSWnkA680=; b=oukmdNqaYlfkeQVitFdQMBDNM2aAoPYQNPCuxNB/FmZO38FaNqNrCNHOdNhuP9Nc1R 87gAi2INq+UuPm/cZaxvceL8SXtqja8OVShZsaPuFrMGWaL0spyjklhzRUuVUHgmHnoN z+PSVAA0C0RUPsNbLfrbWsDYugp9M2kwIpz6not8LCjD86Ru2H6nlZ/igcqjDESwOjoU sL82KbXtkR8IUEhZpnK4WNjV1hQemzI+TOapFoJJJff8l7V67yZRh0fs1razm7RFb9Aw Qne2DaS7NvTXdN9AKTFCBnLA9PTNHW+WEyThQ3KbHlvQbfYKwt3Mv/31fG+iQBI89rAS Tjhg== X-Gm-Message-State: AAQBX9ftPlp/812qKF1BGysZlowCSaOttPp8qja+9Z+usY3UJHG52p/8 DS9pcNAF11Yn/me4gE62+Pm7IL7oPI8= X-Google-Smtp-Source: AKy350Z14P+hleTn0lqEEGCnxX6I9CpmjbytWFhP9LS+IDTatzUDMB38AFD8aCqSVnL4DR1xCyrbNg== X-Received: by 2002:a62:1711:0:b0:62d:dad9:3d74 with SMTP id 17-20020a621711000000b0062ddad93d74mr11301304pfx.23.1680474599936; Sun, 02 Apr 2023 15:29:59 -0700 (PDT) Received: from chiron.. ([2601:1c0:ca00:cea0:c5a7:cc15:fd65:db07]) by smtp.gmail.com with ESMTPSA id x47-20020a056a000bef00b0062cc53e5db9sm5404357pfu.197.2023.04.02.15.29.59 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 02 Apr 2023 15:29:59 -0700 (PDT) From: Tim Orling X-Google-Original-From: Tim Orling To: openembedded-devel@lists.openembedded.org Subject: [meta-oe][PATCH 02/11] span-lite: do not inherit ptest Date: Sun, 2 Apr 2023 15:29:34 -0700 Message-Id: <7013d64531ae0214cabe338c5b37c05ba158198c.1680473253.git.tim.orling@konsulko.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sun, 02 Apr 2023 22:30:10 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-devel/message/101880 This recipe provides no run-ptest script. Signed-off-by: Tim Orling --- meta-oe/recipes-support/span-lite/span-lite_0.10.3.bb | 1 - 1 file changed, 1 deletion(-) diff --git a/meta-oe/recipes-support/span-lite/span-lite_0.10.3.bb b/meta-oe/recipes-support/span-lite/span-lite_0.10.3.bb index 0d9a8c93d..15380f5d7 100644 --- a/meta-oe/recipes-support/span-lite/span-lite_0.10.3.bb +++ b/meta-oe/recipes-support/span-lite/span-lite_0.10.3.bb @@ -9,4 +9,3 @@ SRCREV = "cbb9c3c5162a0d7018c7b3e053153a04d4fbbbb9" S = "${WORKDIR}/git" inherit cmake -inherit ptest From patchwork Sun Apr 2 22:29:35 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 22119 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 040E2C77B6F for ; Sun, 2 Apr 2023 22:30:11 +0000 (UTC) Received: from mail-pj1-f45.google.com (mail-pj1-f45.google.com [209.85.216.45]) by mx.groups.io with SMTP id smtpd.web11.56496.1680474602539675573 for ; Sun, 02 Apr 2023 15:30:02 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=DEENpRtZ; spf=pass (domain: gmail.com, ip: 209.85.216.45, mailfrom: ticotimo@gmail.com) Received: by mail-pj1-f45.google.com with SMTP id mp3-20020a17090b190300b0023fcc8ce113so30657453pjb.4 for ; Sun, 02 Apr 2023 15:30:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680474602; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=X97xLhF+qn+IAMS1TLqk6kcj1O9tfBFP6VRsjycj7Gg=; b=DEENpRtZAY3M9OT5mq8SAaRSjyPh74QWSQHMf0mMdb/S5W9VGhslqoQyEv1oKdU3fl ymFXdu1ZwHFd0rblNEDmeZqgqu9NCM2NA9Vste3WN61WQPPg+lDfumQc1avGO207fucw D29L1qSlzTY81lnZsNXPdzREFjGEDUhmFp+2szKF5Y2+hpg2eFRO2piEa/i/0oAHBcdU Ikovb1qYm7w3U5MjX9ulLv/JuRL68mdZ2q1NGFsd4AUQIqCfFOkdfrbn0eRflaSNc1Au uiXS8K3k8Ic9ljeDcEjm5uacVdMynY3n9Fm0EzJ4DrvbhBlnx2YdCoYnGCs9pfxl48f2 bi2Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680474602; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=X97xLhF+qn+IAMS1TLqk6kcj1O9tfBFP6VRsjycj7Gg=; b=BuWKB1XjwJiAo7PM/IPKxa6ABRONW+gx2nXAoLYI5NdAPC9JaNibG6VhP67rrXtmOE qEU31pIvcHH7A858K0UUb8vzb1pUaEht7aKHpF6WPuXGLbWmqsjjfY9z3IdlMQPP1iME d0ODFOYrZZ5pcXgNMe6wqrvTMspXkrAxA0hgTqlkEE6uQKtZCGBRlhhQP9V1FnvaDrYU u1iKBue3CQIlvU2KJMkKMqJn2qnfGE5kkLSLm0ezS6GOJxZjQTu87MgIHjrRrt3AlBcf MhYW7xoB2yi3N4TKgpEqL5ZSNTZcDzTRKqfJW/P0mR+4LL34EVWFyGeOt/MDbzY66OnU hUrQ== X-Gm-Message-State: AO0yUKXvUwojG3nwuAzlVnK6X6GrOXoRsoZcDUnKvt3j1cSUuEufaimh gDyg4pSOlJqZyeqRfdgHuUQ7tAFraCg= X-Google-Smtp-Source: AK7set/3gNfQdllhsJT0qDlbz0e7fcYa6W9oOuLYyBcrW1Bvt6WiYJRC4NJTiLR5TGcswc7Okq+evQ== X-Received: by 2002:a05:6a20:1222:b0:db:a03c:713d with SMTP id v34-20020a056a20122200b000dba03c713dmr26701786pzf.23.1680474601644; Sun, 02 Apr 2023 15:30:01 -0700 (PDT) Received: from chiron.. ([2601:1c0:ca00:cea0:c5a7:cc15:fd65:db07]) by smtp.gmail.com with ESMTPSA id x47-20020a056a000bef00b0062cc53e5db9sm5404357pfu.197.2023.04.02.15.30.01 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 02 Apr 2023 15:30:01 -0700 (PDT) From: Tim Orling X-Google-Original-From: Tim Orling To: openembedded-devel@lists.openembedded.org Subject: [meta-oe][PATCH 03/11] ptest-packagelists-meta-oe.inc: add ptest recipes Date: Sun, 2 Apr 2023 15:29:35 -0700 Message-Id: <29fe2ef9bbbaba0ef0424da5aa04d48572de6141.1680473253.git.tim.orling@konsulko.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sun, 02 Apr 2023 22:30:11 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-devel/message/101881 Similar to ptest-packagelists.inc in oe-core, this list enables per image ptest (isolated ptests for a given recipe) * Add recipes to PTEST_FAST_META_OE for ptests which take less than ~30s * Add recipes to PTEST_SLOW_META_OE for ptests which take longer * Add recipes to PTEST_PROBLEMS_META_OE for ptests which have failing tests or other issues with ptest package The initial list was taken from: meta_oe_ptest_recipes=$(bitbake-layers show-recipes --recipes-only \ --layer meta-oe --inherits ptest --bare | tr '\n' ' ' | \ pcregrep -o1 '^NOTE:.+===(.+)$') Signed-off-by: Tim Orling --- .../include/ptest-packagelists-meta-oe.inc | 60 +++++++++++++++++++ 1 file changed, 60 insertions(+) create mode 100644 meta-oe/conf/include/ptest-packagelists-meta-oe.inc diff --git a/meta-oe/conf/include/ptest-packagelists-meta-oe.inc b/meta-oe/conf/include/ptest-packagelists-meta-oe.inc new file mode 100644 index 000000000..e8898ce78 --- /dev/null +++ b/meta-oe/conf/include/ptest-packagelists-meta-oe.inc @@ -0,0 +1,60 @@ +# +# Lists of the ptest in meta-oe, sorted into two sets by the time they take +# Please keep these sorted in alphabetical order +# +# A first pass at getting all meta-oe recipes which inherit ptest +# meta_oe_ptest_recipes=$(bitbake-layers show-recipes --recipes-only --layer meta-oe --inherits ptest --bare | tr '\n' ' ' | pcregrep -o1 '^NOTE:.+===(.+)$') +# +# ptests which take less than ~30s each +PTESTS_FAST_META_OE = "\ + cmocka \ + cunit \ + duktape \ + fmt \ + function2 \ + fwupd \ + gcab \ + jq \ + leveldb \ + libcereal \ + libee \ + libio-pty-perl \ + libmanette \ + libssh \ + libxml++-5.0 \ + libxmlb \ + libyang \ + lmdb \ + minicoredumper \ + neon \ + nodejs \ + onig \ + poco \ + protobuf \ + sdbus-c++ \ + uthash \ + xmlsec1 \ + zeromq \ +" + +PTESTS_SLOW_META_OE = "\ + fftw \ + libusb-compat \ + rsyslog \ +" + +PTESTS_PROBLEMS_META_OE ="\ + jemalloc \ + kernel-selftest \ + keyutils \ + libdbi-perl \ + libgpiod \ + libjcat \ + libteam \ + libxml++ \ + mcelog \ + oprofile \ + ostree \ + psqlodbc \ + pv \ +" From patchwork Sun Apr 2 22:29:36 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 22120 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id EC70DC77B6C for ; Sun, 2 Apr 2023 22:30:10 +0000 (UTC) Received: from mail-pl1-f171.google.com (mail-pl1-f171.google.com [209.85.214.171]) by mx.groups.io with SMTP id smtpd.web10.56520.1680474604260122003 for ; Sun, 02 Apr 2023 15:30:04 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=RsHqTDup; spf=pass (domain: gmail.com, ip: 209.85.214.171, mailfrom: ticotimo@gmail.com) Received: by mail-pl1-f171.google.com with SMTP id ix20so26296473plb.3 for ; Sun, 02 Apr 2023 15:30:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680474603; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=dM+tYoUx+0nHNF2/f8c/i2VjvlktDTFLkWugm95yHO8=; b=RsHqTDup9TF4SPRDD/cXcdumGYw7Dd4m7TuWfTvSCXHNRYDgFfvmMeYIGLBr7dTvap DXltHKDV9iiw2TVyn6/YTjHpLfXxtQ6YKu+ojV5QuvDv87E4GfE+KKJfH6XzvWZTavMZ NGX6jop7/6lZWsmYi7aPnx4+O/zSkIvq/95xw+GRCeeCP5T4y95fZhgHVfF2LGVi7wtl fazH3XfUu54pq/8SFl7U8QEKf9OwgYsTt05JT/FG6KIZdU9GVtLvsraznuF6XPbTqkl8 4aX4gd+rFMz9Hpml7p7OKc7RXeK4EoUQGwQMZz+jEF9ABdJSsxK/fE8sfrzeNl3MI/G7 oG5g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680474603; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=dM+tYoUx+0nHNF2/f8c/i2VjvlktDTFLkWugm95yHO8=; b=CVQOvssiVWXyugU9NBLpwGOpLTEXYubSMtodNyPQrEBnIQZET+Whp7T7SgQ5I54voV h76kFlpJ2NluPjFhY2cwbtCcOiJG9aVByPYy9d7TcgNtsWDlppbh6GqjA1dDCP2Ur06i LLwU1s0sEhJ9fAPvh9inUlcaDMH9ByQ/vSL0E+u/f68c4QQb3ATBtas27I7xzHJZtK3f a0EHaQWTQC9pJQAIIim9Chqry4IVkR1RgiMzk6yIfdy7ma4oeVUW9zx0gBDrppC9t8L8 PcIOmAGZEWw0U2u9NssKrZcRXo1Fdm5Dw3SHbiYuwjdkeIyuqAwGufVI6Q3/f/gBVFS7 PCsA== X-Gm-Message-State: AO0yUKVL1H7mXbxqzVra1T8BRw4lXAC80Ohm0kjThY55vW/ialtXZiJD Du2wwAZPNkv/Vs14I0/rWSeFNHbw97k= X-Google-Smtp-Source: AK7set+29Ze00xg+HxueMBtsRl5JBiZS+IknKSMTqW0Z0jsXRGi5q0LQOYz89QPdUiEAbMDOxbz+og== X-Received: by 2002:a05:6a20:4891:b0:d9:cde:d2a9 with SMTP id fo17-20020a056a20489100b000d90cded2a9mr28886473pzb.20.1680474603213; Sun, 02 Apr 2023 15:30:03 -0700 (PDT) Received: from chiron.. ([2601:1c0:ca00:cea0:c5a7:cc15:fd65:db07]) by smtp.gmail.com with ESMTPSA id x47-20020a056a000bef00b0062cc53e5db9sm5404357pfu.197.2023.04.02.15.30.02 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 02 Apr 2023 15:30:02 -0700 (PDT) From: Tim Orling X-Google-Original-From: Tim Orling To: openembedded-devel@lists.openembedded.org Subject: [meta-oe][PATCH 04/11] meta-oe-ptest*-image: enable BBCLASSEXTEND parallel execution Date: Sun, 2 Apr 2023 15:29:36 -0700 Message-Id: <040cff75f5cc2f926c6ab489c0a4b1776ce7d17d.1680473253.git.tim.orling@konsulko.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sun, 02 Apr 2023 22:30:10 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-devel/message/101882 Similar to "core-image-ptest: Switch to BBCLASSEXTEND parallel execution" Refactor meta-oe-ptest-image.bb for an image per ptest in the form of meta-oe-ptest-image-XXX using class extensions. * Add meta-oe-ptest-all-image.bb depends on ALL meta-oe-ptest-image-XXX in meta-oe * Add meta-oe-ptest-fast-image.bb depends on meta-oe ptests which take less than ~30s This allows parallel execution of the tests. The downside to this approach is the parsing time of an image generating this number of class extensions is slow but making it easier to execute and collect test data should outweigh that. A useful advantage is that the dependencies of each ptest package are checked/tested individually. Add to local.conf: IMAGE_CLASSES += "testimage" All the meta-oe-ptest-image-XXX can be built with: $ bitbake meta-oe-ptest-all-image Subsequently, all the ptest images can be run with: $ bitbake -c testimage meta-oe-ptest-all-image You will likely want to limit the number of parallel image tests: BB_NUMBER_THREADS = "4" based on the number of TAP devices you have defined or the number of simultaneous QEMU sessions your server can support. Results can be summarized with: $ resulttool report tmp/log/oeqa/testresult.json Signed-off-by: Tim Orling --- .../images/meta-oe-ptest-all-image.bb | 25 ++++++++++++ .../images/meta-oe-ptest-fast-image.bb | 6 +++ .../images/meta-oe-ptest-image.bb | 38 ++++++++++++++++++- 3 files changed, 68 insertions(+), 1 deletion(-) create mode 100644 meta-oe/recipes-core/images/meta-oe-ptest-all-image.bb create mode 100644 meta-oe/recipes-core/images/meta-oe-ptest-fast-image.bb diff --git a/meta-oe/recipes-core/images/meta-oe-ptest-all-image.bb b/meta-oe/recipes-core/images/meta-oe-ptest-all-image.bb new file mode 100644 index 000000000..0ea03dd2e --- /dev/null +++ b/meta-oe/recipes-core/images/meta-oe-ptest-all-image.bb @@ -0,0 +1,25 @@ +DESCRIPTION = "Recipe to trigger execution of all meta-oe ptest images." +HOMEPAGE = "https://www.openembedded.org/" + +LICENSE = "MIT" + +inherit features_check nopackages +REQUIRED_DISTRO_FEATURES = "ptest" + +require conf/include/ptest-packagelists-meta-oe.inc + +# Include the full set of ptests +PTESTS_META_OE = "${PTESTS_FAST_META_OE} ${PTESTS_SLOW_META_OE}" + +do_testimage[noexec] = "1" +do_testimage[depends] = "${@' '.join(['meta-oe-ptest-image-'+x+':do_testimage' for x in d.getVar('PTESTS_META_OE').split()])}" + +do_build[depends] = "${@' '.join(['meta-oe-ptest-image-'+x+':do_build' for x in d.getVar('PTESTS_META_OE').split()])}" + +# normally image.bbclass would do this +EXCLUDE_FROM_WORLD = "1" + +python () { + if bb.utils.contains('IMAGE_CLASSES', 'testimage', True, False, d): + bb.build.addtask("do_testimage", "", "", d) +} diff --git a/meta-oe/recipes-core/images/meta-oe-ptest-fast-image.bb b/meta-oe/recipes-core/images/meta-oe-ptest-fast-image.bb new file mode 100644 index 000000000..f56e841ff --- /dev/null +++ b/meta-oe/recipes-core/images/meta-oe-ptest-fast-image.bb @@ -0,0 +1,6 @@ +require meta-oe-ptest-all-image.bb + +DESCRIPTION = "Recipe to trigger execution of all fast meta-oe ptest images." + +PTESTS_META_OE = "${PTESTS_FAST_META_OE}" + diff --git a/meta-oe/recipes-core/images/meta-oe-ptest-image.bb b/meta-oe/recipes-core/images/meta-oe-ptest-image.bb index 0166b9c41..951d91f82 100644 --- a/meta-oe/recipes-core/images/meta-oe-ptest-image.bb +++ b/meta-oe/recipes-core/images/meta-oe-ptest-image.bb @@ -1,5 +1,41 @@ +inherit features_check +REQUIRED_DISTRO_FEATURES = "ptest" + +require conf/include/ptest-packagelists-meta-oe.inc + require meta-oe-image-base.bb SUMMARY = "meta-oe ptest test image" -IMAGE_INSTALL += "packagegroup-meta-oe" +DESCRIPTION += "Also including the ${MCNAME} ptest package." +HOMEPAGE = "https://www.openembedded.org/" + +PTESTS_META_OE = "${PTESTS_SLOW_META_OE} ${PTESTS_FAST_META_OE}" + +IMAGE_INSTALL:append = " ${MCNAME}-ptest openssh" + +BBCLASSEXTEND = "${@' '.join(['mcextend:'+x for x in d.getVar('PTESTS_META_OE').split()])}" + +# The image can be sufficiently large (~1.8GB) that we need to be careful that it fits in a live +# image (which has a 4GB limit), so nullify the overhead factor (1.3x out of the +# box) and explicitly add up to 1500MB. +IMAGE_OVERHEAD_FACTOR = "1.0" +IMAGE_ROOTFS_EXTRA_SPACE = "324288" +# If a particular ptest needs more space, it can be customized: +#IMAGE_ROOTFS_EXTRA_SPACE:virtclass-mcextend- = "1024288" + +# ptests need more memory than standard to avoid the OOM killer +QB_MEM = "-m 1024" +# If a particular ptest needs more memroy, it can be customized: +#QB_MEM:virtclass-mcextend- = "-m 4096" + +TEST_SUITES = "ping ssh parselogs ptest" + +# Sadly at the moment the full set of ptests is not robust enough and sporadically fails in random places +PTEST_EXPECT_FAILURE = "1" + +python () { + if not d.getVar("MCNAME"): + raise bb.parse.SkipRecipe("No class extension set") +} + From patchwork Sun Apr 2 22:29:37 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 22117 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id E9DB1C77B6E for ; Sun, 2 Apr 2023 22:30:10 +0000 (UTC) Received: from mail-pf1-f175.google.com (mail-pf1-f175.google.com [209.85.210.175]) by mx.groups.io with SMTP id smtpd.web11.56497.1680474605691217793 for ; Sun, 02 Apr 2023 15:30:05 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=fCWew9rX; spf=pass (domain: gmail.com, ip: 209.85.210.175, mailfrom: ticotimo@gmail.com) Received: by mail-pf1-f175.google.com with SMTP id dw14so17880907pfb.6 for ; Sun, 02 Apr 2023 15:30:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680474605; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=uVvNwtJVkY+MWUAPdA2UgR7zS3BQzEkvHyxHQsGFKQY=; b=fCWew9rXtTrTZ1cM0BYAa8HmAFhz6pDB0s1zgohxI0IOdMvpJjk/UhJcFDNmbdLvsQ 7G3x7Gu9VXmBxCtcV0PBcSLQaUDGaB17Rr80BjZmmM+wc4sTjDmvI4JOC5n93rq2h1rr U4NUzlnsCO0Nmi+xfoc+5uUtyJIXe3BKPoyim1G6cVGtY6NA9GAajkHp7l0nCCS/4seY RYcnLP5nS98Vbk4FaIkF2YiJn3rXao2jK0RzYrLDWA9tOkqPfRksQOjm43FHyFZsUZ0b cCpiwcuQjJ0N4xrQf8SB0PFIJPsdtHA4mNMu0ImUcKg1YCBLX4o1lnsnQksh56aoyXK+ /tdA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680474605; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=uVvNwtJVkY+MWUAPdA2UgR7zS3BQzEkvHyxHQsGFKQY=; b=gFwbDAOPDIzzDDe3SHXoCbYQ+LlsQo4EbgGu23S0dmE7JaK44nRP7tN5r2hCRQyvcs /TNhivKcf2XJjGUhQUmWIZSav2hzDuwM28y8glZso0ry67PnIdVHMONzdPLROAB5MNMM uFLveM2T77n6NHVcT7VoZVColU92Tdi+fsDVzXy7ug37pOAePW8xlkAVB/MRSih+C42D 4Ebim7K6HgXRIkXH3eMM68xgL8cRCBNycF710u8ZDmJnIt/y29azxizAYJuvNTpRvNYf Uq4vXT/ztYecFWAG/+5+rSbjB/y1eU3ut2PA1joiyarX1zwpHPmCnFfbHD1F/ER5K6Yh Rl2A== X-Gm-Message-State: AAQBX9fZaemV8o4hd0mwadryr5yqCbaQBtwx6W2jXVYWC/d88nM1yU4M 6Fb7fELyN7RkJEHLdUlbRWH515ND6CU= X-Google-Smtp-Source: AKy350Y3XiylclTj1QaaaPZbmCQidcwMob9yNDHM13T3NL+3lEZZZnM66EYYlos82iNomgpNPZim/w== X-Received: by 2002:aa7:9dc5:0:b0:5de:3c49:b06 with SMTP id g5-20020aa79dc5000000b005de3c490b06mr31017816pfq.3.1680474604806; Sun, 02 Apr 2023 15:30:04 -0700 (PDT) Received: from chiron.. ([2601:1c0:ca00:cea0:c5a7:cc15:fd65:db07]) by smtp.gmail.com with ESMTPSA id x47-20020a056a000bef00b0062cc53e5db9sm5404357pfu.197.2023.04.02.15.30.04 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 02 Apr 2023 15:30:04 -0700 (PDT) From: Tim Orling X-Google-Original-From: Tim Orling To: openembedded-devel@lists.openembedded.org Subject: [meta-python][PATCH 05/11] ptest-packagelists-meta-python.inc: add ptest recipes Date: Sun, 2 Apr 2023 15:29:37 -0700 Message-Id: <7b4562adb2d6756acadc64d06c87bbd763fb098c.1680473253.git.tim.orling@konsulko.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sun, 02 Apr 2023 22:30:10 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-devel/message/101883 Similar to ptest-packagelists.inc in oe-core, this list enables per image ptest (isolated ptests for a given recipe) * Add recipes to PTEST_FAST_META_PYTHON for ptests which take less than ~30s * Add recipes to PTEST_SLOW_META_PYTHON for ptests which take longer * Add recipes to PTEST_PROBLEMS_META_PYTHON for ptests which have failing tests or other issues with ptest package The initial list was taken from: meta_python_ptest_recipes=$(bitbake-layers show-recipes --recipes-only \ --layer meta-python --inherits ptest --bare | tr '\n' ' ' | \ pcregrep -o1 '^NOTE:.+===(.+)$') Signed-off-by: Tim Orling --- .../ptest-packagelists-meta-python.inc | 82 +++++++++++++++++++ 1 file changed, 82 insertions(+) create mode 100644 meta-python/conf/include/ptest-packagelists-meta-python.inc diff --git a/meta-python/conf/include/ptest-packagelists-meta-python.inc b/meta-python/conf/include/ptest-packagelists-meta-python.inc new file mode 100644 index 000000000..ef5d20bcd --- /dev/null +++ b/meta-python/conf/include/ptest-packagelists-meta-python.inc @@ -0,0 +1,82 @@ +# +# Lists of the ptest in meta-python, sorted into two sets by the time they take +# Please keep these sorted in alphabetical order +# +# A first pass at getting all meta-python recipes which inherit ptest +# meta_python_ptest_recipes=$(bitbake-layers show-recipes --recipes-only --layer meta-python --inherits ptest --bare | tr '\n' ' ' | pcregrep -o1 '^NOTE:.+===(.+)$') +# +# ptests which take less than ~30s each +PTESTS_FAST_META_PYTHON = "\ + python3-ansicolors \ + python3-asgiref \ + python3-aspectlib \ + python3-blinker \ + python3-cachetools \ + python3-cbor2 \ + python3-click \ + python3-dominate \ + python3-execnet \ + python3-geojson \ + python3-html2text \ + python3-inflection \ + python3-intervals \ + python3-ipy \ + python3-iso3166 \ + python3-parse-type \ + python3-polyline \ + python3-precise-runner \ + python3-prettytable \ + python3-ptyprocess \ + python3-pyasn1-modules \ + python3-pyroute2 \ + python3-pyserial \ + python3-pytoml \ + python3-requests-file \ + python3-requests-toolbelt \ + python3-semver \ + python3-serpent \ + python3-simpleeval \ + python3-smpplib \ + python3-soupsieve \ + python3-sqlparse \ + python3-u-msgpack-python \ + python3-unidiff \ + python3-uritemplate \ + python3-xmltodict \ + python3-xxhash \ +" + +PTESTS_SLOW_META_PYTHON = "\ + python3-lz4 \ +" + +PTESTS_PROBLEMS_META_PYTHON ="\ + python3-appdirs \ + python3-betamax \ + python3-dnspython \ + python3-fastjsonschema \ + python3-gpiod \ + python3-gunicorn \ + python3-inotify \ + python3-jdcal \ + python3-jsmin \ + python3-license-expression \ + python3-msgpack \ + python3-multidict \ + python3-ordered-set \ + python3-parse \ + python3-pillow \ + python3-pint \ + python3-py-cpuinfo \ + python3-pytest-lazy-fixture \ + python3-pyzmq \ + python3-scrypt \ + python3-service-identity \ + python3-trustme \ + python3-typeguard \ + python3-whoosh \ + python3-ujson \ + python3-xlrd \ + python3-yappi \ + python3-yarl \ +" From patchwork Sun Apr 2 22:29:38 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 22118 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id E8456C77B62 for ; Sun, 2 Apr 2023 22:30:10 +0000 (UTC) Received: from mail-pg1-f174.google.com (mail-pg1-f174.google.com [209.85.215.174]) by mx.groups.io with SMTP id smtpd.web11.56498.1680474607315358990 for ; Sun, 02 Apr 2023 15:30:07 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=OqsbD1OV; spf=pass (domain: gmail.com, ip: 209.85.215.174, mailfrom: ticotimo@gmail.com) Received: by mail-pg1-f174.google.com with SMTP id s72so595418pgs.9 for ; Sun, 02 Apr 2023 15:30:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680474606; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=ZC3BVYCoZoqB5WYkIECYy9FObVXDJvMc6g/3Hr0QNJw=; b=OqsbD1OVz9a6nrAbBJn9QdY8yuBSigybxUj1nDNrFsyLflTljHmlg+emMl9A6YlAlH ZTJEI4lCjw+F3ZlnrTslLSzJ6kwPlwNWid0gZLuHqXIM7OKL+d0vifPjxG+a/ncz4fcL H/78/C7gzaLlv/usqVPge/eqpSPcfKkK8qLBp8WKWv1aLC+up3XoXyWCzI6smQOSsvb5 9phCXOamU0Udmd9B6qQOUcnjScnZsHz+ycbMrMXaNcvm24e3lBwgVznYOa8qoWatNhM0 feLmmD7nEZ6ZXVGvwKgWj/XmkmQAeSnEw3e9Zf6DNuep4rQq3/+qsfAEm8HgWKVWPohf ihKQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680474606; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=ZC3BVYCoZoqB5WYkIECYy9FObVXDJvMc6g/3Hr0QNJw=; b=XwyDUojpCgyUqtkG1XFU1H9lMTgHqENnkfGpe6vdDaV6OTsw/oDVtMrWtQtBfdIIXP bBgIqbb5Qaz6m4H2Zw0npyqLkw5A6GAMvqUObBZxiEUe3q/Tj19ps7Y+7ZynbZv/7dVM IEMMpG9amGIuhAkY/gRjd86rIM37bs67ZFQj0ENgw4Mw5ulAcrdtsursxAeizMpuyQ6p FanEPEDR1UMzg6OmuUBGIWfdsd9Ek3rlU7JqYJECO4qYk0B7jGXhAcfheh7EJVV1WBgw TWzootn3143AURfBudgLvzu4EXXSMq52qZ38f65f1hIf9uTXDrEwA0vRWf+Mtzy+O+W2 fcYA== X-Gm-Message-State: AAQBX9ekZUbn5HFsvZ11VlK2oWy+P8eIQFE1B81UNyNLLRIr3LORL4nt xuiU8zHnIdIWRYyKxDXwtGq0u7vX5LU= X-Google-Smtp-Source: AKy350bQb8hj1iAVcQtV3pM/eTmdTrYXcTHpk9mWjlwYcHchdtsbhHXgMVCmGuSQx520CeGpqCtB1w== X-Received: by 2002:a62:3845:0:b0:594:26a7:cbd2 with SMTP id f66-20020a623845000000b0059426a7cbd2mr16645172pfa.8.1680474606327; Sun, 02 Apr 2023 15:30:06 -0700 (PDT) Received: from chiron.. ([2601:1c0:ca00:cea0:c5a7:cc15:fd65:db07]) by smtp.gmail.com with ESMTPSA id x47-20020a056a000bef00b0062cc53e5db9sm5404357pfu.197.2023.04.02.15.30.05 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 02 Apr 2023 15:30:06 -0700 (PDT) From: Tim Orling X-Google-Original-From: Tim Orling To: openembedded-devel@lists.openembedded.org Subject: [meta-python][PATCH 06/11] meta-python-ptest*-image: enable BBCLASSEXTEND parallel execution Date: Sun, 2 Apr 2023 15:29:38 -0700 Message-Id: X-Mailer: git-send-email 2.34.1 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sun, 02 Apr 2023 22:30:10 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-devel/message/101884 Similar to "core-image-ptest: Switch to BBCLASSEXTEND parallel execution" Refactor meta-python-ptest-image.bb for an image per ptest in the form of meta-python-ptest-image-XXX using class extensions. * Add meta-python-ptest-all-image.bb depends on ALL meta-python-ptest-image-XXX in meta-python * Add meta-python-ptest-fast-image.bb depends on meta-python ptests which take less than ~30s This allows parallel execution of the tests. The downside to this approach is the parsing time of an image generating this number of class extensions is slow but making it easier to execute and collect test data should outweigh that. A useful advantage is that the dependencies of each ptest package are checked/tested individually. Add to local.conf: IMAGE_CLASSES += "testimage" All the meta-python-ptest-image-XXX can be built with: $ bitbake meta-python-ptest-all-image Subsequently, all the ptest images can be run with: $ bitbake -c testimage meta-python-ptest-all-image You will likely want to limit the number of parallel image tests: BB_NUMBER_THREADS = "4" based on the number of TAP devices you have defined or the number of simultaneous QEMU sessions your server can support. Results can be summarized with: $ resulttool report tmp/log/oeqa/testresults.json Signed-off-by: Tim Orling --- .../images/meta-python-ptest-all-image.bb | 25 ++++++++++++ .../images/meta-python-ptest-fast-image.bb | 6 +++ .../images/meta-python-ptest-image.bb | 38 ++++++++++++++++++- 3 files changed, 68 insertions(+), 1 deletion(-) create mode 100644 meta-python/recipes-core/images/meta-python-ptest-all-image.bb create mode 100644 meta-python/recipes-core/images/meta-python-ptest-fast-image.bb diff --git a/meta-python/recipes-core/images/meta-python-ptest-all-image.bb b/meta-python/recipes-core/images/meta-python-ptest-all-image.bb new file mode 100644 index 000000000..fd4dc4248 --- /dev/null +++ b/meta-python/recipes-core/images/meta-python-ptest-all-image.bb @@ -0,0 +1,25 @@ +DESCRIPTION = "Recipe to trigger execution of all meta-python ptest images." +HOMEPAGE = "https://www.openembedded.org/" + +LICENSE = "MIT" + +inherit features_check nopackages +REQUIRED_DISTRO_FEATURES = "ptest" + +require conf/include/ptest-packagelists-meta-python.inc + +# Include the full set of ptests +PTESTS_META_PYTHON = "${PTESTS_FAST_META_PYTHON} ${PTESTS_SLOW_META_PYTHON}" + +do_testimage[noexec] = "1" +do_testimage[depends] = "${@' '.join(['meta-python-ptest-image-'+x+':do_testimage' for x in d.getVar('PTESTS_META_PYTHON').split()])}" + +do_build[depends] = "${@' '.join(['meta-python-ptest-image-'+x+':do_build' for x in d.getVar('PTESTS_META_PYTHON').split()])}" + +# normally image.bbclass would do this +EXCLUDE_FROM_WORLD = "1" + +python () { + if bb.utils.contains('IMAGE_CLASSES', 'testimage', True, False, d): + bb.build.addtask("do_testimage", "", "", d) +} diff --git a/meta-python/recipes-core/images/meta-python-ptest-fast-image.bb b/meta-python/recipes-core/images/meta-python-ptest-fast-image.bb new file mode 100644 index 000000000..4f93a1595 --- /dev/null +++ b/meta-python/recipes-core/images/meta-python-ptest-fast-image.bb @@ -0,0 +1,6 @@ +require meta-python-ptest-all-image.bb + +DESCRIPTION = "Recipe to trigger execution of all fast meta-python ptest images." + +PTESTS_META_PYTHON = "${PTESTS_FAST_META_PYTHON}" + diff --git a/meta-python/recipes-core/images/meta-python-ptest-image.bb b/meta-python/recipes-core/images/meta-python-ptest-image.bb index d497016d4..a649cbb94 100644 --- a/meta-python/recipes-core/images/meta-python-ptest-image.bb +++ b/meta-python/recipes-core/images/meta-python-ptest-image.bb @@ -1,5 +1,41 @@ +inherit features_check +REQUIRED_DISTRO_FEATURES = "ptest" + +require conf/include/ptest-packagelists-meta-python.inc + require meta-python-image-base.bb SUMMARY = "meta-python ptest test image" -IMAGE_INSTALL += "packagegroup-meta-python3-ptest" +DESCRIPTION += "Also including the ${MCNAME} ptest package." +HOMEPAGE = "https://www.openembedded.org/" + +PTESTS_META_PYTHON = "${PTESTS_SLOW_META_PYTHON} ${PTESTS_FAST_META_PYTHON}" + +IMAGE_INSTALL:append = " ${MCNAME}-ptest openssh" + +BBCLASSEXTEND = "${@' '.join(['mcextend:'+x for x in d.getVar('PTESTS_META_PYTHON').split()])}" + +# The image can be sufficiently large (~1.8GB) that we need to be careful that it fits in a live +# image (which has a 4GB limit), so nullify the overhead factor (1.3x out of the +# box) and explicitly add up to 1500MB. +IMAGE_OVERHEAD_FACTOR = "1.0" +IMAGE_ROOTFS_EXTRA_SPACE = "324288" +# If a particular ptest needs more space, it can be customized: +#IMAGE_ROOTFS_EXTRA_SPACE:virtclass-mcextend- = "1024288" + +# ptests need more memory than standard to avoid the OOM killer +QB_MEM = "-m 1024" +# If a particular ptest needs more memory, it can be customized: +#QB_MEM:virtclass-mcextend- = "-m 4096" + +TEST_SUITES = "ping ssh parselogs ptest" + +# Sadly at the moment the full set of ptests is not robust enough and sporadically fails in random places +PTEST_EXPECT_FAILURE = "1" + +python () { + if not d.getVar("MCNAME"): + raise bb.parse.SkipRecipe("No class extension set") +} + From patchwork Sun Apr 2 22:29:39 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 22116 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id DA65FC7619A for ; Sun, 2 Apr 2023 22:30:10 +0000 (UTC) Received: from mail-pl1-f169.google.com (mail-pl1-f169.google.com [209.85.214.169]) by mx.groups.io with SMTP id smtpd.web11.56500.1680474608937530557 for ; Sun, 02 Apr 2023 15:30:09 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=bYCnCNTd; spf=pass (domain: gmail.com, ip: 209.85.214.169, mailfrom: ticotimo@gmail.com) Received: by mail-pl1-f169.google.com with SMTP id u10so26274732plz.7 for ; Sun, 02 Apr 2023 15:30:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680474608; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=uGP1/QIoou6A5NHdBvcpU2teH4LQ/zmHwO6R1QGKpBM=; b=bYCnCNTdJzFz7LWvraAu7D6ekeTRGT9YoDHJNVL47A6Db1MMB0K5NNsRJrTl9dU6nk xMFFFl4t+TaA/1wGYqZD5W82HRyOx0ei/08VMfnqm4zQ1Uazyj7wk0/O6vMYJGUSZxyA IYSqdCS+ESfMreNYq6/xcuk1smlmDo4kQvdt4bxd27ieVnuLFBX1qVuPnFC0U1cVTRv1 +knSvXlQieQSHfZIOKGAqsA9QczkcosUojM4eh+hDb01J2gcVMszRmA7QWRTYTKrSHfV wYW1POF6DMad9rydB1MYfvOrljg4rpv1uGTJQ76qLcx/X1OYjHsh3GOYeWqxyNX7/Ubc a6ng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680474608; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=uGP1/QIoou6A5NHdBvcpU2teH4LQ/zmHwO6R1QGKpBM=; b=GDaTuTd+vBNZqwfqnrxeDZEh3M2v6As5DS7RPRTH0BqxSfPPsNQ3KuMAUjxZmjK+rA V3/pOPHD25Tfzf8ieoFyKyxEzQ0SFfdvWxXRvzSd976kWblX+SJzz1iBeOErE1zBFWgG 1yLcwrIW7wmNJ3ZOxU/9VZbg3iV6DeMLWDbYDOrd6ehew4xKRA96RgGemrVJcTzu7eMq KSd98c4quw5dKhrnBMF7a2Zo9PwDsGlkXQRwudDvLeE47Io87z8qQ0f03GnjVX6noZB1 8rnjh2VXKGIdS7vFnK/WE+2FzrAFesM9khoKdIRloGSVBN121MYwA9PJd25Rimvh0HS2 6L8Q== X-Gm-Message-State: AO0yUKX9y05s0xoOPA2Xe9uHtM83qpAU1HzS3JHrnyqaozhB+3sRXdrX nlpY48v21srdlLNpTAZ9E+g1Fie8bhI= X-Google-Smtp-Source: AK7set+Bm2YUDFm1GORx3YB36Zgh8CqZR2s+w3aUl8+UcU83/ytiYjSIjtdgbbrrGHgoBsszUD7Uqg== X-Received: by 2002:a05:6a20:4f24:b0:d6:a0a1:6c6c with SMTP id gi36-20020a056a204f2400b000d6a0a16c6cmr24537312pzb.8.1680474608015; Sun, 02 Apr 2023 15:30:08 -0700 (PDT) Received: from chiron.. ([2601:1c0:ca00:cea0:c5a7:cc15:fd65:db07]) by smtp.gmail.com with ESMTPSA id x47-20020a056a000bef00b0062cc53e5db9sm5404357pfu.197.2023.04.02.15.30.07 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 02 Apr 2023 15:30:07 -0700 (PDT) From: Tim Orling X-Google-Original-From: Tim Orling To: openembedded-devel@lists.openembedded.org Subject: [meta-python][PATCH 07/11] python3-aspectlib: fix ptest Date: Sun, 2 Apr 2023 15:29:39 -0700 Message-Id: X-Mailer: git-send-email 2.34.1 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sun, 02 Apr 2023 22:30:10 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-devel/message/101885 * ptest RDEPENDS on pytest * Use python3-unittest-automake-output instead of using sed to reformat the output use this new module. Signed-off-by: Tim Orling --- .../recipes-devtools/python/python3-aspectlib/run-ptest | 2 +- .../recipes-devtools/python/python3-aspectlib_2.0.0.bb | 4 +++- 2 files changed, 4 insertions(+), 2 deletions(-) diff --git a/meta-python/recipes-devtools/python/python3-aspectlib/run-ptest b/meta-python/recipes-devtools/python/python3-aspectlib/run-ptest index b63c4de0d..8d2017d39 100644 --- a/meta-python/recipes-devtools/python/python3-aspectlib/run-ptest +++ b/meta-python/recipes-devtools/python/python3-aspectlib/run-ptest @@ -1,3 +1,3 @@ #!/bin/sh -pytest -o log_cli=true -o log_cli_level=INFO | sed -e 's/\[...%\]//g'| sed -e 's/PASSED/PASS/g'| sed -e 's/FAILED/FAIL/g'|sed -e 's/SKIPPED/SKIP/g'| awk '{if ($NF=="PASS" || $NF=="FAIL" || $NF=="SKIP" || $NF=="XFAIL" || $NF=="XPASS"){printf "%s: %s\n", $NF, $0}else{print}}'| awk '{if ($NF=="PASS" || $NF=="FAIL" || $NF=="SKIP" || $NF=="XFAIL" || $NF=="XPASS") {$NF="";print $0}else{print}}' +pytest --automake diff --git a/meta-python/recipes-devtools/python/python3-aspectlib_2.0.0.bb b/meta-python/recipes-devtools/python/python3-aspectlib_2.0.0.bb index 416b031c5..d2b0864ca 100644 --- a/meta-python/recipes-devtools/python/python3-aspectlib_2.0.0.bb +++ b/meta-python/recipes-devtools/python/python3-aspectlib_2.0.0.bb @@ -21,8 +21,10 @@ do_install_ptest() { } RDEPENDS:${PN}-ptest += "\ - python3-tornado \ python3-process-tests \ + python3-pytest \ + python3-tornado \ + python3-unittest-automake-output \ " RDEPENDS:${PN} += "python3-core python3-fields" From patchwork Sun Apr 2 22:29:40 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 22114 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id DA6B3C77B60 for ; Sun, 2 Apr 2023 22:30:10 +0000 (UTC) Received: from mail-pf1-f169.google.com (mail-pf1-f169.google.com [209.85.210.169]) by mx.groups.io with SMTP id smtpd.web11.56502.1680474610619466242 for ; Sun, 02 Apr 2023 15:30:10 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=TCrMas+i; spf=pass (domain: gmail.com, ip: 209.85.210.169, mailfrom: ticotimo@gmail.com) Received: by mail-pf1-f169.google.com with SMTP id ce4so4849338pfb.1 for ; Sun, 02 Apr 2023 15:30:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680474610; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=K7WgAWzjFfyrfEpXi424/+1dvdmRlEALzrvwg9pnBig=; b=TCrMas+inJBOR99m08hsWc+818RDlg7ECN5vFMw++Y4XT5sv5Gw788tCkh+rxsDd0w modc1SvQDX/sG+1RvmdoiYhdzUrnem4hB4tBAiU45D0/I/MCDZ7v8x4MdByTgSzujb1p 4xAMII0rHoLSFjdqREznYi4qLcvKnnYse7QTBDMFKfNao5bSgGV9GAdtqXhGwBkRd+jL ZhrJYLb1HY770aG7Ka36YGLzFquIMAWxHmy5tPKzUPV2jxd6wSFBD+E1hubBJ2M/2YCa f4bSSC+0vXUV+z9nBM/OaqDCxC8XhH8w+3NKxDO0N3JZ0qHBuk8lNhpBBsirEY2BeYmH Hb1w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680474610; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=K7WgAWzjFfyrfEpXi424/+1dvdmRlEALzrvwg9pnBig=; b=PNqpAYmN9L/ONQ5e7QtJkOHl+FzvTnskrxhrbGqrL2rDpU2/WTNACkQOD7uth3c90f 1yVmq+dL9VDLbJF6rI9tHKk2lVo52ZMrExjnNzZPO+8NQLPpujW/w2nW+WIdam964tqy js5e/9EhYNRzqhN830IwTuBlVHZrB0L/ptYOJgwwx6kd4ZGGo3Hr4QOZ0Ios4M4lXZK1 3dGhAFanT4I5uoOEvURMRByNbXNlyg4LlDuNJnez8XopkEsOygOyz/ljX47GDu17cEUp IXuHOgppHRzdoVbI3OGgv/Xq3LF448GZFqoD+lGocKs0lP3uuP9D9xyo1yTjYnre0QHy F6YA== X-Gm-Message-State: AAQBX9cevWOLOTAUAv1kLT32dJEwDN/yI10X/eZtTiRDzsNCgghSYFfj cnV1MtUdZDv/PHrZ6BsDMh7zek0D9Us= X-Google-Smtp-Source: AKy350YEz5sjQtgpZcyv2JYLJfunKXHdI7/46RbclxtbMcPPJQR7xnO10p77ycZllQpNTZKYc3qsmw== X-Received: by 2002:a62:4e4e:0:b0:626:166f:6db1 with SMTP id c75-20020a624e4e000000b00626166f6db1mr32583741pfb.13.1680474609717; Sun, 02 Apr 2023 15:30:09 -0700 (PDT) Received: from chiron.. ([2601:1c0:ca00:cea0:c5a7:cc15:fd65:db07]) by smtp.gmail.com with ESMTPSA id x47-20020a056a000bef00b0062cc53e5db9sm5404357pfu.197.2023.04.02.15.30.09 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 02 Apr 2023 15:30:09 -0700 (PDT) From: Tim Orling X-Google-Original-From: Tim Orling To: openembedded-devel@lists.openembedded.org Subject: [meta-perl][PATCH 08/11] ptest-packagelists-meta-perl.inc: add ptest recipes Date: Sun, 2 Apr 2023 15:29:40 -0700 Message-Id: X-Mailer: git-send-email 2.34.1 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sun, 02 Apr 2023 22:30:10 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-devel/message/101886 Similar to ptest-packagelists.inc in oe-core, this list enables per image ptest (isolated ptests for a given recipe) * Add recipes to PTEST_FAST_META_PERL for ptests which take less than ~30s * Add recipes to PTEST_SLOW_META_PERL for ptests which take longer * Add recipes to PTEST_PROBLEMS_META_PERL for ptests which have failing tests or other issues with ptest package The initial list was taken from: meta_perl_ptest_recipes=$(bitbake-layers show-recipes --recipes-only \ --layer meta-perl --inherits ptest --bare | tr '\n' ' ' | \ pcregrep -o1 '^NOTE:.+===(.+)$') Signed-off-by: Tim Orling --- .../include/ptest-packagelists-meta-perl.inc | 50 +++++++++++++++++++ 1 file changed, 50 insertions(+) create mode 100644 meta-perl/conf/include/ptest-packagelists-meta-perl.inc diff --git a/meta-perl/conf/include/ptest-packagelists-meta-perl.inc b/meta-perl/conf/include/ptest-packagelists-meta-perl.inc new file mode 100644 index 000000000..1a8c759b1 --- /dev/null +++ b/meta-perl/conf/include/ptest-packagelists-meta-perl.inc @@ -0,0 +1,50 @@ +# +# Lists of the ptest in meta-perl, sorted into two sets by the time they take +# Please keep these sorted in alphabetical order +# +# A first pass at getting all meta-perl recipes which inherit ptest +# meta_perl_ptest_recipes=$(bitbake-layers show-recipes --recipes-only --layer meta-perl --inherits ptest --bare | tr '\n' ' ' | pcregrep -o1 '^NOTE:.+===(.+)$') +# +# ptests which take less than ~30s each +PTESTS_FAST_META_PERL = "\ + libcapture-tiny-perl \ + libcgi-perl \ + libcrypt-openssl-random-perl \ + libextutils-config-perl \ + libhtml-tagset-perl \ + libmozilla-ca-perl \ + libstrictures-perl \ + libterm-readkey-perl \ + libtest-nowarnings-perl \ +" + +PTESTS_SLOW_META_PERL = "\ + libio-socket-ssl-perl \ +" + +PTESTS_PROBLEMS_META_PERL ="\ + libauthen-sasl-perl \ + libconfig-autoconf-perl \ + libcrypt-openssl-guess-perl \ + libcrypt-openssl-rsa-perl \ + libdata-hexdump-perl \ + libdbd-sqlite-perl \ + libdigest-hmac-perl \ + libdigest-sha1-perl \ + libnet-dns-perl \ + libnet-dns-sec-perl \ + libnet-ldap-perl \ + libencode-perl \ + libextutils-installpaths-perl \ + libfile-slurper-perl \ + libhtml-parser-perl \ + libmime-types-perl \ + libnet-ssleay-perl \ + libsub-uplevel-perl \ + libtest-deep-perl \ + libtest-harness-perl \ + libtest-warn-perl \ + libunicode-linebreak-perl \ + libunix-statgrab \ + libxml-libxml-perl \ +" From patchwork Sun Apr 2 22:29:41 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 22121 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id EF4A3C77B60 for ; Sun, 2 Apr 2023 22:30:20 +0000 (UTC) Received: from mail-pj1-f48.google.com (mail-pj1-f48.google.com [209.85.216.48]) by mx.groups.io with SMTP id smtpd.web11.56506.1680474612126787595 for ; Sun, 02 Apr 2023 15:30:12 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=ea9K+TlE; spf=pass (domain: gmail.com, ip: 209.85.216.48, mailfrom: ticotimo@gmail.com) Received: by mail-pj1-f48.google.com with SMTP id e15-20020a17090ac20f00b0023d1b009f52so30676053pjt.2 for ; Sun, 02 Apr 2023 15:30:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680474611; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=w6tT9sx2DR8kLbEnmPz+Oh+jqW5wQhntvfAiXYI2HdQ=; b=ea9K+TlEXriTYQRMY5e2EfDMC287KRQitttOuqEorlNX6Y9zdhJbt4yQZaRBjtqSq8 n7Oo9Hja7KDFLX9EPmAegI0VfQ4uTsr0Z5UhOXQfTX59GtVf76xJfZ4s/jb4oJuiJq1o 9kwzcfCGfzUH/lTtsBMmtYFNK7pdEwGPHnP2GaTKae3U5JrLz9eY1eogTD/givHmd3f7 oKimXGexmmjdQ9c9bnkKeHiy4cE2GKBFvh1H+jKyawwfi9UPn07tFSVWY5SdFnKeatoQ DzwlU7MSh8GeHjGcGOlYSj8MyhCp8CbeKU4RH4lBf1in0Ju1h04/Fcf+4YxoLp7R3CUf +1YA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680474611; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=w6tT9sx2DR8kLbEnmPz+Oh+jqW5wQhntvfAiXYI2HdQ=; b=2IBbVml2I6ZB3XSIEpxDC60zpo2bhSFQOi+nl4Gn3CvBP4YIAkgbOMHge/dexOLHGq XyzkFZE9nQfWHSh/O6L9pVfNSvvTrfIr9c00IcT9MZW5Auiz2vElxVtJwIgauhRK+VM9 IdxDS++zPOCc663sJs0LFjJ49qFEaWGJXcV5XxqTKUZtNEmgPr67FnvLSVnjEIWkQc9t J4EEASJhL6l4/ZnPPi+ZYMc1OUiUe9ZloziDu/SgVlWLUST30mcQo7eGKiIpOLuSMm+a QxH/rSJTNsSH49mBr3CvbHLAMolCQ1diuuJ/nqiJQIwJa+eR7Fi9B0nNmynX7lVKuLr/ G8sA== X-Gm-Message-State: AO0yUKUZB/HfWXr1f+u7F98N2F9GthprXL0BmRk4TN+y5EQGoeZolvRD nGN7b3D8nP9F9u578KVBbhTwzB3R3EY= X-Google-Smtp-Source: AK7set/tL6ZTK4igp7/UMjWTv8BOhIGOXPAXb6wR/IyKJt/RwSnEkvRHCAZ/uC6u/veYr1GSE0AcEA== X-Received: by 2002:a05:6a20:19a:b0:cb:f5ab:3bd0 with SMTP id 26-20020a056a20019a00b000cbf5ab3bd0mr26608137pzy.59.1680474611174; Sun, 02 Apr 2023 15:30:11 -0700 (PDT) Received: from chiron.. ([2601:1c0:ca00:cea0:c5a7:cc15:fd65:db07]) by smtp.gmail.com with ESMTPSA id x47-20020a056a000bef00b0062cc53e5db9sm5404357pfu.197.2023.04.02.15.30.10 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 02 Apr 2023 15:30:10 -0700 (PDT) From: Tim Orling X-Google-Original-From: Tim Orling To: openembedded-devel@lists.openembedded.org Subject: [meta-perl][PATCH 09/11] recipes-perl/packagegroups: move to recipes-core/ Date: Sun, 2 Apr 2023 15:29:41 -0700 Message-Id: <7497ebae5929bdc531ca76c5a0d6a29ecd60fe6f.1680473253.git.tim.orling@konsulko.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sun, 02 Apr 2023 22:30:20 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-devel/message/101887 Be consistent with other layers, like oe-core, meta-oe and meta-python Signed-off-by: Tim Orling --- .../packagegroups/packagegroup-meta-perl.bb | 0 1 file changed, 0 insertions(+), 0 deletions(-) rename meta-perl/{recipes-perl => recipes-core}/packagegroups/packagegroup-meta-perl.bb (100%) diff --git a/meta-perl/recipes-perl/packagegroups/packagegroup-meta-perl.bb b/meta-perl/recipes-core/packagegroups/packagegroup-meta-perl.bb similarity index 100% rename from meta-perl/recipes-perl/packagegroups/packagegroup-meta-perl.bb rename to meta-perl/recipes-core/packagegroups/packagegroup-meta-perl.bb From patchwork Sun Apr 2 22:29:42 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 22123 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id EEA41C76196 for ; Sun, 2 Apr 2023 22:30:20 +0000 (UTC) Received: from mail-pg1-f181.google.com (mail-pg1-f181.google.com [209.85.215.181]) by mx.groups.io with SMTP id smtpd.web10.56522.1680474613628637362 for ; Sun, 02 Apr 2023 15:30:13 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=ZZdml2E0; spf=pass (domain: gmail.com, ip: 209.85.215.181, mailfrom: ticotimo@gmail.com) Received: by mail-pg1-f181.google.com with SMTP id h14so16378001pgj.7 for ; Sun, 02 Apr 2023 15:30:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680474613; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=0rzDxQUAB5KMImZouw9yqlppBx2Y7A68IMTYJlhzqU4=; b=ZZdml2E01F7rf+zGD0FKIENoWTY19dTkUoZyTSXgCiyLeBkUiiqL0AhdQzr+rmaqnU tM8y45zYH8I1foXviHsTeoJVj8Ssnf44OUiLCa+igNGp0Z53g8gUZRvMJtSp5n2clbSe aOx2j0QOLnonWfcHy6gR5H6KTKz0L2Uj+RpGAavOPTI0F1EXxg/rk1GoDzJdHNHCQ3hm IyLAsmDIR88bh5OzcOvlm60NptO5QQLALnta07+85X6zxW3MHPWPYujVUKzfB5Ubcg67 0TROSR/SX8HYGIwNW8cZQpRvRxK7Pgoq6JL2jPKDZB+C++VkrCRahStRn7znogJUqDBt bSog== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680474613; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=0rzDxQUAB5KMImZouw9yqlppBx2Y7A68IMTYJlhzqU4=; b=B/o6bj8Nbf7qjSju+W/7Ym90AbtCPKlcGpLkCeN9gneF7F2rVnW3i2lKP9DrlB4228 lTxxkO2RzGnpYLZ1YfQMrjZRqn1u0jAhHq96d/l0a6HWEV73bsz/u33TWM/vmaRppemo 7sRt9t68oTPNNOvLePxkKy1U1VcVKz7rmqqHjPjBg33I232/lpvcG5p/lpL7o8MV5Pn3 1UFedYmPPBOGovYOqm1j8NCgSLtoo/4hnlTXU0s0vFGIEYYRY5jigJLWEvJAKOp4oxd4 twfjUASJjRrnY6bAayOl6Qpbq1fzvd1vVKaDIL+5Mi0WKogwMMkYeAoChmrMk9Ha/yzi qgQQ== X-Gm-Message-State: AAQBX9fOuCEgDnl2xLCzG3zMWdUmdh1uhaIswizfnVMhpUdRq2s5+j7y Vrd3N51p4SkPXS44zBy+j4qGgyUZWUE= X-Google-Smtp-Source: AKy350ZFpmpx4lG+GshiZB2JXmoijMXnngdtGkFlLimG0Jc6fMLm+OaQuJbf8UwKsllZHskWpMDx7A== X-Received: by 2002:a62:6454:0:b0:5a8:b2bf:26ac with SMTP id y81-20020a626454000000b005a8b2bf26acmr30977038pfb.20.1680474612736; Sun, 02 Apr 2023 15:30:12 -0700 (PDT) Received: from chiron.. ([2601:1c0:ca00:cea0:c5a7:cc15:fd65:db07]) by smtp.gmail.com with ESMTPSA id x47-20020a056a000bef00b0062cc53e5db9sm5404357pfu.197.2023.04.02.15.30.12 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 02 Apr 2023 15:30:12 -0700 (PDT) From: Tim Orling X-Google-Original-From: Tim Orling To: openembedded-devel@lists.openembedded.org Subject: [meta-perl][PATCH 10/11] recipes-perl/images: move to recipes-core Date: Sun, 2 Apr 2023 15:29:42 -0700 Message-Id: <8641dfe33feea365918907299622794be00fe3f2.1680473253.git.tim.orling@konsulko.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sun, 02 Apr 2023 22:30:20 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-devel/message/101888 Be consistent with other layers like oe-core, meta-oe and meta-python Signed-off-by: Tim Orling --- meta-perl/{recipes-perl => recipes-core}/images/meta-perl-base.bb | 0 .../{recipes-perl => recipes-core}/images/meta-perl-image.bb | 0 .../images/meta-perl-ptest-image.bb | 0 3 files changed, 0 insertions(+), 0 deletions(-) rename meta-perl/{recipes-perl => recipes-core}/images/meta-perl-base.bb (100%) rename meta-perl/{recipes-perl => recipes-core}/images/meta-perl-image.bb (100%) rename meta-perl/{recipes-perl => recipes-core}/images/meta-perl-ptest-image.bb (100%) diff --git a/meta-perl/recipes-perl/images/meta-perl-base.bb b/meta-perl/recipes-core/images/meta-perl-base.bb similarity index 100% rename from meta-perl/recipes-perl/images/meta-perl-base.bb rename to meta-perl/recipes-core/images/meta-perl-base.bb diff --git a/meta-perl/recipes-perl/images/meta-perl-image.bb b/meta-perl/recipes-core/images/meta-perl-image.bb similarity index 100% rename from meta-perl/recipes-perl/images/meta-perl-image.bb rename to meta-perl/recipes-core/images/meta-perl-image.bb diff --git a/meta-perl/recipes-perl/images/meta-perl-ptest-image.bb b/meta-perl/recipes-core/images/meta-perl-ptest-image.bb similarity index 100% rename from meta-perl/recipes-perl/images/meta-perl-ptest-image.bb rename to meta-perl/recipes-core/images/meta-perl-ptest-image.bb From patchwork Sun Apr 2 22:29:43 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 22122 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 01589C7619A for ; Sun, 2 Apr 2023 22:30:21 +0000 (UTC) Received: from mail-pl1-f174.google.com (mail-pl1-f174.google.com [209.85.214.174]) by mx.groups.io with SMTP id smtpd.web11.56509.1680474615460813145 for ; Sun, 02 Apr 2023 15:30:15 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=fLJdjQbs; spf=pass (domain: gmail.com, ip: 209.85.214.174, mailfrom: ticotimo@gmail.com) Received: by mail-pl1-f174.google.com with SMTP id le6so26262708plb.12 for ; Sun, 02 Apr 2023 15:30:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680474615; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=6PdVQjI1aZhbKuMdav/5xL2+HV2YS5qoFYbMxKDf9E0=; b=fLJdjQbsngY9f/hC+bwSnlh7RFwQxtBKV0L54D6Lr38dILCpj3q205UdqgHE7qMOFA n+LG0GX9zc7RaQ5UzPgBu/uvHyyarIU9/dDFDDNVbC/K/aH5tZgdMpnt/lm1r7JgfMLg h/mGAt9WhouatCTJdbzscvVLqpnNTJx1kSb13vixaygBBGpjNXYcHIvAY5uWIltDDt7i QsiHDQUnKp90S/8l+jCXub74wJiXGB1GL2O/P5pcYaVnkZtmnCwb6j2vREGGdhtU/dX1 hYeLzktyCDX5VlBrRNrjdZsRKab4HKOaOuiSn88VO3OpRCAel65bisxiGu1JzVDJxd0Q rU7g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680474615; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=6PdVQjI1aZhbKuMdav/5xL2+HV2YS5qoFYbMxKDf9E0=; b=cyEsoThv1rHBFbOcggPYryA9t03wCvlf3k+vYe08VyfWrLpXBToyqt/G6WuSh+KoOO lLg1UMHT34FVVOm52WZXpU40cv5BbD/GRsbvisdducqhM8UwgUcasP5olHY3JGi81xcP MgQigjIFmiXGX+sQmR3deAWHyhZa+/eRhDfudAbfiH/4TvJcBpcC4McjLUFTW8uO0fi/ f6gLfjVQNnDFnmGf4HnybGfYhQBwYfkPSg49MG7cAazk3d76YCFkFjTxbjPoOC/uf1D4 4mp17+/uh61vmn4u5gg+WEDQ51WwbCfa3rR3GvV7WAI9t2zzKlPvOHNx39f9T/yZR7nI Vlsw== X-Gm-Message-State: AO0yUKUr//Wi3eeJSLjmrA9YDBMFMDCQVXUo9IbMl97hLl9cQiSNgq6Y wDiAKGbgQ14fKhGn0govD+Keq0u43XI= X-Google-Smtp-Source: AK7set/O22AsN49E/bh18oCl4akbiSO/agtaIPCn3/dfm7VGELxOJdpoI46prM8ka9/TF3TFuaDb5g== X-Received: by 2002:a05:6a20:6597:b0:da:eebd:7f6c with SMTP id p23-20020a056a20659700b000daeebd7f6cmr28436774pzh.56.1680474614457; Sun, 02 Apr 2023 15:30:14 -0700 (PDT) Received: from chiron.. ([2601:1c0:ca00:cea0:c5a7:cc15:fd65:db07]) by smtp.gmail.com with ESMTPSA id x47-20020a056a000bef00b0062cc53e5db9sm5404357pfu.197.2023.04.02.15.30.13 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 02 Apr 2023 15:30:14 -0700 (PDT) From: Tim Orling X-Google-Original-From: Tim Orling To: openembedded-devel@lists.openembedded.org Subject: [meta-perl][PATCH 11/11] meta-perl-ptest*-image: enable BBCLASSEXTEND parallel execution Date: Sun, 2 Apr 2023 15:29:43 -0700 Message-Id: <6ce55616d1db9dbd490032581f89e1033aad9bb3.1680473253.git.tim.orling@konsulko.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sun, 02 Apr 2023 22:30:21 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-devel/message/101889 Similar to "core-image-ptest: Switch to BBCLASSEXTEND parallel execution" Refactor meta-perl-ptest-image.bb for an image per ptest in the form of meta-perl-ptest-image-XXX using class extensions. * Add meta-perl-ptest-all-image.bb depends on ALL meta-perl-ptest-image-XXX in meta-perl * Add meta-perl-ptest-fast-image.bb depends on meta-perl ptests which take less than ~30s This allows parallel execution of the tests. The downside to this approach is the parsing time of an image generating this number of class extensions is slow but making it easier to execute and collect test data should outweigh that. A useful advantage is that the dependencies of each ptest package are checked/tested individually. Add to local.conf: IMAGE_CLASSES += "testimage" All the meta-perl-ptest-image-XXX can be built with: $ bitbake meta-perl-ptest-all-image Subsequently, all the ptest images can be run with: $ bitbake -c testimage meta-perl-ptest-all-image You will likely want to limit the number of parallel image tests: BB_NUMBER_THREADS = "4" based on the number of TAP devices you have defined or the number of simultaneous QEMU sessions your server can support. Results can be summarized with: $ resulttool report tmp/log/oeqa/testresults.json Signed-off-by: Tim Orling --- .../images/meta-perl-ptest-all-image.bb | 25 ++++++++++++ .../images/meta-perl-ptest-fast-image.bb | 6 +++ .../images/meta-perl-ptest-image.bb | 38 +++++++++++++++++-- 3 files changed, 66 insertions(+), 3 deletions(-) create mode 100644 meta-perl/recipes-core/images/meta-perl-ptest-all-image.bb create mode 100644 meta-perl/recipes-core/images/meta-perl-ptest-fast-image.bb diff --git a/meta-perl/recipes-core/images/meta-perl-ptest-all-image.bb b/meta-perl/recipes-core/images/meta-perl-ptest-all-image.bb new file mode 100644 index 000000000..236043c22 --- /dev/null +++ b/meta-perl/recipes-core/images/meta-perl-ptest-all-image.bb @@ -0,0 +1,25 @@ +DESCRIPTION = "Recipe to trigger execution of all meta-perl ptest images." +HOMEPAGE = "https://www.openembedded.org/" + +LICENSE = "MIT" + +inherit features_check nopackages +REQUIRED_DISTRO_FEATURES = "ptest" + +require conf/include/ptest-packagelists-meta-perl.inc + +# Include the full set of ptests +PTESTS_META_PERL = "${PTESTS_FAST_META_PERL} ${PTESTS_SLOW_META_PERL}" + +do_testimage[noexec] = "1" +do_testimage[depends] = "${@' '.join(['meta-perl-ptest-image-'+x+':do_testimage' for x in d.getVar('PTESTS_META_PERL').split()])}" + +do_build[depends] = "${@' '.join(['meta-perl-ptest-image-'+x+':do_build' for x in d.getVar('PTESTS_META_PERL').split()])}" + +# normally image.bbclass would do this +EXCLUDE_FROM_WORLD = "1" + +python () { + if bb.utils.contains('IMAGE_CLASSES', 'testimage', True, False, d): + bb.build.addtask("do_testimage", "", "", d) +} diff --git a/meta-perl/recipes-core/images/meta-perl-ptest-fast-image.bb b/meta-perl/recipes-core/images/meta-perl-ptest-fast-image.bb new file mode 100644 index 000000000..5d8afa08e --- /dev/null +++ b/meta-perl/recipes-core/images/meta-perl-ptest-fast-image.bb @@ -0,0 +1,6 @@ +require meta-perl-ptest-all-image.bb + +DESCRIPTION = "Recipe to trigger execution of all fast meta-perl ptest images." + +PTESTS_META_PERL = "${PTESTS_FAST_META_PERL}" + diff --git a/meta-perl/recipes-core/images/meta-perl-ptest-image.bb b/meta-perl/recipes-core/images/meta-perl-ptest-image.bb index a9b4cc3c7..7cca6402b 100644 --- a/meta-perl/recipes-core/images/meta-perl-ptest-image.bb +++ b/meta-perl/recipes-core/images/meta-perl-ptest-image.bb @@ -1,9 +1,41 @@ +inherit features_check +REQUIRED_DISTRO_FEATURES += "ptest" + require meta-perl-base.bb SUMMARY = "meta-perl build ptest image" -inherit features_check +require conf/include/ptest-packagelists-meta-perl.inc -REQUIRED_DISTRO_FEATURES += "ptest" +DESCRIPTION += "Also including the ${MCNAME} ptest package." +HOMEPAGE = "https://www.openembedded.org/" + +PTESTS_META_PERL = "${PTESTS_SLOW_META_PERL} ${PTESTS_FAST_META_PERL}" + +IMAGE_INSTALL:append = " ${MCNAME}-ptest openssh" + +BBCLASSEXTEND = "${@' '.join(['mcextend:'+x for x in d.getVar('PTESTS_META_PERL').split()])}" + +# The image can be sufficiently large (~1.8GB) that we need to be careful that it fits in a live +# image (which has a 4GB limit), so nullify the overhead factor (1.3x out of the +# box) and explicitly add up to 1500MB. +IMAGE_OVERHEAD_FACTOR = "1.0" +IMAGE_ROOTFS_EXTRA_SPACE = "324288" +# If a particular ptest needs more space, it can be customized: +#IMAGE_ROOTFS_EXTRA_SPACE:virtclass-mcextend- = "1024288" + +# ptests need more memory than standard to avoid the OOM killer +QB_MEM = "-m 1024" +# If a particular ptest needs more memory, it can be customized: +#QB_MEM:virtclass-mcextend- = "-m 4096" + +TEST_SUITES = "ping ssh parselogs ptest" + +# Sadly at the moment the full set of ptests is not robust enough and sporadically fails in random places +PTEST_EXPECT_FAILURE = "1" + +python () { + if not d.getVar("MCNAME"): + raise bb.parse.SkipRecipe("No class extension set") +} -IMAGE_INSTALL += "packagegroup-meta-perl-ptest"