From patchwork Mon Dec 18 11:20:24 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Joakim Tjernlund X-Patchwork-Id: 36541 X-Patchwork-Delegate: steve@sakoman.com Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id DE99EC35274 for ; Mon, 18 Dec 2023 11:20:34 +0000 (UTC) Received: from NAM12-BN8-obe.outbound.protection.outlook.com (NAM12-BN8-obe.outbound.protection.outlook.com [40.107.237.59]) by mx.groups.io with SMTP id smtpd.web11.41968.1702898428502173155 for ; Mon, 18 Dec 2023 03:20:28 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@infinera.com header.s=selector1 header.b=OoJEwsEk; spf=pass (domain: infinera.com, ip: 40.107.237.59, mailfrom: joakim.tjernlund@infinera.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=mudpFGoqBk/n1BfuMe8CMWVlSqetZRnCybXhkcf51uUbLvpMhh83Mz+M/c6xK4Tf0CfhG0slutrL9R6GXQLw/24q15gSe2MYpbkHKJHfU0wvHJXScAC6djpLwrJGQdTckROG6o432lvSOXBI6cUBZyyUUQt6AiM0WiSax0nl90ZkPbfz/KPYC6Xd4gRtxbbDGU4ZMwc3ukVjytPa23DwaXZU9g6mPNpS2EijIe3grAJsFgn1J5aPdf2AYoGr2MzAM0hen8m68gngFS6OzbSGaLVwDrJ/5YnTlPY6InuHxHRHSQl9B+/KckFp6cU979deSCBJS4GTwAfBZYujKJpz0A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=0/IVxmS5AVMIrfmavNq/+h0aTFPBBPEUJXwcqpeGoyc=; b=mkZDJoBvkbW0RiwiaOZQ+1X6LnhNXM/S8jKMYAhOE5Y50/vwaDsVTNeYKkayt/4XT5M+cqpl5ZVfasKDof60rao0AnORfRDnE4+E7Sdtk+x/3L8nlCgWQaMMv7IDAIH8JERSiFV+rcy50HfoYOmQ6OvNsv8jo4WApStwPJhf7Xuy2NtyyhFmKQgkT12yr/lc3/5Qa9DodCiLaylEx6Hn2CMFWl2zZ6ZsRESGu4wOnr1kwflIw3YEYJ5qcvNK167ZYqeI0jSEngdiO7ws97kzuFriupk2YOY7SAeGW92DvuULmDZegcE/Eb4NxHrNahQAAZ9wBsatqhZuGZnvOAC5VQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=infinera.com; dmarc=pass action=none header.from=infinera.com; dkim=pass header.d=infinera.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=infinera.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=0/IVxmS5AVMIrfmavNq/+h0aTFPBBPEUJXwcqpeGoyc=; b=OoJEwsEkbHL6riVPwv3nOuVVgWru0nVcgzrNXxurTE9LLRRDr/GzVpl6Gb2ngR1dtRpDDquxhtRdzEVcM0VDSm2XqINXh6NAgA8Z8nFZ0RpnO/LJL98oxaa1Y417BesdpI54tEMdAo/VPLQeoJQbNIXWKpj1UMu8Yz8NILbrqNKjB7GUnrSdUq8vdPZ/ddhzd8LiEh3cGG0i4yjYuO2WrzAGQTCAMASjx4Sevd0suQ+FNlKYY1IBIFl8A0ycMiVLrgWCUyWinXGI1ZcLyFt7Bobwz1Xg+wQfhtImitvd6PG47pNQp6deyuLxxBZK3VYvpH+RwdpROOkvOkZFDqRHFQ== Received: from PH0PR10MB4615.namprd10.prod.outlook.com (2603:10b6:510:36::24) by PH0PR10MB4455.namprd10.prod.outlook.com (2603:10b6:510:36::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7091.37; Mon, 18 Dec 2023 11:20:24 +0000 Received: from PH0PR10MB4615.namprd10.prod.outlook.com ([fe80::86e6:23e4:41ae:35c5]) by PH0PR10MB4615.namprd10.prod.outlook.com ([fe80::86e6:23e4:41ae:35c5%7]) with mapi id 15.20.7091.034; Mon, 18 Dec 2023 11:20:24 +0000 From: Joakim Tjernlund To: "openembedded-core@lists.openembedded.org" Subject: kirkstone: oe-selftest -v -r reproducible.ReproducibleTests.test_reproducible_builds broken ? Thread-Topic: kirkstone: oe-selftest -v -r reproducible.ReproducibleTests.test_reproducible_builds broken ? Thread-Index: AQHaMaQyiJqshOiCukOwvQQfz8CqBQ== Date: Mon, 18 Dec 2023 11:20:24 +0000 Message-ID: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Evolution 3.50.1 autocrypt: addr=joakim.tjernlund@infinera.com; prefer-encrypt=mutual; keydata=mQENBFp0f28BCADPn4XzN2HEzkY4BZKE6/T/S4M/Qjlf01K6gmECJZi5LQgOt0jOUAdvsXVd8yKYeqCq+eWvlfrLU9OXPGoCqwj95P2YjMsttqaPBEAnf4XyBs67Snz2wHyBDONoRxGoyq2Ondy+TPicWEm0mh404h9EzKxRNxwrRyKhsjWoVeaucuybAiGbJvqQj0CLmuMCl4PUBYDmXFzt3yx0g54z8E9/8ON+z0J7yZbA0aftZAjFLv6nn0Th/2dpD8d3vWtkJw4yBjLX2KFvlzJfQqkd6RI4Cn1OP9sguXDob123dMiMk/5XbjXz+0C21QFxejxt3HGisvKes+8swplyni7KdiDtABEBAAG0MEpvYWtpbSBUamVybmx1bmQgPGpvYWtpbS50amVybmx1bmRAaW5maW5lcmEuY29tPokBVAQTAQgAPhYhBFtMG/jmfqy7x0aBp4VMQ6CbDpcaBQJadH9vAhsDBQkDwmcABQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAAAoJEIVMQ6CbDpcasFAH/j64dpHpjY55tVoUg5yK8hcmxS/buKQQP9H3e2DdHeYrK0qeQ97AXiWTh63UvzvEXchiKjua6kYhUUkDObaltmwkKgPv0qb9lP6yfFBzvllriS6LrdIMCOLgtnQW2x28m5mC1hYT08jlqEXluYDoj2dTll9HGMsqn0JkhRjBsuzTXq8VyJjjnNLpzsAlTOGEQoAi7SqtDHs9PSNyOAKH5jRjATdNbPAsTKuI1veJf7Zzyc98yG0ya43Hqal1scoa+9GJZXNQPRaMVkyxKGbEEncdtnQl9e/DUMH4SUQ5vbM/+U4WvkX5Cvc+KwI6JAm1PhrAaVHSkDNAU5LqUqEbbHY= authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=infinera.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PH0PR10MB4615:EE_|PH0PR10MB4455:EE_ x-ms-office365-filtering-correlation-id: 02c1ab55-1111-485e-4500-08dbffbb54a2 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: gI8P6vTm2lQ6Mmq3fAoGfi0V00L1/76omyTW5ndbO+QAc0jBazCXBdonW4kieesG74huuysTAHL71JpnfJGTYeeXCNjDT7dpvkYPxXJE7a3I5sKBYjb6ZMuC3si0tV7eT5QZag8MC/Q2MEw6k5+atCQhOwjujim2YWZ+WTo7GjNQ2pLFjUfmjix7fPsZJWXHkqNB0vt+FntNy20P81jtDzMeMmfUDaKmsp6q0PeuBgFutkYSasJpTauxS3WgoVQL/xyHDvkl04leD2H1n20YGrF6p6W/6SGolOa4v3Uyyn+JKOqovXVvcIu3kNi0khoRl83VhVSAYKTHQVCI0tRsar919f32egDVryvOJ9iEzDK6udfzzdHmiU1yBrbaUKZUaE6xRifullT5xQqs7tahV+fc0j+e2xFXA0zbvmZGsRSaBjwBIFXvS58V6A9Iy+ampBnMMZTxUADN6jFLy56s+bPfE9DOADWQWpiSIzKmxTPLhYuljnYzLU79pK7mHbhV9eOGmQMH+TGriXV88w1mJGjcEVr969anUWbUCWe4seu8l3HX9AwWrnIBfu2lPDTou38h/s31iXLWg7U73rwvg7jtlUKrHEN+wCh5AFpJVvU= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PH0PR10MB4615.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(366004)(39850400004)(346002)(136003)(396003)(376002)(230922051799003)(451199024)(186009)(64100799003)(1800799012)(38070700009)(38100700002)(122000001)(2906002)(86362001)(66556008)(4001150100001)(2616005)(83380400001)(71200400001)(6506007)(6512007)(5660300002)(966005)(91956017)(6486002)(36756003)(41300700001)(478600001)(316002)(6916009)(66446008)(66476007)(64756008)(76116006)(66946007)(8676002)(8936002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?utf-8?q?OiZGgw1uSW1Kgp3489vk+Lot/3c4?= =?utf-8?q?ap8f7e/d9Ppbkn5VamWe5QYF+WH2LtX8dBdZQ+p4aeo7g/sQcIaSx7U/v5YhGCiTV?= =?utf-8?q?5w2XwXkGN5to/bUkPRxfxNrxL0znmX8F2lTQNbo044ZuZ3YZtImi0b/QeS+2CiELT?= =?utf-8?q?qUjI0slBgHEscYR2L6kE9KocZWuKWTVmGRR1Mo5BetzNGTNk24Yh+fSta7bKwIIeH?= =?utf-8?q?/zMOjrKLTneAYuB2Ziq38I6s3jSHRfNgJ8vovuqanZj/xgT59MPbHasvqAF0Y4vlx?= =?utf-8?q?7t2n4pi7kZ4nb3qoeK911QF0bCQxDb9kujUlBmuOHnO585z2dFeJULTo9xaZBUDNR?= =?utf-8?q?psaB2OC1K9YQwmnj/2cProorwK6AayxSuCmF3W6TxA0Fo/wHwoZPw9KJ9omo1L5K0?= =?utf-8?q?9zL2076KsXHWQ8po4G4U4Y+WR7WDG5Q48NqCryOvzNe9LLHPqk6q91ogSj74BrVw3?= =?utf-8?q?1ERxrsKOWUqN4NGvHB9b0U7LWNu7ldBzZmY0avkqVkXM6bBfY5RdW/LTJ7BZjkHL4?= =?utf-8?q?jzoaacY8aNdgSAe1hAm3XydCiFDSL+F2MKpSW6IOuRea8dMYEWEg30/PxjCL1HY+7?= =?utf-8?q?GfBTCMgfSTuTL/a/v8+QHRIVYNa5vsRDaYsgYKwpa1+jJIBEtv2ctDdooiZVOLc3t?= =?utf-8?q?lgqBMhqaA7kEBG13fHv+JIMcV961gnmGYXRUv9cFZWwIvSuGkuuXq6Ttxn64UTp18?= =?utf-8?q?kO7LUWFnDWYuwxlOMBlmEVaNTNeD9ymlTyyECGU3JS0gHz+qX/c2Kn5BeDUHv5Myo?= =?utf-8?q?TDsTqVG8Jsbg5pbKyBlNrG2hAw4lkUvIxcDz5oaNVzEtLmbkEnXsoG6FHqs7uukBH?= =?utf-8?q?VeT45PJDBjv1wMjl7wBr1eNQcNJYxlVIk2d6IJiw7Uc1S6tllRRIMI7jUTWqN8TRn?= =?utf-8?q?X/YFaXGHgwWk1Qb48YPuKIR+3ARXLy62KNGZj0L4ycCFAzGQEINK0sjFAtHcGZQMI?= =?utf-8?q?38OIBCo1bGZRv4tPhEsYoCQiPhncqLPjDykkHzOZ3Ne7md0wiAZNz1DInBkIbOJaO?= =?utf-8?q?JzJPpnWezra7we68kR1G+hPf2q+7yHKx6dByvpKXWcg5qxuLm0p+Up+0qguGuHvKr?= =?utf-8?q?KMcmYQIsIuz3DEzR6Xr/sDiGDlzSxtt58Xs/s8yiTLL56kXXemP9Os+IjRpvTUZL0?= =?utf-8?q?T1baJV01GW2M8jaNXmMhrwCz8zx9DZ3AXpM+yzPmh1Vcbl7JMQGarlwmYflUJQDyq?= =?utf-8?q?Hmc876bejPDcI69wGattvhp5GGtFH08jxeyORaSA79tBGOh0Q9HCvUoD0F0aBhv51?= =?utf-8?q?aZwG2DQjq2ZcRz4O7DKJrbfqWZBwOF4YtkBM8B14E5pMknWCghSdj+w/ACh1b9EVu?= =?utf-8?q?dlfQc3dqUYnMK5DjLN+zXCa7BJ1FOzG80L9GZQ/J/LrfEW4AD15CNhdmYKdTToFPV?= =?utf-8?q?FcCOPK+b5/Etwwrpx7pxOrP6M8+RkdisI+5h6iF4EZnWdsthnqlAsy0kTBrUPN2Lc?= =?utf-8?q?zyMpmqOykiKKcB6bXnqM3dkKSeRSexbPzJ8R1N9KB8Gu+HUwlCvuEyeeNJZTgZwrh?= =?utf-8?q?d1AXxgU2oIu2arQw8GvHAeR53WzVcSivj7TtATnrf4voAZh2t44n88kBM7+1wA87S?= =?utf-8?q?hmdrRkthcSS?= Content-ID: MIME-Version: 1.0 X-OriginatorOrg: infinera.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PH0PR10MB4615.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 02c1ab55-1111-485e-4500-08dbffbb54a2 X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Dec 2023 11:20:24.6424 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 285643de-5f5b-4b03-a153-0ae2dc8aaf77 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: MamvDeSrIRRQQpv4LZLEB79QXo0BbsQ1IW1wuAdSmH3N4ke3hzlwdzVgu/nhbujpEG7/VnJsU58/suWkPoLUQw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR10MB4455 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Mon, 18 Dec 2023 11:20:34 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/192631 I setup above test for reproducible builds and build one pkg(u-boot) and try to force a non-reproducible build to test the framework: forcing EPOCH to current build date but I still get an success report: oe-selftest -v -r reproducible.ReproducibleTests.test_reproducible_builds 2023-12-18 12:05:22,355 - oe-selftest - INFO - Adding layer libraries: 2023-12-18 12:05:22,356 - oe-selftest - INFO - /home/jocke/yocto-xr/3pp/poky/meta/lib 2023-12-18 12:05:22,356 - oe-selftest - INFO - /home/jocke/yocto-xr/3pp/poky/meta-yocto-bsp/lib 2023-12-18 12:05:22,356 - oe-selftest - INFO - /home/jocke/yocto-xr/3pp/meta-openembedded/meta-oe/lib 2023-12-18 12:05:22,356 - oe-selftest - INFO - /home/jocke/yocto-xr/meta-xr/lib 2023-12-18 12:05:22,356 - oe-selftest - INFO - /home/jocke/yocto-xr/3pp/poky/meta-selftest/lib 2023-12-18 12:05:22,359 - oe-selftest - INFO - Running bitbake -e to test the configuration is valid/parsable 2023-12-18 12:05:27,248 - oe-selftest - INFO - Adding: "include selftest.inc" in /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/local.conf 2023-12-18 12:05:27,248 - oe-selftest - INFO - Adding: "include bblayers.inc" in bblayers.conf 2023-12-18 12:05:27,248 - oe-selftest - INFO - test_reproducible_builds (reproducible.ReproducibleTests) 2023-12-18 12:05:29,724 - oe-selftest - DEBUG - Writing to: /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc 2023-12-18 12:08:26,539 - oe-selftest - INFO - Building reproducibleA (sstate allowed)... 2023-12-18 12:08:26,545 - oe-selftest - DEBUG - Writing to: /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc PACKAGE_CLASSES = "package_ipk" INHIBIT_PACKAGE_STRIP = "1" TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/reproducibleA/tmp" LICENSE_FLAGS_ACCEPTED = "commercial" DISTRO_FEATURES:append = ' systemd pam' USERADDEXTENSION = "useradd-staticids" USERADD_ERROR_DYNAMIC = "skip" USERADD_UID_TABLES += "files/static-passwd" USERADD_GID_TABLES += "files/static-group" 2023-12-18 12:09:08,936 - oe-selftest - INFO - Building reproducibleB (sstate NOT allowed)... 2023-12-18 12:09:08,937 - oe-selftest - DEBUG - Writing to: /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc PACKAGE_CLASSES = "package_ipk" INHIBIT_PACKAGE_STRIP = "1" TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/reproducibleB/tmp" LICENSE_FLAGS_ACCEPTED = "commercial" DISTRO_FEATURES:append = ' systemd pam' USERADDEXTENSION = "useradd-staticids" USERADD_ERROR_DYNAMIC = "skip" USERADD_UID_TABLES += "files/static-passwd" USERADD_GID_TABLES += "files/static-group" SSTATE_DIR = "${TMPDIR}/sstate" SSTATE_MIRRORS = "file://.*/.*-native.* http://sstate.yoctoproject.org/all/PATH;downloadfilename=PATH file://.*/.*-cross.* http://sstate.yoctoproject.org/all/PATH;downloadfilename=PATH" 2023-12-18 12:09:24,772 - oe-selftest - INFO - Checking ipk packages for differences... 2023-12-18 12:09:24,843 - oe-selftest - INFO - Reproducibility summary for ipk: same=4 different=0 different_excluded=0 missing=0 total=4 unused_exclusions=[] 2023-12-18 12:09:24,847 - oe-selftest - INFO - ... ok 2023-12-18 12:09:26,044 - oe-selftest - INFO - ---------------------------------------------------------------------- 2023-12-18 12:09:26,044 - oe-selftest - INFO - Ran 1 test in 241.335s 2023-12-18 12:09:26,045 - oe-selftest - INFO - OK 2023-12-18 12:09:32,355 - oe-selftest - INFO - RESULTS: 2023-12-18 12:09:32,356 - oe-selftest - INFO - RESULTS - reproducible.ReproducibleTests.test_reproducible_builds: PASSED (237.60s) 2023-12-18 12:09:32,361 - oe-selftest - INFO - SUMMARY: 2023-12-18 12:09:32,362 - oe-selftest - INFO - oe-selftest () - Ran 1 test in 241.336s 2023-12-18 12:09:32,362 - oe-selftest - INFO - oe-selftest - OK - All required tests passed (successes=1, skipped=0, failures=0, errors=0) Looking harder I don't see oe-seftest ever creating reproducibleA/reproducibleB directories. I have these set OEQA_REPRODUCIBLE_TEST_PACKAGE = "ipk" OEQA_REPRODUCIBLE_TEST_TARGET = "xr-u-boot" I am missing something? Jocke --- a/meta/recipes-bsp/u-boot/u-boot.inc +++ b/meta/recipes-bsp/u-boot/u-boot.inc @@ -9,7 +9,7 @@ inherit uboot-config uboot-extlinux-config uboot-sign deploy python3native kerne DEPENDS += "swig-native" -EXTRA_OEMAKE = 'CROSS_COMPILE=${TARGET_PREFIX} CC="${TARGET_PREFIX}gcc ${TOOLCHAIN_OPTIONS}" V=1' +EXTRA_OEMAKE = 'CROSS_COMPILE=${TARGET_PREFIX} CC="${TARGET_PREFIX}gcc ${TOOLCHAIN_OPTIONS}" V=1 SOURCE_DATE_EPOCH="$(date +%s)"' EXTRA_OEMAKE += 'HOSTCC="${BUILD_CC} ${BUILD_CFLAGS} ${BUILD_LDFLAGS}"' EXTRA_OEMAKE += 'STAGING_INCDIR=${STAGING_INCDIR_NATIVE} STAGING_LIBDIR=${STAGING_LIBDIR_NATIVE}'