From patchwork Fri Aug 4 08:48:27 2023
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: 8bit
X-Patchwork-Submitter: =?utf-8?q?Piotr_=C5=81obacz?=
X-Patchwork-Id: 28406
Return-Path:
X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on
aws-us-west-2-korg-lkml-1.web.codeaurora.org
Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org
(localhost.localdomain [127.0.0.1])
by smtp.lore.kernel.org (Postfix) with ESMTP id B403AC001DB
for ; Fri, 4 Aug 2023 08:48:37 +0000 (UTC)
Received: from EUR05-AM6-obe.outbound.protection.outlook.com
(EUR05-AM6-obe.outbound.protection.outlook.com [40.107.22.60])
by mx.groups.io with SMTP id smtpd.web11.7222.1691138910622027701
for ;
Fri, 04 Aug 2023 01:48:31 -0700
Authentication-Results: mx.groups.io;
dkim=fail reason="dkim: no key for signature: lookup
selector2._domainkey.welotec.com on 127.0.0.1:53: no such host"
header.i=@welotec.com header.s=selector2 header.b=Zt1AHqfD;
spf=pass (domain: welotec.com, ip: 40.107.22.60,
mailfrom: p.lobacz@welotec.com)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
b=crrSTAAoZf2BJJl3rhFxuU8Gw3eCc98UoH2HDOv0cltOuoEm4MoAbmOrEd5pqGlK/hGf8mIAqel2bXnR/bl694sKje23voP8qGjbRmH5bnvgfuUpk+T/U4I3d4EXG2YaY0VW1B0dXuvh3a321H8Z4xMZMoqK5U4sRjxMrnbs4H3MPr1oMLkoeZG4+x88qtvLN/vxFDv+ByurIztOSJswpt/iRti8Vfr7R+J+Ci0262mdqqiOdGeNxH5Q4Oec9aG6R3pW7eh2U+3pkQWX/fQqTe49BH+VuaO7xeRQF+hYvq7X0QAr2yLlDd4KC+3VtgszdaaLl1U6Oihjna+fFxBYXQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;
s=arcselector9901;
h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1;
bh=HcFPgW9AjwcHvUaWUJwyqtTSGsEDkPxD99gpSlnquTk=;
b=WHuGvpjsQdy3PsHLvhyySTbCT/NhUfggrQjT5tQNxH8wzZ6HpESBCqfmlTRSYCqSguvkjmIv1MJQDNPEQ5DE2S/eylZUtbjcrPgWuNXD+Oip/rge7r2wv0e2D/eM2JtdfpcUzeFJfqyHgFUHdZnR6aSUpzqpAInE09DL1/L8zN6qawRm1diUgpRpFryHPKV16kI6YVxw9iL+lIzWBT4s1VFKPgWOp7YIgOmTZmsxBZ2l3C1Mk56Ymxiif4oYbbSBrNcM6sGUKhIM5R1UoCIewLazElcsrMO4Ol2SpFe7eTPiyOrUWQc2NW3sZKDGnjWnjzojDgCeuMpekXB2hm7yuA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass
smtp.mailfrom=welotec.com; dmarc=pass action=none header.from=welotec.com;
dkim=pass header.d=welotec.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=welotec.com;
s=selector2;
h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
bh=HcFPgW9AjwcHvUaWUJwyqtTSGsEDkPxD99gpSlnquTk=;
b=Zt1AHqfDAG40JPmv3YwcARlm6ghyceMPH/GxDy+jtGRP3mHUMxNRp06Hv17JCd780LaD1kpPFF67kPh35EFdSStcswwWsxp4+z/n244Hx8caf8/TFHw+4ZDyWuuXmwqKGBsR2dVZ1AsfJaXN4xt+st/XTCY4D7Jlj1rhV8qFRnM=
Received: from VI1PR04MB5373.eurprd04.prod.outlook.com (2603:10a6:803:da::22)
by AM9PR04MB8587.eurprd04.prod.outlook.com (2603:10a6:20b:43a::18) with
Microsoft SMTP Server (version=TLS1_2,
cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6652.21; Fri, 4 Aug
2023 08:48:27 +0000
Received: from VI1PR04MB5373.eurprd04.prod.outlook.com
([fe80::b693:eb1b:b0e6:9a06]) by VI1PR04MB5373.eurprd04.prod.outlook.com
([fe80::b693:eb1b:b0e6:9a06%4]) with mapi id 15.20.6631.046; Fri, 4 Aug 2023
08:48:27 +0000
From: =?windows-1250?q?Piotr_=A3obacz?=
To: "openembedded-core@lists.openembedded.org"
CC: "alexandre.belloni@bootlin.com" , Richard
Purdie
Subject: ODP: [OE-Core][PATCH v12 1/7] path.py: add support for ACLs and all
additional attributes
Thread-Topic: [OE-Core][PATCH v12 1/7] path.py: add support for ACLs and all
additional attributes
Thread-Index: AQHZxq/4yomck7DpJEm9qpMHFkJ0e6/Z0qTH
Date: Fri, 4 Aug 2023 08:48:27 +0000
Message-ID:
References: <20230804084315.55768-1-p.lobacz@welotec.com>
In-Reply-To: <20230804084315.55768-1-p.lobacz@welotec.com>
Accept-Language: pl-PL, en-GB, en-US
Content-Language: pl-PL
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels:
authentication-results: dkim=none (message not signed)
header.d=none;dmarc=none action=none header.from=welotec.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: VI1PR04MB5373:EE_|AM9PR04MB8587:EE_
x-ms-office365-filtering-correlation-id: 75d60037-9840-4d18-f981-08db94c79204
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info:
gBdNOBZfYOPFYN0Cd9p1pLTXgRrOjqRI3vj7TsnzvGfSNzVSSpeouQ/k75/2wLHR/lIyFQap+CfI9DsaZAKrnjo9Q1wqK9089hip9f2E7fb55io1m1S5/+4FCkvm7xRBVIERC5JxQ3feEYCKm44NGEyRw8z69hAceo3manoY+/ZOSHu5pTZnI7pToa292rp6Tb4IOUnu01z8qwQCs/a0h8ivDHOiTVwcuTO4vQES30ZRQuC0CpkptxR5joOgVvKr0rknBNS666D9HtjW/hhaYJ7IRlv4j8QINDGDgihjXZGDT4pi4wFK9B95llBuPaBFdjynX/0Dg8HtTcOzQND9f62JuAIHWXdA/gg00YttmA/EqWpd7MFugG32VjF8mmJsFIM13rsWyE2V4Tz7K1kLoObZ39bOhw4RR9Hz4EiyG0yFv1Sa1LrGx85x/qr+z/2EScccv0oaz7dKIHPiMdEMt3chu/XUMJ8fdKs170ygBsRV+h00j9T01b9IoEffnXQBgng7Ajb9/Smo1znqObvhI0MN4M8phyTwnYS/fP50B3s02VLVuwiwhLKSpUF1nWhC7PE+p4j5JWb1ZWixlAw+olJeXoG3bwTlBhWf/Ivo0rg48W7NM5OxmJSBpumTPIBM
x-forefront-antispam-report:
CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:VI1PR04MB5373.eurprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(346002)(376002)(396003)(136003)(366004)(39840400004)(1800799003)(186006)(451199021)(316002)(83380400001)(66574015)(122000001)(2906002)(33656002)(8676002)(8936002)(26005)(38100700002)(6506007)(71200400001)(91956017)(52536014)(5660300002)(41300700001)(64756008)(66446008)(66556008)(66476007)(66946007)(76116006)(55016003)(4326008)(7696005)(6916009)(478600001)(86362001)(54906003)(38070700005)(9686003);DIR:OUT;SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?windows-1250?q?Y+QD0urJN1UQyfTrmFVSe?=
=?windows-1250?q?cFsfEOyLVe17LmMc/koJftdL24VhfgQ1TIIALRQUMRUg3Q/d1gQLJKNt4D?=
=?windows-1250?q?EkIMco2MdD06lO36/rPDure0eSvgmH8s7CE3Hwrs8VqYknEfs3/kE95aXw?=
=?windows-1250?q?uBRiKjA3zH6aGmcSxnrkT6h/3qtzK8Lo8vRcPLDqtInVishvkkvLqfHMGH?=
=?windows-1250?q?a/8QHkoVnpXBf97dg+amDWOu9EyvD37Kjfl+9cBbTj+ZTCmzsy0Q7JvvlM?=
=?windows-1250?q?gMqfl7j27yABL3Ta20fGgUQLmR8F8Zk6YbLKRNuVlFw/Sfk0YORO2qAdkp?=
=?windows-1250?q?c6qO4e4vRDq8iikM0p+V3NRf8eVlUF0AmwtJF1CKBj348kfVVsYLS1ctGL?=
=?windows-1250?q?4CogrLVN31TgA9EtUqEnhgMdCOaRnZErPV+PZfsa1Uor6x5arBQqgIbTGR?=
=?windows-1250?q?CVELOW/+6gItASNV/0B4vdtS8EPE8g6TpKNOhF0erpyOeGqXblntNGFopx?=
=?windows-1250?q?gbBVkg5LjussVFB61ulpd0WEbv7Z3jjRvZJjRKdRcVcKCrj7/QRgr/lWhD?=
=?windows-1250?q?Y1YHy2oPW9cKnxkKqmqjK8XNt0fMezbjWvR3yGvmP15RLD5i7da2mxX50V?=
=?windows-1250?q?0yBUM9GOhSjLd3K7NPx3N51kVAnUyeNFVsx67PpRlB+ldG+yQpc/yPCmoU?=
=?windows-1250?q?U9Gh4M0xBebzmDCqgUar8qCzqfmbIUMytIL+1m0Y6S1gcSGPm9whDyoX+P?=
=?windows-1250?q?luK8Mx/ID/vPB8Xue1Uiq6QDb9mU5cOs8/RfYt3r6J/fpBj12HBhOl+3lP?=
=?windows-1250?q?KntUworegGw/YsjPIPHBAgo0x1a6s5/arpLgXpbzjhGe66AQYytTGsX2DR?=
=?windows-1250?q?dN82zmSR+rA3gd/rhF+klPEmwYlC7wqRCLxs7NCqYgZVIpbOvkKHmdMCp4?=
=?windows-1250?q?ZU7M5Zmc8O7sSOibQVJb+hYkDgVtLYy1uuH0DZfufTxaCy9Fg7qnW7XHA2?=
=?windows-1250?q?RqX4lVF3W+lPBGtXhhyUsL/iX4t/YeXWcqvbNA9I6GptqRdqWE8oYm9DZu?=
=?windows-1250?q?f1B1efttmvcweuSKQdmXGC3da1sdkhWF4s9VbOSTqVqsRfH0/mpgwJ51oU?=
=?windows-1250?q?yymGdq+jD9jB1ULDUe6LOaaad5VF4sIH2iol9JuuN67nf8PR9rs7A59VcM?=
=?windows-1250?q?watKjOUKE8kIbw0UfqTYQ0uuZPJmj5KMJ/qppM7/yEo3Swmcce0/ka4nbr?=
=?windows-1250?q?XVp5xxymUrQEfGAoDogcEY1kQBprV9fDA2cmHuirWv7qcMFbFobwkSmdPD?=
=?windows-1250?q?HYmPxhL0djnzraXl3bMuLe5x2TVUEBU5FFipUB9ldUbyo8GWjfObmjWhjm?=
=?windows-1250?q?x8QPY/oa1XAVkEzICsZ4gWaLqKfP077F5nEuJacBgMujCLwLcrr12nPg/n?=
=?windows-1250?q?U94oxzr3rgG704t8QiirQG7xzLsDxBmljCUvAPVdsrYrlyJvP3u1ot8eGK?=
=?windows-1250?q?r1Zx8NJSjgu3eofjnmGOfug9GTHJbVOlzQ7Brs6BqKrvQHg7wRNzDZYiDW?=
=?windows-1250?q?HFjpNij0osFK5AUK8BQzhsTNfv9kf3zArWSCh45InJKP1pS4oG53LC00yN?=
=?windows-1250?q?x1KepEscF5lFGqRNmMmo7pZimrQuwVdwtFnpASO+1LGcKEjbzU=3D?=
MIME-Version: 1.0
X-OriginatorOrg: welotec.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: VI1PR04MB5373.eurprd04.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id:
75d60037-9840-4d18-f981-08db94c79204
X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Aug 2023 08:48:27.2174
(UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 25111a7f-1d5a-4c51-a4ca-7f8e44011b39
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname:
FslsPcfV1u0/RfNDX7Tm7avSw8oJCP0P4v5WLUYI0gf6Uq9eCCy5qR2TS4HpCC2lIPLz5Jcpwnp+aw4cnoWqag==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM9PR04MB8587
List-Id:
X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by
aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for
; Fri, 04 Aug 2023 08:48:37 -0000
X-Groupsio-URL:
https://lists.openembedded.org/g/openembedded-core/message/185518
Hi Alexandre, Richard,
I have finally fixed it and testes with `oe-selftest -r reproducible` tests. which resulted me with:
plobacz@latitude:/media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib$ oe-selftest -r reproducible
2023-08-03 10:31:57,100 - oe-selftest - INFO - Changing cwd to /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build
2023-08-03 10:31:57,100 - oe-selftest - INFO - Adding layer libraries:
2023-08-03 10:31:57,101 - oe-selftest - INFO - /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/meta/lib
2023-08-03 10:31:57,101 - oe-selftest - INFO - /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/meta-yocto-bsp/lib
2023-08-03 10:31:57,101 - oe-selftest - INFO - /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/meta-selftest/lib
2023-08-03 10:31:57,101 - oe-selftest - INFO - Running bitbake -e to test the configuration is valid/parsable
NOTE: Reconnecting to bitbake server...
NOTE: Retrying server connection (#1)... (10:31:58.417913)
NOTE: Reconnecting to bitbake server...
NOTE: Reconnecting to bitbake server...
NOTE: Retrying server connection (#1)... (10:31:58.417913)
NOTE: Retrying server connection (#1)... (10:31:58.417913)
NOTE: Starting bitbake server...
podpowiedź: Użycie „master” jako nawy początkowej gałęzi. Ta domyślna nazwa gałęzi
podpowiedź: może się zmienić. Aby ustawić nazwę początkowej gałęzi do użycia we
podpowiedź: wszystkich nowych repozytoriach, co uciszy ten komunikat, wykonaj:
podpowiedź:
podpowiedź: git config --global init.defaultBranch
podpowiedź:
podpowiedź: Tradycyjnie było „master”, a inne popularne to „main”, „trunk”
podpowiedź: i „development”. Nazwę właśnie utworzonej gałęzi można zmienić tym poleceniem:
podpowiedź:
podpowiedź: git branch -m
2023-08-03 10:32:00,173 - oe-selftest - INFO - Adding: "include selftest.inc" in /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/conf/local.conf
2023-08-03 10:32:00,174 - oe-selftest - INFO - Adding: "include bblayers.inc" in bblayers.conf
2023-08-03 10:32:00,174 - oe-selftest - INFO - test_diffoscope (reproducible.DiffoscopeTests)
2023-08-03 10:47:31,527 - oe-selftest - INFO - ... ok
2023-08-03 10:47:31,528 - oe-selftest - INFO - test_reproducible_builds (reproducible.ReproducibleTests)
2023-08-03 10:48:34,404 - oe-selftest - INFO - Building reproducibleA (sstate allowed)...
2023-08-03 12:11:54,419 - oe-selftest - INFO - Keepalive message
2023-08-03 13:35:14,459 - oe-selftest - INFO - Keepalive message
2023-08-03 14:58:34,500 - oe-selftest - INFO - Keepalive message
2023-08-03 16:21:54,537 - oe-selftest - INFO - Keepalive message
2023-08-03 17:45:14,574 - oe-selftest - INFO - Keepalive message
2023-08-03 19:08:34,618 - oe-selftest - INFO - Keepalive message
2023-08-03 19:31:24,469 - oe-selftest - INFO - Building reproducibleB (sstate NOT allowed)...
2023-08-03 20:54:44,489 - oe-selftest - INFO - Keepalive message
2023-08-03 22:18:04,509 - oe-selftest - INFO - Keepalive message
2023-08-03 23:41:24,579 - oe-selftest - INFO - Keepalive message
2023-08-04 01:04:44,794 - oe-selftest - INFO - Keepalive message
2023-08-04 02:28:04,857 - oe-selftest - INFO - Keepalive message
2023-08-04 03:51:24,904 - oe-selftest - INFO - Keepalive message
2023-08-04 04:19:26,061 - oe-selftest - INFO - Checking deb packages for differences...
2023-08-04 04:19:34,627 - oe-selftest - INFO - Reproducibility summary for deb: same=12137 different=0 different_excluded=2 missing=0 total=12139
unused_exclusions=['rust-dbg']
2023-08-04 04:19:34,661 - oe-selftest - INFO - Checking ipk packages for differences...
2023-08-04 04:19:42,786 - oe-selftest - INFO - Reproducibility summary for ipk: same=12127 different=0 different_excluded=2 missing=0 total=12129
unused_exclusions=['rust-dbg']
2023-08-04 04:19:42,830 - oe-selftest - INFO - Checking rpm packages for differences...
2023-08-04 04:19:52,644 - oe-selftest - INFO - Reproducibility summary for rpm: same=12127 different=0 different_excluded=2 missing=0 total=12129
unused_exclusions=['rust-dbg']
2023-08-04 04:19:52,738 - oe-selftest - INFO - ... ok
2023-08-04 04:27:21,489 - oe-selftest - INFO - ----------------------------------------------------------------------
2023-08-04 04:27:21,490 - oe-selftest - INFO - Ran 2 tests in 64523.097s
2023-08-04 04:27:21,490 - oe-selftest - INFO - OK
2023-08-04 04:27:25,783 - oe-selftest - INFO - RESULTS:
2023-08-04 04:27:25,783 - oe-selftest - INFO - RESULTS - reproducible.DiffoscopeTests.test_diffoscope: PASSED (931.35s)
2023-08-04 04:27:25,783 - oe-selftest - INFO - RESULTS - reproducible.ReproducibleTests.test_reproducible_builds: PASSED (63141.21s)
2023-08-04 04:27:27,913 - oe-selftest - INFO - SUMMARY:
2023-08-04 04:27:27,913 - oe-selftest - INFO - oe-selftest () - Ran 2 tests in 64523.097s
2023-08-04 04:27:27,913 - oe-selftest - INFO - oe-selftest - OK - All required tests passed (successes=2, skipped=0, failures=0, errors=0)
So I think that this will finally work as well for you.
BR
Piotr
Od: Piotr Łobacz
Wysłane: piątek, 4 sierpnia 2023 10:43
Do: openembedded-core@lists.openembedded.org
DW: Piotr Łobacz
Temat: [OE-Core][PATCH v12 1/7] path.py: add support for ACLs and all additional attributes
Extend `tar` command inside copytree() and copyhardlinktree() functions,
with additional parameters, in order to support ACLs and xattr. The posix
format doesn't need to be set in here, as GNU tar switches to it whenewer
is uses --acls and/or --xattrs parameters.
Additionaly change preservation of additional attributes for `cp` command
to all (meaning mode, ownership, timestamps etc.) not only xattrs, which
were previously.
Signed-off-by: Piotr Łobacz
---
meta/lib/oe/path.py | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/meta/lib/oe/path.py b/meta/lib/oe/path.py
index 0dc8f172d5..56e8e214ac 100644
--- a/meta/lib/oe/path.py
+++ b/meta/lib/oe/path.py
@@ -92,7 +92,7 @@ def copytree(src, dst):
# This way we also preserve hardlinks between files in the tree.
bb.utils.mkdirhier(dst)
- cmd = "tar --xattrs --xattrs-include='*' -cf - -S -C %s -p . | tar --xattrs --xattrs-include='*' -xf - -C %s" % (src, dst)
+ cmd = "tar --acls --xattrs --xattrs-include='*' -cf - -S -C %s -p . | tar --acls --xattrs --xattrs-include='*' -xf - -C %s" % (src, dst)
subprocess.check_output(cmd, shell=True, stderr=subprocess.STDOUT)
def copyhardlinktree(src, dst):
@@ -119,7 +119,7 @@ def copyhardlinktree(src, dst):
if (canhard):
# Need to copy directories only with tar first since cp will error if two
# writers try and create a directory at the same time
- cmd = "cd %s; find . -type d -print | tar --xattrs --xattrs-include='*' -cf - -S -C %s -p --no-recursion --files-from - | tar --xattrs --xattrs-include='*' -xhf - -C %s" % (src, src, dst)
+ cmd = "cd %s; find . -type d -print | tar --acls --xattrs --xattrs-include='*' -cf - -S -C %s -p --no-recursion --files-from - | tar --acls --xattrs --xattrs-include='*' -xhf - -C %s" % (src, src, dst)
subprocess.check_output(cmd, shell=True, stderr=subprocess.STDOUT)
source = ''
if os.path.isdir(src):
@@ -130,7 +130,7 @@ def copyhardlinktree(src, dst):
else:
source = src
s_dir = os.getcwd()
- cmd = 'cp -afl --preserve=xattr %s %s' % (source, os.path.realpath(dst))
+ cmd = 'cp -afl --preserve=all %s %s' % (source, os.path.realpath(dst))
subprocess.check_output(cmd, shell=True, cwd=s_dir, stderr=subprocess.STDOUT)
else:
copytree(src, dst)