diff mbox series

ODP: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr

Message ID AM6PR04MB5368ED123188D5223D0F14B7913CA@AM6PR04MB5368.eurprd04.prod.outlook.com
State New
Headers show
Series ODP: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr | expand

Commit Message

Piotr Łobacz July 22, 2023, 9:03 p.m. UTC
Hello Alexadre,
this time everything should be fixed and working :D I have tested it thrice:P

Additionally I've discovered that somehow, during all these patchsets, an extra param "--numeric-owner" has gone from opkg-build script,
which is important to store uid(s)/gid(s) as numbers instead of names in tar archive. An updated patch has been already pushed to opkg-utils
upstream.

You can run it and tell if everything is OK.

BR
Piotr


Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
Wysłane: sobota, 22 lipca 2023 22:55
Do: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
DW: Piotr Łobacz <p.lobacz@welotec.com>
Temat: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr

Extend OPKGBUILDCMD variable, with additional parameters, depending
on target distro features, in order to support ACLs and xattr.

With fix pushed to the opkg-devel:
https://groups.google.com/g/opkg-devel/c/dYNHrLjDwg8
opkg-build is able to create tar archives with ACLs and xattr.

Signed-off-by: Piotr Łobacz <p.lobacz@welotec.com>
---
 meta/classes-global/package_ipk.bbclass | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

--
2.34.1

Comments

Alexandre Belloni July 23, 2023, 3:04 p.m. UTC | #1
Hello,

On 22/07/2023 21:03:43+0000, Piotr Łobacz wrote:
> Hello Alexadre,
> this time everything should be fixed and working :D I have tested it thrice:P
> 
> Additionally I've discovered that somehow, during all these patchsets, an extra param "--numeric-owner" has gone from opkg-build script,
> which is important to store uid(s)/gid(s) as numbers instead of names in tar archive. An updated patch has been already pushed to opkg-utils
> upstream.
> 
> You can run it and tell if everything is OK.
> 

This ran and mostly worked. The remaining issue is the reproducibility
issue:

https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20230722-1a1a_7s6/

Unfortunately, diffoscope is not running on that large set.

> BR
> Piotr
> 
> 
> Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
> Wysłane: sobota, 22 lipca 2023 22:55
> Do: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
> DW: Piotr Łobacz <p.lobacz@welotec.com>
> Temat: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr
> 
> Extend OPKGBUILDCMD variable, with additional parameters, depending
> on target distro features, in order to support ACLs and xattr.
> 
> With fix pushed to the opkg-devel:
> https://groups.google.com/g/opkg-devel/c/dYNHrLjDwg8
> opkg-build is able to create tar archives with ACLs and xattr.
> 
> Signed-off-by: Piotr Łobacz <p.lobacz@welotec.com>
> ---
>  meta/classes-global/package_ipk.bbclass | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
> 
> diff --git a/meta/classes-global/package_ipk.bbclass b/meta/classes-global/package_ipk.bbclass
> index b4b7bc9ac2..a0f106e4ad 100644
> --- a/meta/classes-global/package_ipk.bbclass
> +++ b/meta/classes-global/package_ipk.bbclass
> @@ -15,7 +15,7 @@ IPKGCONF_SDK_TARGET = "${WORKDIR}/opkg-sdk-target.conf"
>  PKGWRITEDIRIPK = "${WORKDIR}/deploy-ipks"
> 
>  # Program to be used to build opkg packages
> -OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}"'
> +OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}" ${@bb.utils.contains('DISTRO_FEATURES', 'acl', '-A', '', d)} ${@bb.utils.contains('DISTRO_FEATURES', 'xattr', '-X', '', d)}'
> 
>  OPKG_ARGS += "--force_postinstall --prefer-arch-to-version"
>  OPKG_ARGS += "${@['', '--no-install-recommends'][d.getVar("NO_RECOMMENDATIONS") == "1"]}"
> --
> 2.34.1

> 
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#184740): https://lists.openembedded.org/g/openembedded-core/message/184740
> Mute This Topic: https://lists.openembedded.org/mt/100301979/3617179
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [alexandre.belloni@bootlin.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
Piotr Łobacz July 23, 2023, 3:53 p.m. UTC | #2
Hi,

> Hello,
>
> On 22/07/2023 21:03:43+0000, Piotr Łobacz wrote:
> > Hello Alexadre,
> > this time everything should be fixed and working :D I have tested it thrice:P
> >
> > Additionally I've discovered that somehow, during all these patchsets, an extra param "--numeric-owner" has gone from opkg-build script,
> > which is important to store uid(s)/gid(s) as numbers instead of names in tar archive. An updated patch has been already pushed to opkg-utils
> > upstream.
> >
> > You can run it and tell if everything is OK.
> >
>
> This ran and mostly worked. The remaining issue is the reproducibility
> issue:

I'm glad that we went further in this problem, but
> https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20230722-1a1a_7s6/

> Unfortunately, diffoscope is not running on that large set.

unfortunately I don't have knowledge what's this link about. Can you explain me a little bit and how is this being run from cli?

> BR
> Piotr
>
>
> Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
> Wysłane: sobota, 22 lipca 2023 22:55
> Do: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
> DW: Piotr Łobacz <p.lobacz@welotec.com>
> Temat: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr
>
> Extend OPKGBUILDCMD variable, with additional parameters, depending
> on target distro features, in order to support ACLs and xattr.
>
> With fix pushed to the opkg-devel:
> https://groups.google.com/g/opkg-devel/c/dYNHrLjDwg8
> opkg-build is able to create tar archives with ACLs and xattr.
>
> Signed-off-by: Piotr Łobacz <p.lobacz@welotec.com>
> ---
>  meta/classes-global/package_ipk.bbclass | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
>
> diff --git a/meta/classes-global/package_ipk.bbclass b/meta/classes-global/package_ipk.bbclass
> index b4b7bc9ac2..a0f106e4ad 100644
> --- a/meta/classes-global/package_ipk.bbclass
> +++ b/meta/classes-global/package_ipk.bbclass
> @@ -15,7 +15,7 @@ IPKGCONF_SDK_TARGET = "${WORKDIR}/opkg-sdk-target.conf"
>  PKGWRITEDIRIPK = "${WORKDIR}/deploy-ipks"
>
>  # Program to be used to build opkg packages
> -OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}"'
> +OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}" ${@bb.utils.contains('DISTRO_FEATURES', 'acl', '-A', '', d)} ${@bb.utils.contains('DISTRO_FEATURES', 'xattr', '-X', '', d)}'
>
>  OPKG_ARGS += "--force_postinstall --prefer-arch-to-version"
>  OPKG_ARGS += "${@['', '--no-install-recommends'][d.getVar("NO_RECOMMENDATIONS") == "1"]}"
> --
> 2.34.1

>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#184740): https://lists.openembedded.org/g/openembedded-core/message/184740
> Mute This Topic: https://lists.openembedded.org/mt/100301979/3617179
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [alexandre.belloni@bootlin.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>


--
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com/
Piotr Łobacz July 23, 2023, 4:32 p.m. UTC | #3
OK, I got it, but correct me if I'm wrong, namely packages differs between builds?

I have found this link https://docs.yoctoproject.org/dev/test-manual/reproducible-builds.html for it with instructions
on how to reproduce it. I'll give it a try and In case of problems will try to ask.

Cheers,
Piotr

Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
Wysłane: niedziela, 23 lipca 2023 17:53
Do: Alexandre Belloni <alexandre.belloni@bootlin.com>
DW: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
Temat: ODP: ODP: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr

Hi,

> Hello,
>
> On 22/07/2023 21:03:43+0000, Piotr Łobacz wrote:
> > Hello Alexadre,
> > this time everything should be fixed and working :D I have tested it thrice:P
> >
> > Additionally I've discovered that somehow, during all these patchsets, an extra param "--numeric-owner" has gone from opkg-build script,
> > which is important to store uid(s)/gid(s) as numbers instead of names in tar archive. An updated patch has been already pushed to opkg-utils
> > upstream.
> >
> > You can run it and tell if everything is OK.
> >
>
> This ran and mostly worked. The remaining issue is the reproducibility
> issue:

I'm glad that we went further in this problem, but
> https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20230722-1a1a_7s6/

> Unfortunately, diffoscope is not running on that large set.

unfortunately I don't have knowledge what's this link about. Can you explain me a little bit and how is this being run from cli?

> BR
> Piotr
>
>
> Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
> Wysłane: sobota, 22 lipca 2023 22:55
> Do: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
> DW: Piotr Łobacz <p.lobacz@welotec.com>
> Temat: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr
>
> Extend OPKGBUILDCMD variable, with additional parameters, depending
> on target distro features, in order to support ACLs and xattr.
>
> With fix pushed to the opkg-devel:
> https://groups.google.com/g/opkg-devel/c/dYNHrLjDwg8
> opkg-build is able to create tar archives with ACLs and xattr.
>
> Signed-off-by: Piotr Łobacz <p.lobacz@welotec.com>
> ---
>  meta/classes-global/package_ipk.bbclass | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
>
> diff --git a/meta/classes-global/package_ipk.bbclass b/meta/classes-global/package_ipk.bbclass
> index b4b7bc9ac2..a0f106e4ad 100644
> --- a/meta/classes-global/package_ipk.bbclass
> +++ b/meta/classes-global/package_ipk.bbclass
> @@ -15,7 +15,7 @@ IPKGCONF_SDK_TARGET = "${WORKDIR}/opkg-sdk-target.conf"
>  PKGWRITEDIRIPK = "${WORKDIR}/deploy-ipks"
>
>  # Program to be used to build opkg packages
> -OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}"'
> +OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}" ${@bb.utils.contains('DISTRO_FEATURES', 'acl', '-A', '', d)} ${@bb.utils.contains('DISTRO_FEATURES', 'xattr', '-X', '', d)}'
>
>  OPKG_ARGS += "--force_postinstall --prefer-arch-to-version"
>  OPKG_ARGS += "${@['', '--no-install-recommends'][d.getVar("NO_RECOMMENDATIONS") == "1"]}"
> --
> 2.34.1

>
>
>


--
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com/
Alexandre Belloni July 23, 2023, 10:23 p.m. UTC | #4
On 23/07/2023 16:32:55+0000, Piotr Łobacz wrote:
> OK, I got it, but correct me if I'm wrong, namely packages differs between builds?
> 
> I have found this link https://docs.yoctoproject.org/dev/test-manual/reproducible-builds.html for it with instructions
> on how to reproduce it. I'll give it a try and In case of problems will try to ask.
> 

You will find the packages that differ in reproducibleA and
reproducibleB so you can compare them yourself.

> Cheers,
> Piotr
> 
> Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
> Wysłane: niedziela, 23 lipca 2023 17:53
> Do: Alexandre Belloni <alexandre.belloni@bootlin.com>
> DW: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
> Temat: ODP: ODP: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr
> 
> Hi,
> 
> > Hello,
> >
> > On 22/07/2023 21:03:43+0000, Piotr Łobacz wrote:
> > > Hello Alexadre,
> > > this time everything should be fixed and working :D I have tested it thrice:P
> > >
> > > Additionally I've discovered that somehow, during all these patchsets, an extra param "--numeric-owner" has gone from opkg-build script,
> > > which is important to store uid(s)/gid(s) as numbers instead of names in tar archive. An updated patch has been already pushed to opkg-utils
> > > upstream.
> > >
> > > You can run it and tell if everything is OK.
> > >
> >
> > This ran and mostly worked. The remaining issue is the reproducibility
> > issue:
> 
> I'm glad that we went further in this problem, but
> > https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20230722-1a1a_7s6/
> 
> > Unfortunately, diffoscope is not running on that large set.
> 
> unfortunately I don't have knowledge what's this link about. Can you explain me a little bit and how is this being run from cli?
> 
> > BR
> > Piotr
> >
> >
> > Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
> > Wysłane: sobota, 22 lipca 2023 22:55
> > Do: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
> > DW: Piotr Łobacz <p.lobacz@welotec.com>
> > Temat: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr
> >
> > Extend OPKGBUILDCMD variable, with additional parameters, depending
> > on target distro features, in order to support ACLs and xattr.
> >
> > With fix pushed to the opkg-devel:
> > https://groups.google.com/g/opkg-devel/c/dYNHrLjDwg8
> > opkg-build is able to create tar archives with ACLs and xattr.
> >
> > Signed-off-by: Piotr Łobacz <p.lobacz@welotec.com>
> > ---
> >  meta/classes-global/package_ipk.bbclass | 2 +-
> >  1 file changed, 1 insertion(+), 1 deletion(-)
> >
> > diff --git a/meta/classes-global/package_ipk.bbclass b/meta/classes-global/package_ipk.bbclass
> > index b4b7bc9ac2..a0f106e4ad 100644
> > --- a/meta/classes-global/package_ipk.bbclass
> > +++ b/meta/classes-global/package_ipk.bbclass
> > @@ -15,7 +15,7 @@ IPKGCONF_SDK_TARGET = "${WORKDIR}/opkg-sdk-target.conf"
> >  PKGWRITEDIRIPK = "${WORKDIR}/deploy-ipks"
> >
> >  # Program to be used to build opkg packages
> > -OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}"'
> > +OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}" ${@bb.utils.contains('DISTRO_FEATURES', 'acl', '-A', '', d)} ${@bb.utils.contains('DISTRO_FEATURES', 'xattr', '-X', '', d)}'
> >
> >  OPKG_ARGS += "--force_postinstall --prefer-arch-to-version"
> >  OPKG_ARGS += "${@['', '--no-install-recommends'][d.getVar("NO_RECOMMENDATIONS") == "1"]}"
> > --
> > 2.34.1
> 
> >
> >
> >
> 
> 
> --
> Alexandre Belloni, co-owner and COO, Bootlin
> Embedded Linux and Kernel engineering
> https://bootlin.com/

> 
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#184761): https://lists.openembedded.org/g/openembedded-core/message/184761
> Mute This Topic: https://lists.openembedded.org/mt/100313731/3617179
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [alexandre.belloni@bootlin.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
Piotr Łobacz July 23, 2023, 11:05 p.m. UTC | #5
Hi, on your advice I have taken the first package and run diffoscope which has given me such result:

plobacz@latitude:~/workspace/reproducible$ diffoscope A/a52dec-doc_0.7.4-r4_core2-64.ipk B/a52dec-doc_0.7.4-r4_core2-64.ipk
--- A/a52dec-doc_0.7.4-r4_core2-64.ipk
+++ B/a52dec-doc_0.7.4-r4_core2-64.ipk
├── file list
│ @@ -1,3 +1,3 @@
│  ?rw-r--r--   0        0        0        4 1970-01-01 00:00:00.000000 debian-binary
│ -?rw-r--r--   0        0        0      504 1970-01-01 00:00:00.000000 control.tar.gz
│ -?rw-r--r--   0        0        0     1236 1970-01-01 00:00:00.000000 data.tar.xz
│ +?rw-r--r--   0        0        0      503 1970-01-01 00:00:00.000000 control.tar.gz
│ +?rw-r--r--   0        0        0     1240 1970-01-01 00:00:00.000000 data.tar.xz
├── control.tar.gz
│ ├── control.tar
│ │┄ Format-specific differences are supported for tape archives (.tar) but no file-specific differences were detected; falling back to a binary diff. file(1) reports: POSIX tar archive
│ │ @@ -26,18 +26,18 @@
│ │  00000190: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00000200: 3330 2061 7469 6d65 3d31 3639 3030 3733  30 atime=1690073
│ │ -00000210: 3231 352e 3839 3835 3637 3730 310a 3330  215.898567701.30
│ │ -00000220: 2063 7469 6d65 3d31 3639 3030 3733 3231   ctime=169007321
│ │ -00000230: 352e 3631 3735 3635 3337 350a 0000 0000  5.617565375.....
│ │ +00000200: 3330 2061 7469 6d65 3d31 3639 3030 3831  30 atime=1690081
│ │ +00000210: 3433 312e 3335 3033 3137 3933 340a 3330  431.350317934.30
│ │ +00000220: 2063 7469 6d65 3d31 3639 3030 3831 3433   ctime=169008143
│ │ +00000230: 312e 3133 3633 3136 3136 350a 0000 0000  1.136316165.....
│ │  00000240: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000250: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000260: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000270: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000280: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000290: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000002a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
├── data.tar.xz
│ ├── data.tar
│ │┄ Format-specific differences are supported for this file format but no file-specific differences were detected; falling back to a binary diff. file(1) reports: POSIX tar archive
│ │ @@ -26,18 +26,18 @@
│ │  00000190: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00000200: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00000210: 3132 332e 3039 3835 3135 3131 330a 3330  123.098515113.30
│ │ -00000220: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00000230: 322e 3634 3134 3832 3935 380a 0000 0000  2.641482958.....
│ │ +00000200: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00000210: 3336 362e 3735 3039 3333 3932 310a 3330  366.750933921.30
│ │ +00000220: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00000230: 362e 3639 3139 3333 3433 330a 0000 0000  6.691933433.....
│ │  00000240: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000250: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000260: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000270: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000280: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000290: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000002a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ @@ -122,18 +122,18 @@
│ │  00000790: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00000800: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00000810: 3132 332e 3039 3835 3135 3131 330a 3330  123.098515113.30
│ │ -00000820: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00000830: 322e 3634 3134 3832 3935 380a 0000 0000  2.641482958.....
│ │ +00000800: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00000810: 3336 362e 3735 3039 3333 3932 310a 3330  366.750933921.30
│ │ +00000820: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00000830: 362e 3639 3139 3333 3433 330a 0000 0000  6.691933433.....
│ │  00000840: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000850: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000860: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000870: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000880: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000890: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000008a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ @@ -218,18 +218,18 @@
│ │  00000d90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000da0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000db0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000dc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000dd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000de0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000df0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00000e00: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00000e10: 3132 332e 3039 3935 3135 3132 320a 3330  123.099515122.30
│ │ -00000e20: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00000e30: 322e 3634 3134 3832 3935 380a 0000 0000  2.641482958.....
│ │ +00000e00: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00000e10: 3336 362e 3639 3239 3333 3434 310a 3330  366.692933441.30
│ │ +00000e20: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00000e30: 362e 3639 3139 3333 3433 330a 0000 0000  6.691933433.....
│ │  00000e40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000e50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000e60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000e70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000e80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000e90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000ea0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ @@ -314,18 +314,18 @@
│ │  00001390: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00001400: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00001410: 3132 332e 3039 3935 3135 3132 320a 3330  123.099515122.30
│ │ -00001420: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00001430: 322e 3634 3134 3832 3935 380a 0000 0000  2.641482958.....
│ │ +00001400: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00001410: 3336 362e 3735 3139 3333 3932 390a 3330  366.751933929.30
│ │ +00001420: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00001430: 362e 3639 3239 3333 3434 310a 0000 0000  6.692933441.....
│ │  00001440: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001450: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001460: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001470: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001480: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001490: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000014a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ @@ -386,16 +386,16 @@
│ │  00001810: 6d61 6e31 2f50 6178 4865 6164 6572 732f  man1/PaxHeaders/
│ │  00001820: 6135 3264 6563 2e31 0000 0000 0000 0000  a52dec.1........
│ │  00001830: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001840: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001850: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001860: 0000 0000 3030 3030 3634 3400 3030 3030  ....0000644.0000
│ │  00001870: 3030 3000 3030 3030 3030 3000 3030 3030  000.0000000.0000
│ │ -00001880: 3030 3030 3037 3300 3037 3532 3036 3635  0000073.07520665
│ │ -00001890: 3034 3100 3031 3437 3531 0020 7800 0000  041.014751. x...
│ │ +00001880: 3030 3030 3037 3200 3037 3532 3036 3635  0000072.07520665
│ │ +00001890: 3034 3100 3031 3437 3530 0020 7800 0000  041.014750. x...
│ │  000018a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000018b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000018c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000018d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000018e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000018f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001900: 0075 7374 6172 0030 3000 0000 0000 0000  .ustar.00.......
│ │ @@ -410,18 +410,18 @@
│ │  00001990: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00001a00: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00001a10: 3132 332e 3134 3435 3135 3439 330a 3239  123.144515493.29
│ │ -00001a20: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00001a30: 322e 3634 3034 3832 3935 0a00 0000 0000  2.64048295......
│ │ +00001a00: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00001a10: 3336 362e 3737 3939 3334 3136 310a 3238  366.779934161.28
│ │ +00001a20: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00001a30: 362e 3637 3539 3333 330a 0000 0000 0000  6.6759333.......
│ │  00001a40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001a50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001a60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001a70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001a80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001a90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001aa0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ @@ -578,16 +578,16 @@
│ │  00002410: 6d61 6e31 2f50 6178 4865 6164 6572 732f  man1/PaxHeaders/
│ │  00002420: 6578 7472 6163 745f 6135 322e 3100 0000  extract_a52.1...
│ │  00002430: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002440: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002450: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002460: 0000 0000 3030 3030 3634 3400 3030 3030  ....0000644.0000
│ │  00002470: 3030 3000 3030 3030 3030 3000 3030 3030  000.0000000.0000
│ │ -00002480: 3030 3030 3037 3300 3037 3532 3036 3635  0000073.07520665
│ │ -00002490: 3034 3100 3031 3630 3237 0020 7800 0000  041.016027. x...
│ │ +00002480: 3030 3030 3037 3200 3037 3532 3036 3635  0000072.07520665
│ │ +00002490: 3034 3100 3031 3630 3236 0020 7800 0000  041.016026. x...
│ │  000024a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000024b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000024c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000024d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000024e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000024f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002500: 0075 7374 6172 0030 3000 0000 0000 0000  .ustar.00.......
│ │ @@ -602,18 +602,18 @@
│ │  00002590: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00002600: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00002610: 3132 332e 3134 3835 3135 3532 360a 3239  123.148515526.29
│ │ -00002620: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00002630: 322e 3634 3034 3832 3935 0a00 0000 0000  2.64048295......
│ │ +00002600: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00002610: 3336 362e 3738 3039 3334 3136 390a 3238  366.780934169.28
│ │ +00002620: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00002630: 362e 3637 3539 3333 330a 0000 0000 0000  6.6759333.......
│ │  00002640: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002650: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002660: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002670: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002680: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002690: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000026a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................

Then, again another first best package which occurred to be openssl_3.1.1-r0_core2-64.ipk and also the same issue. The difference between atime and ctime...

So, in principle the only difference is the date of creation.

I have my suspicions that probably due to the usage of posix format for tar command in opkg-build script these dates differes, but I need to investigate it and maybe consult it with tar developers.

BR
Piotr
________________________________
Od: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wysłane: poniedziałek, 24 lipca 2023 00:23
Do: Piotr Łobacz <p.lobacz@welotec.com>
DW: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
Temat: Re: ODP: ODP: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr

On 23/07/2023 16:32:55+0000, Piotr Łobacz wrote:
> OK, I got it, but correct me if I'm wrong, namely packages differs between builds?
>
> I have found this link https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.yoctoproject.org%2Fdev%2Ftest-manual%2Freproducible-builds.html&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ZKFRDOAbZeeVezYGVUislVmmeJWSCuYq%2BKc6m1KNDhE%3D&reserved=0<https://docs.yoctoproject.org/dev/test-manual/reproducible-builds.html> for it with instructions
> on how to reproduce it. I'll give it a try and In case of problems will try to ask.
>

You will find the packages that differ in reproducibleA and
reproducibleB so you can compare them yourself.

> Cheers,
> Piotr
>
> Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
> Wysłane: niedziela, 23 lipca 2023 17:53
> Do: Alexandre Belloni <alexandre.belloni@bootlin.com>
> DW: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
> Temat: ODP: ODP: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr
>
> Hi,
>
> > Hello,
> >
> > On 22/07/2023 21:03:43+0000, Piotr Łobacz wrote:
> > > Hello Alexadre,
> > > this time everything should be fixed and working :D I have tested it thrice:P
> > >
> > > Additionally I've discovered that somehow, during all these patchsets, an extra param "--numeric-owner" has gone from opkg-build script,
> > > which is important to store uid(s)/gid(s) as numbers instead of names in tar archive. An updated patch has been already pushed to opkg-utils
> > > upstream.
> > >
> > > You can run it and tell if everything is OK.
> > >
> >
> > This ran and mostly worked. The remaining issue is the reproducibility
> > issue:
>
> I'm glad that we went further in this problem, but
> > https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fautobuilder.yocto.io%2Fpub%2Frepro-fail%2Foe-reproducible-20230722-1a1a_7s6%2F&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=YVG%2FJi2GxHwFsiUXfavP7E2csBVZqlBdhHievqSXIeU%3D&reserved=0<https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20230722-1a1a_7s6/>
>
> > Unfortunately, diffoscope is not running on that large set.
>
> unfortunately I don't have knowledge what's this link about. Can you explain me a little bit and how is this being run from cli?
>
> > BR
> > Piotr
> >
> >
> > Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
> > Wysłane: sobota, 22 lipca 2023 22:55
> > Do: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
> > DW: Piotr Łobacz <p.lobacz@welotec.com>
> > Temat: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr
> >
> > Extend OPKGBUILDCMD variable, with additional parameters, depending
> > on target distro features, in order to support ACLs and xattr.
> >
> > With fix pushed to the opkg-devel:
> > https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fg%2Fopkg-devel%2Fc%2FdYNHrLjDwg8&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yMHEGByP9mdHE7TVlx8embVuXdqZeVlk%2BcUcIu8dwNI%3D&reserved=0<https://groups.google.com/g/opkg-devel/c/dYNHrLjDwg8>
> > opkg-build is able to create tar archives with ACLs and xattr.
> >
> > Signed-off-by: Piotr Łobacz <p.lobacz@welotec.com>
> > ---
> >  meta/classes-global/package_ipk.bbclass | 2 +-
> >  1 file changed, 1 insertion(+), 1 deletion(-)
> >
> > diff --git a/meta/classes-global/package_ipk.bbclass b/meta/classes-global/package_ipk.bbclass
> > index b4b7bc9ac2..a0f106e4ad 100644
> > --- a/meta/classes-global/package_ipk.bbclass
> > +++ b/meta/classes-global/package_ipk.bbclass
> > @@ -15,7 +15,7 @@ IPKGCONF_SDK_TARGET = "${WORKDIR}/opkg-sdk-target.conf"
> >  PKGWRITEDIRIPK = "${WORKDIR}/deploy-ipks"
> >
> >  # Program to be used to build opkg packages
> > -OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}"'
> > +OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}" ${@bb.utils.contains('DISTRO_FEATURES', 'acl', '-A', '', d)} ${@bb.utils.contains('DISTRO_FEATURES', 'xattr', '-X', '', d)}'
> >
> >  OPKG_ARGS += "--force_postinstall --prefer-arch-to-version"
> >  OPKG_ARGS += "${@['', '--no-install-recommends'][d.getVar("NO_RECOMMENDATIONS") == "1"]}"
> > --
> > 2.34.1
>
> >
> >
> >
>
>
> --
> Alexandre Belloni, co-owner and COO, Bootlin
> Embedded Linux and Kernel engineering
> https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbootlin.com%2F&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6%2By9Umym57B4b3VZloHOo9CgfGD%2BUexNqfGxtfeIoNA%3D&reserved=0<https://bootlin.com/>

>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#184761): https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.openembedded.org%2Fg%2Fopenembedded-core%2Fmessage%2F184761&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=SYXdJ8dve90A6x8BY5ZD0BvEhYGt5k3fuQeN9Fc7HQs%3D&reserved=0<https://lists.openembedded.org/g/openembedded-core/message/184761>
> Mute This Topic: https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.openembedded.org%2Fmt%2F100313731%2F3617179&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dDMSyaOwoS2iYTerBSaaJJbZP%2BjdwyOvCJStDrPEmS4%3D&reserved=0<https://lists.openembedded.org/mt/100313731/3617179>
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.openembedded.org%2Fg%2Fopenembedded-core%2Funsub&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=guMVOu35BzphIon5DP%2FJ9whcOMyFanYapzoUcbkgyPk%3D&reserved=0<https://lists.openembedded.org/g/openembedded-core/unsub> [alexandre.belloni@bootlin.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>


--
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbootlin.com%2F&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6%2By9Umym57B4b3VZloHOo9CgfGD%2BUexNqfGxtfeIoNA%3D&reserved=0<https://bootlin.com/>
Piotr Łobacz July 24, 2023, 9:36 a.m. UTC | #6
OK, I have done some testings and confirmed that for posix format, tar does not care about mtime parameter and need to investigate on how to fix it...

With gnu format everything is working fine:D but than acls and xattrs are not supported.

BR
Piotr
________________________________
Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
Wysłane: poniedziałek, 24 lipca 2023 01:05
Do: Alexandre Belloni <alexandre.belloni@bootlin.com>; Alex Stewart <alex.stewart@ni.com>
DW: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
Temat: ODP: ODP: ODP: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr

Hi, on your advice I have taken the first package and run diffoscope which has given me such result:

plobacz@latitude:~/workspace/reproducible$ diffoscope A/a52dec-doc_0.7.4-r4_core2-64.ipk B/a52dec-doc_0.7.4-r4_core2-64.ipk
--- A/a52dec-doc_0.7.4-r4_core2-64.ipk
+++ B/a52dec-doc_0.7.4-r4_core2-64.ipk
├── file list
│ @@ -1,3 +1,3 @@
│  ?rw-r--r--   0        0        0        4 1970-01-01 00:00:00.000000 debian-binary
│ -?rw-r--r--   0        0        0      504 1970-01-01 00:00:00.000000 control.tar.gz
│ -?rw-r--r--   0        0        0     1236 1970-01-01 00:00:00.000000 data.tar.xz
│ +?rw-r--r--   0        0        0      503 1970-01-01 00:00:00.000000 control.tar.gz
│ +?rw-r--r--   0        0        0     1240 1970-01-01 00:00:00.000000 data.tar.xz
├── control.tar.gz
│ ├── control.tar
│ │┄ Format-specific differences are supported for tape archives (.tar) but no file-specific differences were detected; falling back to a binary diff. file(1) reports: POSIX tar archive
│ │ @@ -26,18 +26,18 @@
│ │  00000190: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00000200: 3330 2061 7469 6d65 3d31 3639 3030 3733  30 atime=1690073
│ │ -00000210: 3231 352e 3839 3835 3637 3730 310a 3330  215.898567701.30
│ │ -00000220: 2063 7469 6d65 3d31 3639 3030 3733 3231   ctime=169007321
│ │ -00000230: 352e 3631 3735 3635 3337 350a 0000 0000  5.617565375.....
│ │ +00000200: 3330 2061 7469 6d65 3d31 3639 3030 3831  30 atime=1690081
│ │ +00000210: 3433 312e 3335 3033 3137 3933 340a 3330  431.350317934.30
│ │ +00000220: 2063 7469 6d65 3d31 3639 3030 3831 3433   ctime=169008143
│ │ +00000230: 312e 3133 3633 3136 3136 350a 0000 0000  1.136316165.....
│ │  00000240: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000250: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000260: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000270: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000280: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000290: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000002a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
├── data.tar.xz
│ ├── data.tar
│ │┄ Format-specific differences are supported for this file format but no file-specific differences were detected; falling back to a binary diff. file(1) reports: POSIX tar archive
│ │ @@ -26,18 +26,18 @@
│ │  00000190: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000001f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00000200: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00000210: 3132 332e 3039 3835 3135 3131 330a 3330  123.098515113.30
│ │ -00000220: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00000230: 322e 3634 3134 3832 3935 380a 0000 0000  2.641482958.....
│ │ +00000200: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00000210: 3336 362e 3735 3039 3333 3932 310a 3330  366.750933921.30
│ │ +00000220: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00000230: 362e 3639 3139 3333 3433 330a 0000 0000  6.691933433.....
│ │  00000240: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000250: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000260: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000270: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000280: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000290: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000002a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ @@ -122,18 +122,18 @@
│ │  00000790: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000007f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00000800: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00000810: 3132 332e 3039 3835 3135 3131 330a 3330  123.098515113.30
│ │ -00000820: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00000830: 322e 3634 3134 3832 3935 380a 0000 0000  2.641482958.....
│ │ +00000800: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00000810: 3336 362e 3735 3039 3333 3932 310a 3330  366.750933921.30
│ │ +00000820: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00000830: 362e 3639 3139 3333 3433 330a 0000 0000  6.691933433.....
│ │  00000840: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000850: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000860: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000870: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000880: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000890: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000008a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ @@ -218,18 +218,18 @@
│ │  00000d90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000da0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000db0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000dc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000dd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000de0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000df0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00000e00: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00000e10: 3132 332e 3039 3935 3135 3132 320a 3330  123.099515122.30
│ │ -00000e20: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00000e30: 322e 3634 3134 3832 3935 380a 0000 0000  2.641482958.....
│ │ +00000e00: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00000e10: 3336 362e 3639 3239 3333 3434 310a 3330  366.692933441.30
│ │ +00000e20: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00000e30: 362e 3639 3139 3333 3433 330a 0000 0000  6.691933433.....
│ │  00000e40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000e50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000e60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000e70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000e80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000e90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00000ea0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ @@ -314,18 +314,18 @@
│ │  00001390: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000013f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00001400: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00001410: 3132 332e 3039 3935 3135 3132 320a 3330  123.099515122.30
│ │ -00001420: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00001430: 322e 3634 3134 3832 3935 380a 0000 0000  2.641482958.....
│ │ +00001400: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00001410: 3336 362e 3735 3139 3333 3932 390a 3330  366.751933929.30
│ │ +00001420: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00001430: 362e 3639 3239 3333 3434 310a 0000 0000  6.692933441.....
│ │  00001440: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001450: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001460: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001470: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001480: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001490: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000014a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ @@ -386,16 +386,16 @@
│ │  00001810: 6d61 6e31 2f50 6178 4865 6164 6572 732f  man1/PaxHeaders/
│ │  00001820: 6135 3264 6563 2e31 0000 0000 0000 0000  a52dec.1........
│ │  00001830: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001840: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001850: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001860: 0000 0000 3030 3030 3634 3400 3030 3030  ....0000644.0000
│ │  00001870: 3030 3000 3030 3030 3030 3000 3030 3030  000.0000000.0000
│ │ -00001880: 3030 3030 3037 3300 3037 3532 3036 3635  0000073.07520665
│ │ -00001890: 3034 3100 3031 3437 3531 0020 7800 0000  041.014751. x...
│ │ +00001880: 3030 3030 3037 3200 3037 3532 3036 3635  0000072.07520665
│ │ +00001890: 3034 3100 3031 3437 3530 0020 7800 0000  041.014750. x...
│ │  000018a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000018b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000018c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000018d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000018e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000018f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001900: 0075 7374 6172 0030 3000 0000 0000 0000  .ustar.00.......
│ │ @@ -410,18 +410,18 @@
│ │  00001990: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000019f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00001a00: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00001a10: 3132 332e 3134 3435 3135 3439 330a 3239  123.144515493.29
│ │ -00001a20: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00001a30: 322e 3634 3034 3832 3935 0a00 0000 0000  2.64048295......
│ │ +00001a00: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00001a10: 3336 362e 3737 3939 3334 3136 310a 3238  366.779934161.28
│ │ +00001a20: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00001a30: 362e 3637 3539 3333 330a 0000 0000 0000  6.6759333.......
│ │  00001a40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001a50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001a60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001a70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001a80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001a90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00001aa0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ @@ -578,16 +578,16 @@
│ │  00002410: 6d61 6e31 2f50 6178 4865 6164 6572 732f  man1/PaxHeaders/
│ │  00002420: 6578 7472 6163 745f 6135 322e 3100 0000  extract_a52.1...
│ │  00002430: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002440: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002450: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002460: 0000 0000 3030 3030 3634 3400 3030 3030  ....0000644.0000
│ │  00002470: 3030 3000 3030 3030 3030 3000 3030 3030  000.0000000.0000
│ │ -00002480: 3030 3030 3037 3300 3037 3532 3036 3635  0000073.07520665
│ │ -00002490: 3034 3100 3031 3630 3237 0020 7800 0000  041.016027. x...
│ │ +00002480: 3030 3030 3037 3200 3037 3532 3036 3635  0000072.07520665
│ │ +00002490: 3034 3100 3031 3630 3236 0020 7800 0000  041.016026. x...
│ │  000024a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000024b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000024c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000024d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000024e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000024f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002500: 0075 7374 6172 0030 3000 0000 0000 0000  .ustar.00.......
│ │ @@ -602,18 +602,18 @@
│ │  00002590: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000025f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │ -00002600: 3330 2061 7469 6d65 3d31 3639 3030 3732  30 atime=1690072
│ │ -00002610: 3132 332e 3134 3835 3135 3532 360a 3239  123.148515526.29
│ │ -00002620: 2063 7469 6d65 3d31 3639 3030 3730 3136   ctime=169007016
│ │ -00002630: 322e 3634 3034 3832 3935 0a00 0000 0000  2.64048295......
│ │ +00002600: 3330 2061 7469 6d65 3d31 3639 3030 3737  30 atime=1690077
│ │ +00002610: 3336 362e 3738 3039 3334 3136 390a 3238  366.780934169.28
│ │ +00002620: 2063 7469 6d65 3d31 3639 3030 3737 3336   ctime=169007736
│ │ +00002630: 362e 3637 3539 3333 330a 0000 0000 0000  6.6759333.......
│ │  00002640: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002650: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002660: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002670: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002680: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  00002690: 0000 0000 0000 0000 0000 0000 0000 0000  ................
│ │  000026a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................

Then, again another first best package which occurred to be openssl_3.1.1-r0_core2-64.ipk and also the same issue. The difference between atime and ctime...

So, in principle the only difference is the date of creation.

I have my suspicions that probably due to the usage of posix format for tar command in opkg-build script these dates differes, but I need to investigate it and maybe consult it with tar developers.

BR
Piotr
________________________________
Od: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wysłane: poniedziałek, 24 lipca 2023 00:23
Do: Piotr Łobacz <p.lobacz@welotec.com>
DW: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
Temat: Re: ODP: ODP: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr

On 23/07/2023 16:32:55+0000, Piotr Łobacz wrote:
> OK, I got it, but correct me if I'm wrong, namely packages differs between builds?
>
> I have found this link https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.yoctoproject.org%2Fdev%2Ftest-manual%2Freproducible-builds.html&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ZKFRDOAbZeeVezYGVUislVmmeJWSCuYq%2BKc6m1KNDhE%3D&reserved=0<https://docs.yoctoproject.org/dev/test-manual/reproducible-builds.html> for it with instructions
> on how to reproduce it. I'll give it a try and In case of problems will try to ask.
>

You will find the packages that differ in reproducibleA and
reproducibleB so you can compare them yourself.

> Cheers,
> Piotr
>
> Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
> Wysłane: niedziela, 23 lipca 2023 17:53
> Do: Alexandre Belloni <alexandre.belloni@bootlin.com>
> DW: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
> Temat: ODP: ODP: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr
>
> Hi,
>
> > Hello,
> >
> > On 22/07/2023 21:03:43+0000, Piotr Łobacz wrote:
> > > Hello Alexadre,
> > > this time everything should be fixed and working :D I have tested it thrice:P
> > >
> > > Additionally I've discovered that somehow, during all these patchsets, an extra param "--numeric-owner" has gone from opkg-build script,
> > > which is important to store uid(s)/gid(s) as numbers instead of names in tar archive. An updated patch has been already pushed to opkg-utils
> > > upstream.
> > >
> > > You can run it and tell if everything is OK.
> > >
> >
> > This ran and mostly worked. The remaining issue is the reproducibility
> > issue:
>
> I'm glad that we went further in this problem, but
> > https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fautobuilder.yocto.io%2Fpub%2Frepro-fail%2Foe-reproducible-20230722-1a1a_7s6%2F&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=YVG%2FJi2GxHwFsiUXfavP7E2csBVZqlBdhHievqSXIeU%3D&reserved=0<https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20230722-1a1a_7s6/>
>
> > Unfortunately, diffoscope is not running on that large set.
>
> unfortunately I don't have knowledge what's this link about. Can you explain me a little bit and how is this being run from cli?
>
> > BR
> > Piotr
> >
> >
> > Od: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <p.lobacz=welotec.com@lists.openembedded.org>
> > Wysłane: sobota, 22 lipca 2023 22:55
> > Do: openembedded-core@lists.openembedded.org <openembedded-core@lists.openembedded.org>
> > DW: Piotr Łobacz <p.lobacz@welotec.com>
> > Temat: [OE-Core][PATCH v8][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr
> >
> > Extend OPKGBUILDCMD variable, with additional parameters, depending
> > on target distro features, in order to support ACLs and xattr.
> >
> > With fix pushed to the opkg-devel:
> > https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fg%2Fopkg-devel%2Fc%2FdYNHrLjDwg8&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yMHEGByP9mdHE7TVlx8embVuXdqZeVlk%2BcUcIu8dwNI%3D&reserved=0<https://groups.google.com/g/opkg-devel/c/dYNHrLjDwg8>
> > opkg-build is able to create tar archives with ACLs and xattr.
> >
> > Signed-off-by: Piotr Łobacz <p.lobacz@welotec.com>
> > ---
> >  meta/classes-global/package_ipk.bbclass | 2 +-
> >  1 file changed, 1 insertion(+), 1 deletion(-)
> >
> > diff --git a/meta/classes-global/package_ipk.bbclass b/meta/classes-global/package_ipk.bbclass
> > index b4b7bc9ac2..a0f106e4ad 100644
> > --- a/meta/classes-global/package_ipk.bbclass
> > +++ b/meta/classes-global/package_ipk.bbclass
> > @@ -15,7 +15,7 @@ IPKGCONF_SDK_TARGET = "${WORKDIR}/opkg-sdk-target.conf"
> >  PKGWRITEDIRIPK = "${WORKDIR}/deploy-ipks"
> >
> >  # Program to be used to build opkg packages
> > -OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}"'
> > +OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}" ${@bb.utils.contains('DISTRO_FEATURES', 'acl', '-A', '', d)} ${@bb.utils.contains('DISTRO_FEATURES', 'xattr', '-X', '', d)}'
> >
> >  OPKG_ARGS += "--force_postinstall --prefer-arch-to-version"
> >  OPKG_ARGS += "${@['', '--no-install-recommends'][d.getVar("NO_RECOMMENDATIONS") == "1"]}"
> > --
> > 2.34.1
>
> >
> >
> >
>
>
> --
> Alexandre Belloni, co-owner and COO, Bootlin
> Embedded Linux and Kernel engineering
> https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbootlin.com%2F&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6%2By9Umym57B4b3VZloHOo9CgfGD%2BUexNqfGxtfeIoNA%3D&reserved=0<https://bootlin.com/>

>
>
>


--
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbootlin.com%2F&data=05%7C01%7Cp.lobacz%40welotec.com%7C51dd1d7467324ac969b308db8bcb7ad6%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638257478278865450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6%2By9Umym57B4b3VZloHOo9CgfGD%2BUexNqfGxtfeIoNA%3D&reserved=0<https://bootlin.com/>
diff mbox series

Patch

diff --git a/meta/classes-global/package_ipk.bbclass b/meta/classes-global/package_ipk.bbclass
index b4b7bc9ac2..a0f106e4ad 100644
--- a/meta/classes-global/package_ipk.bbclass
+++ b/meta/classes-global/package_ipk.bbclass
@@ -15,7 +15,7 @@  IPKGCONF_SDK_TARGET = "${WORKDIR}/opkg-sdk-target.conf"
 PKGWRITEDIRIPK = "${WORKDIR}/deploy-ipks"

 # Program to be used to build opkg packages
-OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}"'
+OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}" ${@bb.utils.contains('DISTRO_FEATURES', 'acl', '-A', '', d)} ${@bb.utils.contains('DISTRO_FEATURES', 'xattr', '-X', '', d)}'

 OPKG_ARGS += "--force_postinstall --prefer-arch-to-version"
 OPKG_ARGS += "${@['', '--no-install-recommends'][d.getVar("NO_RECOMMENDATIONS") == "1"]}"