mbox series

[RFC,0/4] Bump Protobuf/gRPC

Message ID 20230720162535.116519-1-peron.clem@gmail.com
Headers show
Series Bump Protobuf/gRPC | expand

Message

Clément Péron July 20, 2023, 4:22 p.m. UTC
Hi,

I'm trying to bump gRPC to a more recent version,
but it requires a bump of protobuf.

I'm strugling with the following issue when compiling:

ERROR: abseil-cpp-20230125.3-r0 do_package: Variable Requires: absl_config = 20230125, absl_core_headers = 20230125, absl_log_internal_append_truncated = 20230125, absl_log_internal_config = 20230125, absl_log_internal_globals = 20230125, absl_log_severity = 20230125, absl_strings = 20230125, absl_str_format = 20230125, absl_time = 20230125, absl_span  contains an operation using the old override syntax. Please convert this layer/metadata before attempting to use with a newer bitbake.
ERROR: Logfile of failure stored in: /build/tmp/work/armv8a-poky-linux/abseil-cpp/20230125.3-r0/temp/log.do_package.2192204
ERROR: Task (/build/../meta-outsight/recipes-devtools/abseil-cpp/abseil-cpp_git.bb:do_package) failed with exit code '1'

Do you have an idea of what is happening?

Thanks for your help

Clément Péron (4):
  jsoncpp: extend with nativesdk
  devtools: protobuf: add utf8-range recipe
  protobuf: bump to 3.23.4
  devtools: grpc: bump to 1.56.2

 ...RPCPP_ABSEIL_SYNC-to-GPR_ABSEIL_SYNC.patch | 62 -------------
 ...d-separate-export-for-plugin-targets.patch | 93 -------------------
 .../grpc/{grpc_1.50.1.bb => grpc_1.56.2.bb}   |  6 +-
 .../recipes-devtools/jsoncpp/jsoncpp_1.9.5.bb |  2 +-
 .../0001-Fix-linking-error-with-ld-gold.patch | 69 --------------
 ...e-respect-CXX-LDFLAGS-variables-fix-.patch |  4 +-
 ...protobuf_3.21.12.bb => protobuf_3.23.4.bb} |  8 +-
 .../protobuf/utf8-range_git.bb                | 22 +++++
 8 files changed, 32 insertions(+), 234 deletions(-)
 delete mode 100644 meta-oe/recipes-devtools/grpc/grpc/0001-Revert-Changed-GRPCPP_ABSEIL_SYNC-to-GPR_ABSEIL_SYNC.patch
 delete mode 100644 meta-oe/recipes-devtools/grpc/grpc/0001-cmake-add-separate-export-for-plugin-targets.patch
 rename meta-oe/recipes-devtools/grpc/{grpc_1.50.1.bb => grpc_1.56.2.bb} (92%)
 delete mode 100644 meta-oe/recipes-devtools/protobuf/protobuf/0001-Fix-linking-error-with-ld-gold.patch
 rename meta-oe/recipes-devtools/protobuf/{protobuf_3.21.12.bb => protobuf_3.23.4.bb} (95%)
 create mode 100644 meta-oe/recipes-devtools/protobuf/utf8-range_git.bb

Comments

Martin Jansa July 20, 2023, 4:38 p.m. UTC | #1
These patches should be sent to openembedded-devel not openembedded-core.

> ERROR: abseil-cpp-20230125.3-r0 do_package: Variable Requires:
absl_config = 20230125, absl_core_headers = 20230125,
absl_log_internal_append_truncated = 20230125, absl_log_internal_config =
20230125, absl_log_internal_globals = 20230125, absl_log_severity =
20230125, absl_strings = 20230125, absl_str_format = 20230125, absl_time =
20230125, absl_span  contains an operation using the old override syntax.
Please convert this layer/metadata before attempting to use with a newer
bitbake.

Do you have this change in your build?
https://lists.openembedded.org/g/openembedded-core/message/179019

On Thu, Jul 20, 2023 at 6:25 PM Clément Péron <peron.clem@gmail.com> wrote:

> Hi,
>
> I'm trying to bump gRPC to a more recent version,
> but it requires a bump of protobuf.
>
> I'm strugling with the following issue when compiling:
>
> ERROR: abseil-cpp-20230125.3-r0 do_package: Variable Requires: absl_config
> = 20230125, absl_core_headers = 20230125,
> absl_log_internal_append_truncated = 20230125, absl_log_internal_config =
> 20230125, absl_log_internal_globals = 20230125, absl_log_severity =
> 20230125, absl_strings = 20230125, absl_str_format = 20230125, absl_time =
> 20230125, absl_span  contains an operation using the old override syntax.
> Please convert this layer/metadata before attempting to use with a newer
> bitbake.
> ERROR: Logfile of failure stored in:
> /build/tmp/work/armv8a-poky-linux/abseil-cpp/20230125.3-r0/temp/log.do_package.2192204
> ERROR: Task
> (/build/../meta-outsight/recipes-devtools/abseil-cpp/abseil-cpp_git.bb:do_package)
> failed with exit code '1'
>
> Do you have an idea of what is happening?
>
> Thanks for your help
>
> Clément Péron (4):
>   jsoncpp: extend with nativesdk
>   devtools: protobuf: add utf8-range recipe
>   protobuf: bump to 3.23.4
>   devtools: grpc: bump to 1.56.2
>
>  ...RPCPP_ABSEIL_SYNC-to-GPR_ABSEIL_SYNC.patch | 62 -------------
>  ...d-separate-export-for-plugin-targets.patch | 93 -------------------
>  .../grpc/{grpc_1.50.1.bb => grpc_1.56.2.bb}   |  6 +-
>  .../recipes-devtools/jsoncpp/jsoncpp_1.9.5.bb |  2 +-
>  .../0001-Fix-linking-error-with-ld-gold.patch | 69 --------------
>  ...e-respect-CXX-LDFLAGS-variables-fix-.patch |  4 +-
>  ...protobuf_3.21.12.bb => protobuf_3.23.4.bb} |  8 +-
>  .../protobuf/utf8-range_git.bb                | 22 +++++
>  8 files changed, 32 insertions(+), 234 deletions(-)
>  delete mode 100644
> meta-oe/recipes-devtools/grpc/grpc/0001-Revert-Changed-GRPCPP_ABSEIL_SYNC-to-GPR_ABSEIL_SYNC.patch
>  delete mode 100644
> meta-oe/recipes-devtools/grpc/grpc/0001-cmake-add-separate-export-for-plugin-targets.patch
>  rename meta-oe/recipes-devtools/grpc/{grpc_1.50.1.bb => grpc_1.56.2.bb}
> (92%)
>  delete mode 100644
> meta-oe/recipes-devtools/protobuf/protobuf/0001-Fix-linking-error-with-ld-gold.patch
>  rename meta-oe/recipes-devtools/protobuf/{protobuf_3.21.12.bb =>
> protobuf_3.23.4.bb} (95%)
>  create mode 100644 meta-oe/recipes-devtools/protobuf/utf8-range_git.bb
>
> --
> 2.41.0
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#184644):
> https://lists.openembedded.org/g/openembedded-core/message/184644
> Mute This Topic: https://lists.openembedded.org/mt/100259348/3617156
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [
> Martin.Jansa@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
>
Clément Péron July 21, 2023, 9:07 a.m. UTC | #2
Hi Martin,

On Thu, 20 Jul 2023 at 18:38, Martin Jansa <martin.jansa@gmail.com> wrote:

> These patches should be sent to openembedded-devel not openembedded-core.
>

Sorry about that. I will send the next version in the correct ML


> > ERROR: abseil-cpp-20230125.3-r0 do_package: Variable Requires:
> absl_config = 20230125, absl_core_headers = 20230125,
> absl_log_internal_append_truncated = 20230125, absl_log_internal_config =
> 20230125, absl_log_internal_globals = 20230125, absl_log_severity =
> 20230125, absl_strings = 20230125, absl_str_format = 20230125, absl_time =
> 20230125, absl_span  contains an operation using the old override syntax.
> Please convert this layer/metadata before attempting to use with a newer
> bitbake.
>
> Do you have this change in your build?
> https://lists.openembedded.org/g/openembedded-core/message/179019
>

No, thanks for pointing out this fix, I have proposed a backport to
kirkstone.

Regards,
Clement


>
> On Thu, Jul 20, 2023 at 6:25 PM Clément Péron <peron.clem@gmail.com>
> wrote:
>
>> Hi,
>>
>> I'm trying to bump gRPC to a more recent version,
>> but it requires a bump of protobuf.
>>
>> I'm strugling with the following issue when compiling:
>>
>> ERROR: abseil-cpp-20230125.3-r0 do_package: Variable Requires:
>> absl_config = 20230125, absl_core_headers = 20230125,
>> absl_log_internal_append_truncated = 20230125, absl_log_internal_config =
>> 20230125, absl_log_internal_globals = 20230125, absl_log_severity =
>> 20230125, absl_strings = 20230125, absl_str_format = 20230125, absl_time =
>> 20230125, absl_span  contains an operation using the old override syntax.
>> Please convert this layer/metadata before attempting to use with a newer
>> bitbake.
>> ERROR: Logfile of failure stored in:
>> /build/tmp/work/armv8a-poky-linux/abseil-cpp/20230125.3-r0/temp/log.do_package.2192204
>> ERROR: Task
>> (/build/../meta-outsight/recipes-devtools/abseil-cpp/abseil-cpp_git.bb:do_package)
>> failed with exit code '1'
>>
>> Do you have an idea of what is happening?
>>
>> Thanks for your help
>>
>> Clément Péron (4):
>>   jsoncpp: extend with nativesdk
>>   devtools: protobuf: add utf8-range recipe
>>   protobuf: bump to 3.23.4
>>   devtools: grpc: bump to 1.56.2
>>
>>  ...RPCPP_ABSEIL_SYNC-to-GPR_ABSEIL_SYNC.patch | 62 -------------
>>  ...d-separate-export-for-plugin-targets.patch | 93 -------------------
>>  .../grpc/{grpc_1.50.1.bb => grpc_1.56.2.bb}   |  6 +-
>>  .../recipes-devtools/jsoncpp/jsoncpp_1.9.5.bb |  2 +-
>>  .../0001-Fix-linking-error-with-ld-gold.patch | 69 --------------
>>  ...e-respect-CXX-LDFLAGS-variables-fix-.patch |  4 +-
>>  ...protobuf_3.21.12.bb => protobuf_3.23.4.bb} |  8 +-
>>  .../protobuf/utf8-range_git.bb                | 22 +++++
>>  8 files changed, 32 insertions(+), 234 deletions(-)
>>  delete mode 100644
>> meta-oe/recipes-devtools/grpc/grpc/0001-Revert-Changed-GRPCPP_ABSEIL_SYNC-to-GPR_ABSEIL_SYNC.patch
>>  delete mode 100644
>> meta-oe/recipes-devtools/grpc/grpc/0001-cmake-add-separate-export-for-plugin-targets.patch
>>  rename meta-oe/recipes-devtools/grpc/{grpc_1.50.1.bb => grpc_1.56.2.bb}
>> (92%)
>>  delete mode 100644
>> meta-oe/recipes-devtools/protobuf/protobuf/0001-Fix-linking-error-with-ld-gold.patch
>>  rename meta-oe/recipes-devtools/protobuf/{protobuf_3.21.12.bb =>
>> protobuf_3.23.4.bb} (95%)
>>  create mode 100644 meta-oe/recipes-devtools/protobuf/utf8-range_git.bb
>>
>> --
>> 2.41.0
>>
>>
>> -=-=-=-=-=-=-=-=-=-=-=-
>> Links: You receive all messages sent to this group.
>> View/Reply Online (#184644):
>> https://lists.openembedded.org/g/openembedded-core/message/184644
>> Mute This Topic: https://lists.openembedded.org/mt/100259348/3617156
>> Group Owner: openembedded-core+owner@lists.openembedded.org
>> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [
>> Martin.Jansa@gmail.com]
>> -=-=-=-=-=-=-=-=-=-=-=-
>>
>>
Clément Péron July 22, 2023, 10:11 a.m. UTC | #3
Hi,

On Fri, 21 Jul 2023 at 11:07, Clément Péron via lists.openembedded.org
<peron.clem=gmail.com@lists.openembedded.org> wrote:

> Hi Martin,
>
> On Thu, 20 Jul 2023 at 18:38, Martin Jansa <martin.jansa@gmail.com> wrote:
>
>> These patches should be sent to openembedded-devel not openembedded-core.
>>
>
> Sorry about that. I will send the next version in the correct ML
>
>
>> > ERROR: abseil-cpp-20230125.3-r0 do_package: Variable Requires:
>> absl_config = 20230125, absl_core_headers = 20230125,
>> absl_log_internal_append_truncated = 20230125, absl_log_internal_config =
>> 20230125, absl_log_internal_globals = 20230125, absl_log_severity =
>> 20230125, absl_strings = 20230125, absl_str_format = 20230125, absl_time =
>> 20230125, absl_span  contains an operation using the old override syntax.
>> Please convert this layer/metadata before attempting to use with a newer
>> bitbake.
>>
>> Do you have this change in your build?
>> https://lists.openembedded.org/g/openembedded-core/message/179019
>>
>
> No, thanks for pointing out this fix, I have proposed a backport to
> kirkstone.
>
> Regards,
> Clement
>
>
>>
>> On Thu, Jul 20, 2023 at 6:25 PM Clément Péron <peron.clem@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> I'm trying to bump gRPC to a more recent version,
>>> but it requires a bump of protobuf.
>>>
>>> I'm strugling with the following issue when compiling:
>>>
>>> ERROR: abseil-cpp-20230125.3-r0 do_package: Variable Requires:
>>> absl_config = 20230125, absl_core_headers = 20230125,
>>> absl_log_internal_append_truncated = 20230125, absl_log_internal_config =
>>> 20230125, absl_log_internal_globals = 20230125, absl_log_severity =
>>> 20230125, absl_strings = 20230125, absl_str_format = 20230125, absl_time =
>>> 20230125, absl_span  contains an operation using the old override syntax.
>>> Please convert this layer/metadata before attempting to use with a newer
>>> bitbake.
>>> ERROR: Logfile of failure stored in:
>>> /build/tmp/work/armv8a-poky-linux/abseil-cpp/20230125.3-r0/temp/log.do_package.2192204
>>> ERROR: Task
>>> (/build/../meta-outsight/recipes-devtools/abseil-cpp/abseil-cpp_git.bb:do_package)
>>> failed with exit code '1'
>>>
>>> Do you have an idea of what is happening?
>>
>>
I'm now facing the issue that /usr/lib/libutf8_validity.a is installed by
both utf8-range-native and protobuf-native.

I'm not an expert but is it not kind of strange that a python package ships
a library in /usr/lib no? I would expect it to be used at link time but not
shipped. Am I correct?

https://github.com/protocolbuffers/protobuf/blob/main/python/setup.py#L309

Regards,
Clement



>
>>> Thanks for your help
>>>
>>> Clément Péron (4):
>>>   jsoncpp: extend with nativesdk
>>>   devtools: protobuf: add utf8-range recipe
>>>   protobuf: bump to 3.23.4
>>>   devtools: grpc: bump to 1.56.2
>>>
>>>  ...RPCPP_ABSEIL_SYNC-to-GPR_ABSEIL_SYNC.patch | 62 -------------
>>>  ...d-separate-export-for-plugin-targets.patch | 93 -------------------
>>>  .../grpc/{grpc_1.50.1.bb => grpc_1.56.2.bb}   |  6 +-
>>>  .../recipes-devtools/jsoncpp/jsoncpp_1.9.5.bb |  2 +-
>>>  .../0001-Fix-linking-error-with-ld-gold.patch | 69 --------------
>>>  ...e-respect-CXX-LDFLAGS-variables-fix-.patch |  4 +-
>>>  ...protobuf_3.21.12.bb => protobuf_3.23.4.bb} |  8 +-
>>>  .../protobuf/utf8-range_git.bb                | 22 +++++
>>>  8 files changed, 32 insertions(+), 234 deletions(-)
>>>  delete mode 100644
>>> meta-oe/recipes-devtools/grpc/grpc/0001-Revert-Changed-GRPCPP_ABSEIL_SYNC-to-GPR_ABSEIL_SYNC.patch
>>>  delete mode 100644
>>> meta-oe/recipes-devtools/grpc/grpc/0001-cmake-add-separate-export-for-plugin-targets.patch
>>>  rename meta-oe/recipes-devtools/grpc/{grpc_1.50.1.bb => grpc_1.56.2.bb}
>>> (92%)
>>>  delete mode 100644
>>> meta-oe/recipes-devtools/protobuf/protobuf/0001-Fix-linking-error-with-ld-gold.patch
>>>  rename meta-oe/recipes-devtools/protobuf/{protobuf_3.21.12.bb =>
>>> protobuf_3.23.4.bb} (95%)
>>>  create mode 100644 meta-oe/recipes-devtools/protobuf/utf8-range_git.bb
>>>
>>> --
>>> 2.41.0
>>>
>>>
>>>
>>>
>>>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#184677):
> https://lists.openembedded.org/g/openembedded-core/message/184677
> Mute This Topic: https://lists.openembedded.org/mt/100259348/4240582
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [
> peron.clem@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
>