mbox series

[meta-oe,v4,0/3] update protobuf package from 3.21.12 to 4.22.2

Message ID 20230331094145.2362159-1-xiangyu.chen@eng.windriver.com
Headers show
Series update protobuf package from 3.21.12 to 4.22.2 | expand

Message

Xiangyu Chen March 31, 2023, 9:41 a.m. UTC
From: Xiangyu Chen <xiangyu.chen@windriver.com>

The series patches are upgrading protobuf package to latest version and add support which is 
depending protobuf package.

Changes:
v3->v4:
1. fix build failure under qemuarm
2. fix protobuf-c-native build failure

Tested compiling protobuf/protobuf-native on qemuarm(clang) and x86-64(gcc)
Tested compiling protobuf-c/protobuf-c-native on qemuarm(clang) and x86-64(gcc)
Tested compiling mosh on qemuarm(clang) and x86-64(gcc)

##### log of building qemuarm with clang (protobuf-c-native/protobuf failed before):

poky/build-upstream$ bitbake protobuf protobuf-native protobuf-c protobuf-c-native mosh 
/usr/lib/python3/dist-packages/html5lib/_trie/_base.py:3: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3, and in 3.9 it will stop working
  from collections import Mapping
NOTE: Reconnecting to bitbake server...
Loading cache: 100% |######################################################################################################################################################################| Time: 0:00:00
Loaded 3049 entries from dependency cache.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION           = "2.3.1"
BUILD_SYS            = "x86_64-linux"
NATIVELSBSTRING      = "universal"
TARGET_SYS           = "arm-poky-linux-gnueabi"
MACHINE              = "qemuarm"
DISTRO               = "poky"
DISTRO_VERSION       = "4.1+snapshot-51c56c35dcbdf990c764f62babdb303568d7c879"
TUNE_FEATURES        = "arm vfp cortexa15 neon thumb callconvention-hard"
TARGET_FPU           = "hard"
meta                 
meta-poky            
meta-yocto-bsp       = "master:51c56c35dcbdf990c764f62babdb303568d7c879"
meta-oe              = "master-dev:a06ee7ad9f58f055cdd08e3807e36e0c21b302d1"
meta-clang           = "HEAD:371097cdaa0175119a6710390d11a4e967188968"

Initialising tasks: 100% |#################################################################################################################################################################| Time: 0:00:01
Sstate summary: Wanted 27 Local 0 Mirrors 0 Missed 27 Current 312 (0% match, 92% complete)
NOTE: Executing Tasks
WARNING: mosh-1.4.0-r0 do_fetch: Failed to fetch URL http://mosh.mit.edu/mosh-1.4.0.tar.gz, attempting MIRRORS if available
WARNING: protobuf-4.22.2-r0 do_fetch: Failed to fetch URL gitsm://github.com/protocolbuffers/protobuf.git;branch=22.x;protocol=https, attempting MIRRORS if available
WARNING: protobuf-c-1.4.1-r0 do_fetch: Failed to fetch URL git://github.com/protobuf-c/protobuf-c.git;branch=master;protocol=https, attempting MIRRORS if available
NOTE: Tasks Summary: Attempted 1254 tasks of which 1182 didn't need to be rerun and all succeeded.

Summary: There were 3 WARNING messages.

#### end of log

v2->v3:
1. fix mosh compile failure
2. fix protobuf-c compile failure under clang

protobuf,protobuf-c and mosh tested under both clang and gcc mode.


v1->v2:
The v2[1] patch for upgrading protobuf from 3.21.12 to 4.22.2.
After upgrading the protobuf, the package protobuf-c cannot compile anymore[2] due to the latest version
protobuf is using c++14 and some of API name has been changed, so use another patch to add support of
protobuf latest version in protobuf-c.


Ref:
[1] v1 thread please refer to https://lists.openembedded.org/g/openembedded-devel/message/101784
[2] https://errors.yoctoproject.org/Errors/Details/698756/


Xiangyu Chen (3):
  protobuf: upgrade 3.21.12 -> 4.22.2
  protobuf-c: add support of protobuf 4.22.x
  mosh: add support of protobuf 4.22.x

 ...re.ac-add-support-of-protobuf-4.22.x.patch |  63 ++++
 .../recipes-connectivity/mosh/mosh_1.4.0.bb   |   7 +-
 ...ot-compile-the-code-which-was-genera.patch | 147 ++++++++
 .../0001-add-support-of-protobuf-4.22.x.patch | 315 ++++++++++++++++++
 .../protobuf/protobuf-c_1.4.1.bb              |   6 +-
 ...e-respect-CXX-LDFLAGS-variables-fix-.patch |  15 +-
 ...protobuf_3.21.12.bb => protobuf_4.22.2.bb} |  11 +-
 7 files changed, 552 insertions(+), 12 deletions(-)
 create mode 100644 meta-oe/recipes-connectivity/mosh/mosh/0001-configure.ac-add-support-of-protobuf-4.22.x.patch
 create mode 100644 meta-oe/recipes-devtools/protobuf/protobuf-c/0001-Makefile.am-do-not-compile-the-code-which-was-genera.patch
 create mode 100644 meta-oe/recipes-devtools/protobuf/protobuf-c/0001-add-support-of-protobuf-4.22.x.patch
 rename meta-oe/recipes-devtools/protobuf/{protobuf_3.21.12.bb => protobuf_4.22.2.bb} (86%)

Comments

Khem Raj April 1, 2023, 1:09 p.m. UTC | #1
next error

https://errors.yoctoproject.org/Errors/Details/699337/

On Fri, Mar 31, 2023 at 2:42 AM Xiangyu Chen
<xiangyu.chen@eng.windriver.com> wrote:
>
> From: Xiangyu Chen <xiangyu.chen@windriver.com>
>
> The series patches are upgrading protobuf package to latest version and add support which is
> depending protobuf package.
>
> Changes:
> v3->v4:
> 1. fix build failure under qemuarm
> 2. fix protobuf-c-native build failure
>
> Tested compiling protobuf/protobuf-native on qemuarm(clang) and x86-64(gcc)
> Tested compiling protobuf-c/protobuf-c-native on qemuarm(clang) and x86-64(gcc)
> Tested compiling mosh on qemuarm(clang) and x86-64(gcc)
>
> ##### log of building qemuarm with clang (protobuf-c-native/protobuf failed before):
>
> poky/build-upstream$ bitbake protobuf protobuf-native protobuf-c protobuf-c-native mosh
> /usr/lib/python3/dist-packages/html5lib/_trie/_base.py:3: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3, and in 3.9 it will stop working
>   from collections import Mapping
> NOTE: Reconnecting to bitbake server...
> Loading cache: 100% |######################################################################################################################################################################| Time: 0:00:00
> Loaded 3049 entries from dependency cache.
> NOTE: Resolving any missing task queue dependencies
>
> Build Configuration:
> BB_VERSION           = "2.3.1"
> BUILD_SYS            = "x86_64-linux"
> NATIVELSBSTRING      = "universal"
> TARGET_SYS           = "arm-poky-linux-gnueabi"
> MACHINE              = "qemuarm"
> DISTRO               = "poky"
> DISTRO_VERSION       = "4.1+snapshot-51c56c35dcbdf990c764f62babdb303568d7c879"
> TUNE_FEATURES        = "arm vfp cortexa15 neon thumb callconvention-hard"
> TARGET_FPU           = "hard"
> meta
> meta-poky
> meta-yocto-bsp       = "master:51c56c35dcbdf990c764f62babdb303568d7c879"
> meta-oe              = "master-dev:a06ee7ad9f58f055cdd08e3807e36e0c21b302d1"
> meta-clang           = "HEAD:371097cdaa0175119a6710390d11a4e967188968"
>
> Initialising tasks: 100% |#################################################################################################################################################################| Time: 0:00:01
> Sstate summary: Wanted 27 Local 0 Mirrors 0 Missed 27 Current 312 (0% match, 92% complete)
> NOTE: Executing Tasks
> WARNING: mosh-1.4.0-r0 do_fetch: Failed to fetch URL http://mosh.mit.edu/mosh-1.4.0.tar.gz, attempting MIRRORS if available
> WARNING: protobuf-4.22.2-r0 do_fetch: Failed to fetch URL gitsm://github.com/protocolbuffers/protobuf.git;branch=22.x;protocol=https, attempting MIRRORS if available
> WARNING: protobuf-c-1.4.1-r0 do_fetch: Failed to fetch URL git://github.com/protobuf-c/protobuf-c.git;branch=master;protocol=https, attempting MIRRORS if available
> NOTE: Tasks Summary: Attempted 1254 tasks of which 1182 didn't need to be rerun and all succeeded.
>
> Summary: There were 3 WARNING messages.
>
> #### end of log
>
> v2->v3:
> 1. fix mosh compile failure
> 2. fix protobuf-c compile failure under clang
>
> protobuf,protobuf-c and mosh tested under both clang and gcc mode.
>
>
> v1->v2:
> The v2[1] patch for upgrading protobuf from 3.21.12 to 4.22.2.
> After upgrading the protobuf, the package protobuf-c cannot compile anymore[2] due to the latest version
> protobuf is using c++14 and some of API name has been changed, so use another patch to add support of
> protobuf latest version in protobuf-c.
>
>
> Ref:
> [1] v1 thread please refer to https://lists.openembedded.org/g/openembedded-devel/message/101784
> [2] https://errors.yoctoproject.org/Errors/Details/698756/
>
>
> Xiangyu Chen (3):
>   protobuf: upgrade 3.21.12 -> 4.22.2
>   protobuf-c: add support of protobuf 4.22.x
>   mosh: add support of protobuf 4.22.x
>
>  ...re.ac-add-support-of-protobuf-4.22.x.patch |  63 ++++
>  .../recipes-connectivity/mosh/mosh_1.4.0.bb   |   7 +-
>  ...ot-compile-the-code-which-was-genera.patch | 147 ++++++++
>  .../0001-add-support-of-protobuf-4.22.x.patch | 315 ++++++++++++++++++
>  .../protobuf/protobuf-c_1.4.1.bb              |   6 +-
>  ...e-respect-CXX-LDFLAGS-variables-fix-.patch |  15 +-
>  ...protobuf_3.21.12.bb => protobuf_4.22.2.bb} |  11 +-
>  7 files changed, 552 insertions(+), 12 deletions(-)
>  create mode 100644 meta-oe/recipes-connectivity/mosh/mosh/0001-configure.ac-add-support-of-protobuf-4.22.x.patch
>  create mode 100644 meta-oe/recipes-devtools/protobuf/protobuf-c/0001-Makefile.am-do-not-compile-the-code-which-was-genera.patch
>  create mode 100644 meta-oe/recipes-devtools/protobuf/protobuf-c/0001-add-support-of-protobuf-4.22.x.patch
>  rename meta-oe/recipes-devtools/protobuf/{protobuf_3.21.12.bb => protobuf_4.22.2.bb} (86%)
>
> --
> 2.34.1
>
Clément Péron July 30, 2023, 1:01 p.m. UTC | #2
Hi Xiangyu,

On Sat, 1 Apr 2023 at 15:09, Khem Raj <raj.khem@gmail.com> wrote:

> next error
>
> https://errors.yoctoproject.org/Errors/Details/699337/


Could you try to bump gRPC and see if it fixed the compilation?

I was looking to bump gRPC but got other issues with utf8-native
https://lists.openembedded.org/g/openembedded-core/message/184648

Regards,
Clement



>
> On Fri, Mar 31, 2023 at 2:42 AM Xiangyu Chen
> <xiangyu.chen@eng.windriver.com> wrote:
> >
> > From: Xiangyu Chen <xiangyu.chen@windriver.com>
> >
> > The series patches are upgrading protobuf package to latest version and
> add support which is
> > depending protobuf package.
> >
> > Changes:
> > v3->v4:
> > 1. fix build failure under qemuarm
> > 2. fix protobuf-c-native build failure
> >
> > Tested compiling protobuf/protobuf-native on qemuarm(clang) and
> x86-64(gcc)
> > Tested compiling protobuf-c/protobuf-c-native on qemuarm(clang) and
> x86-64(gcc)
> > Tested compiling mosh on qemuarm(clang) and x86-64(gcc)
> >
> > ##### log of building qemuarm with clang (protobuf-c-native/protobuf
> failed before):
> >
> > poky/build-upstream$ bitbake protobuf protobuf-native protobuf-c
> protobuf-c-native mosh
> > /usr/lib/python3/dist-packages/html5lib/_trie/_base.py:3:
> DeprecationWarning: Using or importing the ABCs from 'collections' instead
> of from 'collections.abc' is deprecated since Python 3.3, and in 3.9 it
> will stop working
> >   from collections import Mapping
> > NOTE: Reconnecting to bitbake server...
> > Loading cache: 100%
> |######################################################################################################################################################################|
> Time: 0:00:00
> > Loaded 3049 entries from dependency cache.
> > NOTE: Resolving any missing task queue dependencies
> >
> > Build Configuration:
> > BB_VERSION           = "2.3.1"
> > BUILD_SYS            = "x86_64-linux"
> > NATIVELSBSTRING      = "universal"
> > TARGET_SYS           = "arm-poky-linux-gnueabi"
> > MACHINE              = "qemuarm"
> > DISTRO               = "poky"
> > DISTRO_VERSION       =
> "4.1+snapshot-51c56c35dcbdf990c764f62babdb303568d7c879"
> > TUNE_FEATURES        = "arm vfp cortexa15 neon thumb callconvention-hard"
> > TARGET_FPU           = "hard"
> > meta
> > meta-poky
> > meta-yocto-bsp       = "master:51c56c35dcbdf990c764f62babdb303568d7c879"
> > meta-oe              =
> "master-dev:a06ee7ad9f58f055cdd08e3807e36e0c21b302d1"
> > meta-clang           = "HEAD:371097cdaa0175119a6710390d11a4e967188968"
> >
> > Initialising tasks: 100%
> |#################################################################################################################################################################|
> Time: 0:00:01
> > Sstate summary: Wanted 27 Local 0 Mirrors 0 Missed 27 Current 312 (0%
> match, 92% complete)
> > NOTE: Executing Tasks
> > WARNING: mosh-1.4.0-r0 do_fetch: Failed to fetch URL
> http://mosh.mit.edu/mosh-1.4.0.tar.gz, attempting MIRRORS if available
> > WARNING: protobuf-4.22.2-r0 do_fetch: Failed to fetch URL gitsm://
> github.com/protocolbuffers/protobuf.git;branch=22.x;protocol=https,
> attempting MIRRORS if available
> > WARNING: protobuf-c-1.4.1-r0 do_fetch: Failed to fetch URL git://
> github.com/protobuf-c/protobuf-c.git;branch=master;protocol=https,
> attempting MIRRORS if available
> > NOTE: Tasks Summary: Attempted 1254 tasks of which 1182 didn't need to
> be rerun and all succeeded.
> >
> > Summary: There were 3 WARNING messages.
> >
> > #### end of log
> >
> > v2->v3:
> > 1. fix mosh compile failure
> > 2. fix protobuf-c compile failure under clang
> >
> > protobuf,protobuf-c and mosh tested under both clang and gcc mode.
> >
> >
> > v1->v2:
> > The v2[1] patch for upgrading protobuf from 3.21.12 to 4.22.2.
> > After upgrading the protobuf, the package protobuf-c cannot compile
> anymore[2] due to the latest version
> > protobuf is using c++14 and some of API name has been changed, so use
> another patch to add support of
> > protobuf latest version in protobuf-c.
> >
> >
> > Ref:
> > [1] v1 thread please refer to
> https://lists.openembedded.org/g/openembedded-devel/message/101784
> > [2] https://errors.yoctoproject.org/Errors/Details/698756/
> >
> >
> > Xiangyu Chen (3):
> >   protobuf: upgrade 3.21.12 -> 4.22.2
> >   protobuf-c: add support of protobuf 4.22.x
> >   mosh: add support of protobuf 4.22.x
> >
> >  ...re.ac-add-support-of-protobuf-4.22.x.patch |  63 ++++
> >  .../recipes-connectivity/mosh/mosh_1.4.0.bb   |   7 +-
> >  ...ot-compile-the-code-which-was-genera.patch | 147 ++++++++
> >  .../0001-add-support-of-protobuf-4.22.x.patch | 315 ++++++++++++++++++
> >  .../protobuf/protobuf-c_1.4.1.bb              |   6 +-
> >  ...e-respect-CXX-LDFLAGS-variables-fix-.patch |  15 +-
> >  ...protobuf_3.21.12.bb => protobuf_4.22.2.bb} |  11 +-
> >  7 files changed, 552 insertions(+), 12 deletions(-)
> >  create mode 100644
> meta-oe/recipes-connectivity/mosh/mosh/0001-configure.ac-add-support-of-protobuf-4.22.x.patch
> >  create mode 100644
> meta-oe/recipes-devtools/protobuf/protobuf-c/0001-Makefile.am-do-not-compile-the-code-which-was-genera.patch
> >  create mode 100644
> meta-oe/recipes-devtools/protobuf/protobuf-c/0001-add-support-of-protobuf-4.22.x.patch
> >  rename meta-oe/recipes-devtools/protobuf/{protobuf_3.21.12.bb =>
> protobuf_4.22.2.bb} (86%)
> >
> > --
> > 2.34.1
> >
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#101868):
> https://lists.openembedded.org/g/openembedded-devel/message/101868
> Mute This Topic: https://lists.openembedded.org/mt/97969897/4240582
> Group Owner: openembedded-devel+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub [
> peron.clem@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
>