Recipes with disabled parallel make

Submitted by Yuri Bushmelev on March 2, 2012, 10:29 p.m.

Details

Message ID CAJG6M_MgcYVomQbn=j_w=+BCDjUAdDe1D==CsQ_eFTJm1=rwQw@mail.gmail.com
State New
Headers show

Commit Message

Yuri Bushmelev March 2, 2012, 10:29 p.m.
2012/2/10 Khem Raj <raj.khem@gmail.com>:
> Hi
>
> Just grepped for the occurances of disabled parallel make and I see
> around 40 cases on oe-core
>
> git grep PARALLEL_MAKE.*=.*\"\" recipes* | grep -v "#"
>
> If someone has time to kill then it would help to see if some of these
> are fixed by time or can be fixed
>
> it can help in paralleling the build a bit more.

Well, I have some first results! :)


1. Recipes (files) confirmed to fail with P_M enabled (need to have
P_M disabled as it is now):
meta/recipes-connectivity/bind/bind_9.8.1.bb
meta/recipes-extended/slang/slang_2.2.4.bb
meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb
meta/recipes-support/js/js_1.7.0+1.8.0rc1.bb
meta/recipes-support/pth/pth_2.0.7.bb


2. Recipes _not_ confirmed to fail with P_M enabled (i.e. are building
ok in my environment with P_M enabled):
meta/recipes-bsp/pciutils/pciutils_3.1.9.bb
meta/recipes-bsp/pcmciautils/pcmciautils.inc
meta/recipes-connectivity/iproute2/iproute2.inc
meta/recipes-connectivity/nfs-utils/nfs-utils_1.2.3.bb
meta/recipes-core/eggdbus/eggdbus_0.6.bb
meta/recipes-devtools/autoconf/autoconf_2.68.bb
meta/recipes-extended/at/at_3.1.12.bb
meta/recipes-extended/groff/groff_1.20.1.bb
meta/recipes-extended/mailx/mailx_12.5.bb
meta/recipes-extended/net-tools/net-tools_1.60-23.bb
meta/recipes-extended/sat-solver/sat-solver_git.bb
meta/recipes-graphics/fontconfig/fontconfig_2.8.0.bb
meta/recipes-graphics/libsdl/libsdl_1.2.14.bb
meta/recipes-graphics/xcb/libpthread-stubs_0.3.bb
meta/recipes-graphics/xcb/xcb-util.inc
meta/recipes-multimedia/pulseaudio/pulseaudio.inc
meta/recipes-multimedia/speex/speex_1.2rc1.bb
meta/recipes-support/icu/icu-3.6.inc
meta/recipes-support/libpcre/libpcre_8.21.bb


3. Recipes not tested yet (need more work):
meta/recipes-bsp/x-load/x-load.inc (want specific ARCH)
meta/recipes-bsp/u-boot/u-boot.inc (multiple versions available)
meta/recipes-core/eglibc/eglibc.inc (multiple versions available)
meta/recipes-core/gettext/gettext_0.16.1.bb (multiple versions available)
meta/recipes-devtools/dpkg/dpkg.inc (fetch and patch tasks are failed)
meta/recipes-devtools/gcc/gcc-cross-canadian_4.6.bb (can't remember actually...)
meta/recipes-devtools/mtd/mtd-utils_1.4.9.bb (multiple versions available)
meta/recipes-devtools/mtd/mtd-utils_1.1.0+git.bb (multiple versions available)
meta/recipes-devtools/valgrind/valgrind_3.7.0.bb (want specific ARCH)
meta/recipes-extended/bash/bash_3.2.48.bb (multiple versions available)
meta/recipes-extended/bash/bash.inc (multiple versions available)
meta/recipes-graphics/xcb/libxcb.inc (multiple versions available)


4. Recipes with PARALLEL_MAKEINST disabled (not tested yet as well):
meta/recipes-connectivity/openssl/openssl_1.0.0g.bb
meta/recipes-extended/ghostscript/ghostscript_9.04.bb
meta/recipes-devtools/mtools/mtools_3.9.9.bb
meta/recipes-devtools/mtools/mtools_4.0.17.bb


Recipes from list #2 was tested with BB_THREAD_NUMBER="6" and
PARALLEL_MAKE="-j 5" for ARCH'es: qemuarm, qemumips and qemux86.

I've attached patch which enable P_M for recipes from list #2. I hope
someone else will test it in own environment (not safe for production,
use separate branch).

Patch hide | download patch | download mbox

From 31ea9e54b8a1b31fd85b0e512a2c1276778423d6 Mon Sep 17 00:00:00 2001
From: Yuri Bushmelev <jay4mail@gmail.com>
Date: Thu, 1 Mar 2012 21:17:35 +0400
Subject: [PATCH] Enable PARALLEL_MAKE for testing

Signed-off-by: Yuri Bushmelev <jay4mail@gmail.com>
---
 meta/recipes-bsp/pciutils/pciutils_3.1.9.bb        |    2 +-
 meta/recipes-bsp/pcmciautils/pcmciautils.inc       |    2 +-
 meta/recipes-connectivity/iproute2/iproute2.inc    |    2 +-
 .../nfs-utils/nfs-utils_1.2.3.bb                   |    2 +-
 meta/recipes-core/eggdbus/eggdbus_0.6.bb           |    2 +-
 meta/recipes-devtools/autoconf/autoconf_2.68.bb    |    2 +-
 meta/recipes-extended/at/at_3.1.12.bb              |    2 +-
 meta/recipes-extended/groff/groff_1.20.1.bb        |    2 +-
 meta/recipes-extended/mailx/mailx_12.5.bb          |    2 +-
 .../net-tools/net-tools_1.60-23.bb                 |    2 +-
 meta/recipes-extended/sat-solver/sat-solver_git.bb |    2 +-
 .../fontconfig/fontconfig_2.8.0.bb                 |    2 +-
 meta/recipes-graphics/libsdl/libsdl_1.2.14.bb      |    2 +-
 meta/recipes-graphics/xcb/libpthread-stubs_0.3.bb  |    2 +-
 meta/recipes-graphics/xcb/xcb-util.inc             |    2 +-
 meta/recipes-multimedia/pulseaudio/pulseaudio.inc  |    2 +-
 meta/recipes-multimedia/speex/speex_1.2rc1.bb      |    2 +-
 meta/recipes-support/icu/icu-3.6.inc               |    2 +-
 meta/recipes-support/libpcre/libpcre_8.21.bb       |    2 +-
 19 files changed, 19 insertions(+), 19 deletions(-)

diff --git a/meta/recipes-bsp/pciutils/pciutils_3.1.9.bb b/meta/recipes-bsp/pciutils/pciutils_3.1.9.bb
index 51e7476..9de3c3d 100644
--- a/meta/recipes-bsp/pciutils/pciutils_3.1.9.bb
+++ b/meta/recipes-bsp/pciutils/pciutils_3.1.9.bb
@@ -21,7 +21,7 @@  SRC_URI = "${KERNELORG_MIRROR}/software/utils/pciutils/pciutils-${PV}.tar.bz2 \
 SRC_URI[md5sum] = "79cc1d0bff8603d3a550fa63802cd1db"
 SRC_URI[sha256sum] = "e4ce5d56ae4a9611d51ba0cc2ea45806f9539a18aceb4aa70b8ded50f6923c4f"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 
 PCI_CONF_FLAG = "ZLIB=yes DNS=yes SHARED=yes"
 
diff --git a/meta/recipes-bsp/pcmciautils/pcmciautils.inc b/meta/recipes-bsp/pcmciautils/pcmciautils.inc
index c0c1d0c..2820858 100644
--- a/meta/recipes-bsp/pcmciautils/pcmciautils.inc
+++ b/meta/recipes-bsp/pcmciautils/pcmciautils.inc
@@ -23,7 +23,7 @@  LD = "${CC}"
 CFLAGS =+ "-I${S}/src"
 CFLAGS =+ "-DPCMCIAUTILS_VERSION=\'${PV}\'"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 EXTRA_OEMAKE = "-e 'STRIP=echo' 'LIB_OBJS=-lc -lsysfs' 'LEX=flex'"
 
 do_install () {
diff --git a/meta/recipes-connectivity/iproute2/iproute2.inc b/meta/recipes-connectivity/iproute2/iproute2.inc
index 6fc30a0..361ae60 100644
--- a/meta/recipes-connectivity/iproute2/iproute2.inc
+++ b/meta/recipes-connectivity/iproute2/iproute2.inc
@@ -34,4 +34,4 @@  ALTERNATIVE_PATH = "${base_sbindir}/ip.iproute2"
 ALTERNATIVE_LINK = "${base_bindir}/ip"
 ALTERNATIVE_PRIORITY = "100"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
diff --git a/meta/recipes-connectivity/nfs-utils/nfs-utils_1.2.3.bb b/meta/recipes-connectivity/nfs-utils/nfs-utils_1.2.3.bb
index d047940..f45067e 100644
--- a/meta/recipes-connectivity/nfs-utils/nfs-utils_1.2.3.bb
+++ b/meta/recipes-connectivity/nfs-utils/nfs-utils_1.2.3.bb
@@ -22,7 +22,7 @@  SRC_URI = "${SOURCEFORGE_MIRROR}/nfs/nfs-utils-${PV}.tar.bz2 \
 SRC_URI[md5sum] = "1131dc5f27c4f3905a6e7ee0d594fd4d"
 SRC_URI[sha256sum] = "5575ece941097cbfa67fbe0d220dfa11b73f5e6d991e7939c9339bd72259ff19"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 
 # Only kernel-module-nfsd is required here (but can be built-in)  - the nfsd module will
 # pull in the remainder of the dependencies.
diff --git a/meta/recipes-core/eggdbus/eggdbus_0.6.bb b/meta/recipes-core/eggdbus/eggdbus_0.6.bb
index 75f56de..4a980d5 100644
--- a/meta/recipes-core/eggdbus/eggdbus_0.6.bb
+++ b/meta/recipes-core/eggdbus/eggdbus_0.6.bb
@@ -28,4 +28,4 @@  EXTRA_OECONF = " --disable-man-pages --disable-gtk-doc-html "
 
 BBCLASSEXTEND = "native"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
diff --git a/meta/recipes-devtools/autoconf/autoconf_2.68.bb b/meta/recipes-devtools/autoconf/autoconf_2.68.bb
index 63db7d1..fb9e04e 100644
--- a/meta/recipes-devtools/autoconf/autoconf_2.68.bb
+++ b/meta/recipes-devtools/autoconf/autoconf_2.68.bb
@@ -2,7 +2,7 @@  require autoconf.inc
 
 PR = "r5"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 
 LICENSE = "GPLv2 & GPLv3"
 LIC_FILES_CHKSUM = "file://COPYING;md5=751419260aa954499f7abaabaa882bbe \
diff --git a/meta/recipes-extended/at/at_3.1.12.bb b/meta/recipes-extended/at/at_3.1.12.bb
index f2017b7..bac5bd9 100644
--- a/meta/recipes-extended/at/at_3.1.12.bb
+++ b/meta/recipes-extended/at/at_3.1.12.bb
@@ -61,4 +61,4 @@  do_install () {
 	done
 }
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
diff --git a/meta/recipes-extended/groff/groff_1.20.1.bb b/meta/recipes-extended/groff/groff_1.20.1.bb
index 6cb72bf..618a2df 100644
--- a/meta/recipes-extended/groff/groff_1.20.1.bb
+++ b/meta/recipes-extended/groff/groff_1.20.1.bb
@@ -19,7 +19,7 @@  DEPENDS_virtclass-native = ""
 inherit autotools
 
 EXTRA_OECONF = "--without-x"
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 
 do_configure_prepend() {
 	if [ "${BUILD_SYS}" != "${HOST_SYS}" ]; then
diff --git a/meta/recipes-extended/mailx/mailx_12.5.bb b/meta/recipes-extended/mailx/mailx_12.5.bb
index 2a08113..6b6f143 100644
--- a/meta/recipes-extended/mailx/mailx_12.5.bb
+++ b/meta/recipes-extended/mailx/mailx_12.5.bb
@@ -27,4 +27,4 @@  inherit autotools
 
 CFLAGS_append = " -D_BSD_SOURCE -DDEBIAN -I${S}/EXT"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
diff --git a/meta/recipes-extended/net-tools/net-tools_1.60-23.bb b/meta/recipes-extended/net-tools/net-tools_1.60-23.bb
index 213fb60..ba8afcb 100644
--- a/meta/recipes-extended/net-tools/net-tools_1.60-23.bb
+++ b/meta/recipes-extended/net-tools/net-tools_1.60-23.bb
@@ -23,7 +23,7 @@  SRC_URI[patch.sha256sum] = "d678b3ea97d6c7ca548918994642bfc6b5511ab02f3a5881dfcc
 inherit gettext
 
 # The Makefile is lame, no parallel build
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 
 # Unlike other Debian packages, net-tools *.diff.gz contains another series of
 # patches maintained by quilt. So manually apply them before applying other local
diff --git a/meta/recipes-extended/sat-solver/sat-solver_git.bb b/meta/recipes-extended/sat-solver/sat-solver_git.bb
index 9d8422f..3095dd8 100644
--- a/meta/recipes-extended/sat-solver/sat-solver_git.bb
+++ b/meta/recipes-extended/sat-solver/sat-solver_git.bb
@@ -10,7 +10,7 @@  SRCREV = "0a7378d5f482f477a01cf1690d76871ab8bdcc32"
 PV = "0.0-git${SRCPV}"
 PR = "r13"
 
-PARALLEL_MAKE=""
+#PARALLEL_MAKE=""
 
 SRC_URI = "git://github.com/openSUSE/sat-solver.git;protocol=git \
            file://sat-solver_rpm5.patch \
diff --git a/meta/recipes-graphics/fontconfig/fontconfig_2.8.0.bb b/meta/recipes-graphics/fontconfig/fontconfig_2.8.0.bb
index 55c04cc..8814fbb 100644
--- a/meta/recipes-graphics/fontconfig/fontconfig_2.8.0.bb
+++ b/meta/recipes-graphics/fontconfig/fontconfig_2.8.0.bb
@@ -39,7 +39,7 @@  RREPLACES_fontconfig-utils = "libfontconfig-utils"
 RCONFLICTS_fontconfig-utils = "libfontconfig-utils"
 DEBIAN_NOAUTONAME_fontconfig-utils = "1"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 
 inherit autotools pkgconfig
 
diff --git a/meta/recipes-graphics/libsdl/libsdl_1.2.14.bb b/meta/recipes-graphics/libsdl/libsdl_1.2.14.bb
index 62a2d1f..a618fd1 100644
--- a/meta/recipes-graphics/libsdl/libsdl_1.2.14.bb
+++ b/meta/recipes-graphics/libsdl/libsdl_1.2.14.bb
@@ -48,7 +48,7 @@  EXTRA_OECONF = "--disable-static --disable-debug --enable-cdrom --enable-threads
 PACKAGECONFIG ??= "${@base_contains('DISTRO_FEATURES', 'alsa', 'alsa', '', d)}"
 PACKAGECONFIG[alsa] = "--enable-alsa,--disable-alsa,alsa-lib,"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 
 EXTRA_AUTORECONF += "--include=acinclude --exclude=autoheader"
 
diff --git a/meta/recipes-graphics/xcb/libpthread-stubs_0.3.bb b/meta/recipes-graphics/xcb/libpthread-stubs_0.3.bb
index c121bb9..6258794 100644
--- a/meta/recipes-graphics/xcb/libpthread-stubs_0.3.bb
+++ b/meta/recipes-graphics/xcb/libpthread-stubs_0.3.bb
@@ -8,7 +8,7 @@  LICENSE = "MIT"
 LIC_FILES_CHKSUM = "file://COPYING;md5=6edc1fea03d959f0c2d743fe5ca746ad"
 PR = "r0"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 #DEPENDS = "xcb-proto xproto libxau libxslt-native"
 # DEPENDS += "xsltproc-native gperf-native"
 
diff --git a/meta/recipes-graphics/xcb/xcb-util.inc b/meta/recipes-graphics/xcb/xcb-util.inc
index cd9923d..3b792d4 100644
--- a/meta/recipes-graphics/xcb/xcb-util.inc
+++ b/meta/recipes-graphics/xcb/xcb-util.inc
@@ -16,7 +16,7 @@  SECTION = "x11/libs"
 DEPENDS = "libxcb"
 DEPENDS += "gperf-native"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 
 SRC_URI = "http://xcb.freedesktop.org/dist/xcb-util-${PV}.tar.bz2"
 
diff --git a/meta/recipes-multimedia/pulseaudio/pulseaudio.inc b/meta/recipes-multimedia/pulseaudio/pulseaudio.inc
index ca3a28d..81f9e46 100644
--- a/meta/recipes-multimedia/pulseaudio/pulseaudio.inc
+++ b/meta/recipes-multimedia/pulseaudio/pulseaudio.inc
@@ -33,7 +33,7 @@  EXTRA_OECONF = "\
 		--with-access-group=audio \
 "
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 
 export TARGET_PFPU = "${TARGET_FPU}"
 
diff --git a/meta/recipes-multimedia/speex/speex_1.2rc1.bb b/meta/recipes-multimedia/speex/speex_1.2rc1.bb
index fe46a00..1dea8ca 100644
--- a/meta/recipes-multimedia/speex/speex_1.2rc1.bb
+++ b/meta/recipes-multimedia/speex/speex_1.2rc1.bb
@@ -14,7 +14,7 @@  SRC_URI = "http://downloads.us.xiph.org/releases/speex/speex-1.2rc1.tar.gz"
 SRC_URI[md5sum] = "c4438b22c08e5811ff10e2b06ee9b9ae"
 SRC_URI[sha256sum] = "342f30dc57bd4a6dad41398365baaa690429660b10d866b7d508e8f1179cb7a6"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 
 inherit autotools pkgconfig
 
diff --git a/meta/recipes-support/icu/icu-3.6.inc b/meta/recipes-support/icu/icu-3.6.inc
index e3f9dd2..553568e 100644
--- a/meta/recipes-support/icu/icu-3.6.inc
+++ b/meta/recipes-support/icu/icu-3.6.inc
@@ -17,7 +17,7 @@  DEPENDS_virtclass-native = ""
 
 S = "${WORKDIR}/icu/source"
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 FULL_OPTIMIZATION_arm = "-Os"
 
 inherit autotools pkgconfig binconfig
diff --git a/meta/recipes-support/libpcre/libpcre_8.21.bb b/meta/recipes-support/libpcre/libpcre_8.21.bb
index 4eb65d7..bc20762 100644
--- a/meta/recipes-support/libpcre/libpcre_8.21.bb
+++ b/meta/recipes-support/libpcre/libpcre_8.21.bb
@@ -22,7 +22,7 @@  DEPENDS = "bzip2 zlib readline"
 
 inherit autotools binconfig
 
-PARALLEL_MAKE = ""
+#PARALLEL_MAKE = ""
 
 CFLAGS_append = " -D_REENTRANT"
 CXXFLAGS_powerpc += "-lstdc++"
-- 
1.7.2.5

Comments

Khem Raj March 2, 2012, 10:37 p.m.
On Fri, Mar 2, 2012 at 2:29 PM, Yury Bushmelev <jay4mail@gmail.com> wrote:
> 2012/2/10 Khem Raj <raj.khem@gmail.com>:
>> Hi
>>
>> Just grepped for the occurances of disabled parallel make and I see
>> around 40 cases on oe-core
>>
>> git grep PARALLEL_MAKE.*=.*\"\" recipes* | grep -v "#"
>>
>> If someone has time to kill then it would help to see if some of these
>> are fixed by time or can be fixed
>>
>> it can help in paralleling the build a bit more.
>
> Well, I have some first results! :)
>
>
> 1. Recipes (files) confirmed to fail with P_M enabled (need to have
> P_M disabled as it is now):
> meta/recipes-connectivity/bind/bind_9.8.1.bb
> meta/recipes-extended/slang/slang_2.2.4.bb
> meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb
> meta/recipes-support/js/js_1.7.0+1.8.0rc1.bb
> meta/recipes-support/pth/pth_2.0.7.bb
>
>
> 2. Recipes _not_ confirmed to fail with P_M enabled (i.e. are building
> ok in my environment with P_M enabled):
> meta/recipes-bsp/pciutils/pciutils_3.1.9.bb
> meta/recipes-bsp/pcmciautils/pcmciautils.inc
> meta/recipes-connectivity/iproute2/iproute2.inc
> meta/recipes-connectivity/nfs-utils/nfs-utils_1.2.3.bb
> meta/recipes-core/eggdbus/eggdbus_0.6.bb
> meta/recipes-devtools/autoconf/autoconf_2.68.bb
> meta/recipes-extended/at/at_3.1.12.bb
> meta/recipes-extended/groff/groff_1.20.1.bb
> meta/recipes-extended/mailx/mailx_12.5.bb
> meta/recipes-extended/net-tools/net-tools_1.60-23.bb
> meta/recipes-extended/sat-solver/sat-solver_git.bb
> meta/recipes-graphics/fontconfig/fontconfig_2.8.0.bb
> meta/recipes-graphics/libsdl/libsdl_1.2.14.bb
> meta/recipes-graphics/xcb/libpthread-stubs_0.3.bb
> meta/recipes-graphics/xcb/xcb-util.inc
> meta/recipes-multimedia/pulseaudio/pulseaudio.inc
> meta/recipes-multimedia/speex/speex_1.2rc1.bb
> meta/recipes-support/icu/icu-3.6.inc
> meta/recipes-support/libpcre/libpcre_8.21.bb
>
>
> 3. Recipes not tested yet (need more work):
> meta/recipes-bsp/x-load/x-load.inc (want specific ARCH)
> meta/recipes-bsp/u-boot/u-boot.inc (multiple versions available)
> meta/recipes-core/eglibc/eglibc.inc (multiple versions available)
> meta/recipes-core/gettext/gettext_0.16.1.bb (multiple versions available)
> meta/recipes-devtools/dpkg/dpkg.inc (fetch and patch tasks are failed)
> meta/recipes-devtools/gcc/gcc-cross-canadian_4.6.bb (can't remember actually...)
> meta/recipes-devtools/mtd/mtd-utils_1.4.9.bb (multiple versions available)
> meta/recipes-devtools/mtd/mtd-utils_1.1.0+git.bb (multiple versions available)
> meta/recipes-devtools/valgrind/valgrind_3.7.0.bb (want specific ARCH)
> meta/recipes-extended/bash/bash_3.2.48.bb (multiple versions available)
> meta/recipes-extended/bash/bash.inc (multiple versions available)
> meta/recipes-graphics/xcb/libxcb.inc (multiple versions available)
>
>
> 4. Recipes with PARALLEL_MAKEINST disabled (not tested yet as well):
> meta/recipes-connectivity/openssl/openssl_1.0.0g.bb
> meta/recipes-extended/ghostscript/ghostscript_9.04.bb
> meta/recipes-devtools/mtools/mtools_3.9.9.bb
> meta/recipes-devtools/mtools/mtools_4.0.17.bb
>
>
> Recipes from list #2 was tested with BB_THREAD_NUMBER="6" and
> PARALLEL_MAKE="-j 5" for ARCH'es: qemuarm, qemumips and qemux86.
>
> I've attached patch which enable P_M for recipes from list #2. I hope
> someone else will test it in own environment (not safe for production,
> use separate branch).

Thanks for doing the work. I will try the patch here and I encourage
other folks with beefy builders to try it out as well. You should have
deleted PARALLEL_MAKE = "" instead of commenting it out.
Richard Purdie March 2, 2012, 10:39 p.m.
On Sat, 2012-03-03 at 01:29 +0300, Yury Bushmelev wrote:
> 2012/2/10 Khem Raj <raj.khem@gmail.com>:
> > Hi
> >
> > Just grepped for the occurances of disabled parallel make and I see
> > around 40 cases on oe-core
> >
> > git grep PARALLEL_MAKE.*=.*\"\" recipes* | grep -v "#"
> >
> > If someone has time to kill then it would help to see if some of these
> > are fixed by time or can be fixed
> >
> > it can help in paralleling the build a bit more.
> 
> Well, I have some first results! :)
> 
> 
> 1. Recipes (files) confirmed to fail with P_M enabled (need to have
> P_M disabled as it is now):
> meta/recipes-connectivity/bind/bind_9.8.1.bb
> meta/recipes-extended/slang/slang_2.2.4.bb
> meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb
> meta/recipes-support/js/js_1.7.0+1.8.0rc1.bb
> meta/recipes-support/pth/pth_2.0.7.bb
> 
> 
> 2. Recipes _not_ confirmed to fail with P_M enabled (i.e. are building
> ok in my environment with P_M enabled):
> meta/recipes-bsp/pciutils/pciutils_3.1.9.bb
> meta/recipes-bsp/pcmciautils/pcmciautils.inc
> meta/recipes-connectivity/iproute2/iproute2.inc
> meta/recipes-connectivity/nfs-utils/nfs-utils_1.2.3.bb
> meta/recipes-core/eggdbus/eggdbus_0.6.bb
> meta/recipes-devtools/autoconf/autoconf_2.68.bb
> meta/recipes-extended/at/at_3.1.12.bb
> meta/recipes-extended/groff/groff_1.20.1.bb
> meta/recipes-extended/mailx/mailx_12.5.bb
> meta/recipes-extended/net-tools/net-tools_1.60-23.bb
> meta/recipes-extended/sat-solver/sat-solver_git.bb
> meta/recipes-graphics/fontconfig/fontconfig_2.8.0.bb
> meta/recipes-graphics/libsdl/libsdl_1.2.14.bb
> meta/recipes-graphics/xcb/libpthread-stubs_0.3.bb
> meta/recipes-graphics/xcb/xcb-util.inc
> meta/recipes-multimedia/pulseaudio/pulseaudio.inc
> meta/recipes-multimedia/speex/speex_1.2rc1.bb
> meta/recipes-support/icu/icu-3.6.inc
> meta/recipes-support/libpcre/libpcre_8.21.bb
> 
> 
> 3. Recipes not tested yet (need more work):
> meta/recipes-bsp/x-load/x-load.inc (want specific ARCH)
> meta/recipes-bsp/u-boot/u-boot.inc (multiple versions available)
> meta/recipes-core/eglibc/eglibc.inc (multiple versions available)
> meta/recipes-core/gettext/gettext_0.16.1.bb (multiple versions available)
> meta/recipes-devtools/dpkg/dpkg.inc (fetch and patch tasks are failed)
> meta/recipes-devtools/gcc/gcc-cross-canadian_4.6.bb (can't remember actually...)
> meta/recipes-devtools/mtd/mtd-utils_1.4.9.bb (multiple versions available)
> meta/recipes-devtools/mtd/mtd-utils_1.1.0+git.bb (multiple versions available)
> meta/recipes-devtools/valgrind/valgrind_3.7.0.bb (want specific ARCH)
> meta/recipes-extended/bash/bash_3.2.48.bb (multiple versions available)
> meta/recipes-extended/bash/bash.inc (multiple versions available)
> meta/recipes-graphics/xcb/libxcb.inc (multiple versions available)
> 
> 
> 4. Recipes with PARALLEL_MAKEINST disabled (not tested yet as well):
> meta/recipes-connectivity/openssl/openssl_1.0.0g.bb
> meta/recipes-extended/ghostscript/ghostscript_9.04.bb
> meta/recipes-devtools/mtools/mtools_3.9.9.bb
> meta/recipes-devtools/mtools/mtools_4.0.17.bb

FWIW, this last set of PARALLEL_MAKEINST are very recent and very likely
to break. I'd concentrate on those last.

Cheers,

Richard
Khem Raj March 2, 2012, 11:30 p.m.
On Fri, Mar 2, 2012 at 2:29 PM, Yury Bushmelev <jay4mail@gmail.com> wrote:
>
> 3. Recipes not tested yet (need more work):
> meta/recipes-bsp/x-load/x-load.inc (want specific ARCH)
> meta/recipes-bsp/u-boot/u-boot.inc (multiple versions available)
> meta/recipes-core/eglibc/eglibc.inc (multiple versions available)

eglibc is already built parallel. It uses a different flag
EGLIBCPARALLELISM which directly derived from PARALLEL_MAKE
since eglibc uses PARALLELMFLAGS="-j X"
Yuri Bushmelev March 3, 2012, 7:48 a.m.
2012/3/3 Yury Bushmelev <jay4mail@gmail.com>:
> 2012/2/10 Khem Raj <raj.khem@gmail.com>:
>> Hi
>>
>> Just grepped for the occurances of disabled parallel make and I see
>> around 40 cases on oe-core
[skip]

> 2. Recipes _not_ confirmed to fail with P_M enabled (i.e. are building
> ok in my environment with P_M enabled):
[skip]
> meta/recipes-extended/net-tools/net-tools_1.60-23.bb

net-tools confirmed to fail with P_M disabled when build was run with
BB_N_T="7" and P_M="-j 7".
Khem Raj March 3, 2012, 7:55 p.m.
On Fri, Mar 2, 2012 at 11:48 PM, Yury Bushmelev <jay4mail@gmail.com> wrote:
>> meta/recipes-extended/net-tools/net-tools_1.60-23.bb
>
> net-tools confirmed to fail with P_M disabled when build was run with
> BB_N_T="7" and P_M="-j 7".

hmmm this is reversal of course. so I guess in order to declare them good
they should be compiled in variety of combinations.
Yuri Bushmelev March 3, 2012, 10:15 p.m.
2012/3/3 Khem Raj <raj.khem@gmail.com>:
> On Fri, Mar 2, 2012 at 11:48 PM, Yury Bushmelev <jay4mail@gmail.com> wrote:
>>> meta/recipes-extended/net-tools/net-tools_1.60-23.bb
>>
>> net-tools confirmed to fail with P_M disabled when build was run with
>> BB_N_T="7" and P_M="-j 7".
>
> hmmm this is reversal of course. so I guess in order to declare them good
> they should be compiled in variety of combinations.

Doing this today. Tested P_M in range [2..7]. Following 2 recipes
failed and gone to list #1:

meta/recipes-core/eggdbus/eggdbus_0.6.bb
meta/recipes-extended/net-tools/net-tools_1.60-23.bb

I'll run some more extreme builds tonight.
Andreas Oberritter March 8, 2012, 1:34 p.m.
On 02.03.2012 23:29, Yury Bushmelev wrote:
> 2012/2/10 Khem Raj <raj.khem@gmail.com>:
>> Hi
>>
>> Just grepped for the occurances of disabled parallel make and I see
>> around 40 cases on oe-core
>>
>> git grep PARALLEL_MAKE.*=.*\"\" recipes* | grep -v "#"
>>
>> If someone has time to kill then it would help to see if some of these
>> are fixed by time or can be fixed
>>
>> it can help in paralleling the build a bit more.
> 
> Well, I have some first results! :)
> 
> 
> 1. Recipes (files) confirmed to fail with P_M enabled (need to have
> P_M disabled as it is now):
> meta/recipes-connectivity/bind/bind_9.8.1.bb
> meta/recipes-extended/slang/slang_2.2.4.bb
> meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb
> meta/recipes-support/js/js_1.7.0+1.8.0rc1.bb
> meta/recipes-support/pth/pth_2.0.7.bb

meta/recipes-devtools/libtool/libtool_2.4.2.bb might need disabled
P_M, too:

| ./mipsel-oe-linux-libtool  --tag=CC   --mode=compile ccache mipsel-oe-linux-gcc  -mel -mabi=32   -mhard-float -march=mips32 --sysroot=.../tmp/sysroots/dm7020hd -DHAVE_CONFIG_H -I.  -DLTDLOPEN=libltdl -DLT_CONFIG_H='<config.h>' -DLTDL -I. -I. -Ilibltdl -I./libltdl -I./libltdl/libltdl   -Os -pipe -g -feliminate-unused-debug-types -c -o libltdl/libltdl_libltdl_la-slist.lo `test -f 'libltdl/slist.c' || echo './'`libltdl/slist.c
| /bin/sh: ./mipsel-oe-linux-libtool: /bin/sh: bad interpreter: Text file busy
| make[2]: *** [libltdl/libltdl_libltdl_la-slist.lo] Error 126
| make[2]: *** Waiting for unfinished jobs....

This was a fresh build with clean tmp and sstate-cache. I've just
seen this failue for the first time.

BB_NUMBER_THREADS = "4"
PARALLEL_MAKE = "-j 4"

Regards,
Andreas
McClintock Matthew-B29882 Oct. 10, 2012, 1:45 a.m.
On Thu, Mar 8, 2012 at 7:34 AM, Andreas Oberritter <obi@opendreambox.org> wrote:
> On 02.03.2012 23:29, Yury Bushmelev wrote:
>> 2012/2/10 Khem Raj <raj.khem@gmail.com>:
>>> Hi
>>>
>>> Just grepped for the occurances of disabled parallel make and I see
>>> around 40 cases on oe-core
>>>
>>> git grep PARALLEL_MAKE.*=.*\"\" recipes* | grep -v "#"
>>>
>>> If someone has time to kill then it would help to see if some of these
>>> are fixed by time or can be fixed
>>>
>>> it can help in paralleling the build a bit more.
>>
>> Well, I have some first results! :)
>>
>>
>> 1. Recipes (files) confirmed to fail with P_M enabled (need to have
>> P_M disabled as it is now):
>> meta/recipes-connectivity/bind/bind_9.8.1.bb
>> meta/recipes-extended/slang/slang_2.2.4.bb
>> meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb
>> meta/recipes-support/js/js_1.7.0+1.8.0rc1.bb
>> meta/recipes-support/pth/pth_2.0.7.bb
>
> meta/recipes-devtools/libtool/libtool_2.4.2.bb might need disabled
> P_M, too:
>
> | ./mipsel-oe-linux-libtool  --tag=CC   --mode=compile ccache mipsel-oe-linux-gcc  -mel -mabi=32   -mhard-float -march=mips32 --sysroot=.../tmp/sysroots/dm7020hd -DHAVE_CONFIG_H -I.  -DLTDLOPEN=libltdl -DLT_CONFIG_H='<config.h>' -DLTDL -I. -I. -Ilibltdl -I./libltdl -I./libltdl/libltdl   -Os -pipe -g -feliminate-unused-debug-types -c -o libltdl/libltdl_libltdl_la-slist.lo `test -f 'libltdl/slist.c' || echo './'`libltdl/slist.c
> | /bin/sh: ./mipsel-oe-linux-libtool: /bin/sh: bad interpreter: Text file busy
> | make[2]: *** [libltdl/libltdl_libltdl_la-slist.lo] Error 126
> | make[2]: *** Waiting for unfinished jobs....
>
> This was a fresh build with clean tmp and sstate-cache. I've just
> seen this failue for the first time.
>
> BB_NUMBER_THREADS = "4"
> PARALLEL_MAKE = "-j 4"

I'm seeing this on denzil on Ubuntu 10.04.2 LTS 32-bit.

-M
Ross Burton Oct. 10, 2012, 9:16 a.m.
Hi Matthew,

On 10 October 2012 02:45, McClintock Matthew-B29882
<B29882@freescale.com> wrote:
>>> 1. Recipes (files) confirmed to fail with P_M enabled (need to have
>>> P_M disabled as it is now):
>>> meta/recipes-connectivity/bind/bind_9.8.1.bb
>>> meta/recipes-extended/slang/slang_2.2.4.bb
>>> meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb
>>> meta/recipes-support/js/js_1.7.0+1.8.0rc1.bb
>>> meta/recipes-support/pth/pth_2.0.7.bb

Lack of parallelism is one of those things that really bugs me...

Do you still have the failure logs to hand?  I'd love to see a patch
which put the failure alongside the PARALLEL_MAKE=0.  It's also
probably worth removing the PARALLEL_MAKE for the other targets once
master opens for development and seeing if they break on the
autobuilders (as some parallel races are rare to hit).

Ross
Richard Purdie Oct. 10, 2012, 10:06 a.m.
On Wed, 2012-10-10 at 10:16 +0100, Burton, Ross wrote:
> Hi Matthew,
> 
> On 10 October 2012 02:45, McClintock Matthew-B29882
> <B29882@freescale.com> wrote:
> >>> 1. Recipes (files) confirmed to fail with P_M enabled (need to have
> >>> P_M disabled as it is now):
> >>> meta/recipes-connectivity/bind/bind_9.8.1.bb
> >>> meta/recipes-extended/slang/slang_2.2.4.bb
> >>> meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb
> >>> meta/recipes-support/js/js_1.7.0+1.8.0rc1.bb
> >>> meta/recipes-support/pth/pth_2.0.7.bb
> 
> Lack of parallelism is one of those things that really bugs me...
> 
> Do you still have the failure logs to hand?  I'd love to see a patch
> which put the failure alongside the PARALLEL_MAKE=0.  It's also
> probably worth removing the PARALLEL_MAKE for the other targets once
> master opens for development and seeing if they break on the
> autobuilders (as some parallel races are rare to hit).

We've done this in the archives, the PARALLEL_MAKE entries we have are
pretty much all needed, sadly. I'm not breaking master on the
autobuilder by removing them "just for fun".

Cheers,

Richard
McClintock Matthew-B29882 Oct. 10, 2012, 2:04 p.m.
On Wed, Oct 10, 2012 at 4:16 AM, Burton, Ross <ross.burton@intel.com> wrote:
> Hi Matthew,
>
> On 10 October 2012 02:45, McClintock Matthew-B29882
> <B29882@freescale.com> wrote:
>>>> 1. Recipes (files) confirmed to fail with P_M enabled (need to have
>>>> P_M disabled as it is now):
>>>> meta/recipes-connectivity/bind/bind_9.8.1.bb
>>>> meta/recipes-extended/slang/slang_2.2.4.bb
>>>> meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb
>>>> meta/recipes-support/js/js_1.7.0+1.8.0rc1.bb
>>>> meta/recipes-support/pth/pth_2.0.7.bb
>
> Lack of parallelism is one of those things that really bugs me...
>
> Do you still have the failure logs to hand?  I'd love to see a patch
> which put the failure alongside the PARALLEL_MAKE=0.  It's also
> probably worth removing the PARALLEL_MAKE for the other targets once
> master opens for development and seeing if they break on the
> autobuilders (as some parallel races are rare to hit).

I want to add it's still a quite rare occurrence... it's just one of
those things you hate to see ;) Logs attached.

-M