[yocto-autobuilder-helper,2/4] config.json: collect data by default

Submitted by Sakib Sajal on April 13, 2021, 5:02 p.m. | Patch ID: 179621

Details

Message ID 20210413170210.72845-2-sakib.sajal@windriver.com
State New
Headers show

Commit Message

Sakib Sajal April 13, 2021, 5:02 p.m.
add the variables required to collect data to "defaults"
so that data is collected on all builds.

Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com>
Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
---
 config.json | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

Patch hide | download patch | download mbox

diff --git a/config.json b/config.json
index c43d231..cd82047 100644
--- a/config.json
+++ b/config.json
@@ -55,7 +55,10 @@ 
             "SDK_INCLUDE_TOOLCHAIN = '1'",
             "BB_DISKMON_DIRS = 'STOPTASKS,${TMPDIR},1G,100K STOPTASKS,${DL_DIR},1G STOPTASKS,${SSTATE_DIR},1G STOPTASKS,/tmp,100M,100K ABORT,${TMPDIR},100M,1K ABORT,${DL_DIR},100M ABORT,${SSTATE_DIR},100M ABORT,/tmp,10M,1K'",
             "BB_HASHSERVE = 'typhoon.yocto.io:8686'",
-            "RUNQEMU_TMPFS_DIR = '/home/pokybuild/tmp'"
+            "RUNQEMU_TMPFS_DIR = '/home/pokybuild/tmp'",
+            "BB_HEARTBEAT_EVENT = '10'",
+            "BB_LOG_HOST_STAT_ON_INTERVAL = '1'",
+            "BB_LOG_HOST_STAT_CMDS = 'oe-time-dd-test.sh 100'"
         ]
     },
     "templates" : {

Comments

Richard Purdie April 16, 2021, 8:28 a.m.
On Tue, 2021-04-13 at 13:02 -0400, sakib.sajal@windriver.com wrote:
> add the variables required to collect data to "defaults"
> so that data is collected on all builds.
> 
> Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com>
> Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
> ---
>  config.json | 5 ++++-
>  1 file changed, 4 insertions(+), 1 deletion(-)
> 
> diff --git a/config.json b/config.json
> index c43d231..cd82047 100644
> --- a/config.json
> +++ b/config.json
> @@ -55,7 +55,10 @@
>              "SDK_INCLUDE_TOOLCHAIN = '1'",
>              "BB_DISKMON_DIRS = 'STOPTASKS,${TMPDIR},1G,100K STOPTASKS,${DL_DIR},1G STOPTASKS,${SSTATE_DIR},1G STOPTASKS,/tmp,100M,100K ABORT,${TMPDIR},100M,1K ABORT,${DL_DIR},100M ABORT,${SSTATE_DIR},100M ABORT,/tmp,10M,1K'",
>              "BB_HASHSERVE = 'typhoon.yocto.io:8686'",
> -            "RUNQEMU_TMPFS_DIR = '/home/pokybuild/tmp'"
> +            "RUNQEMU_TMPFS_DIR = '/home/pokybuild/tmp'",
> +            "BB_HEARTBEAT_EVENT = '10'",
> +            "BB_LOG_HOST_STAT_ON_INTERVAL = '1'",
> +            "BB_LOG_HOST_STAT_CMDS = 'oe-time-dd-test.sh 100'"
>          ]
>      },
>      "templates" : {

I merged 2-4 of this series, unfortunately this resulted in a few issues overnight:

https://autobuilder.yoctoproject.org/typhoon/#/builders/85/builds/1393

which is due to the non-executable script which there is a patch for, it just
wasn't in master due to the release. I've fixed that by merging the patches.

The bigger issue is the performance metrics which this broke:

https://autobuilder.yoctoproject.org/typhoon/#/builders/91/builds/4427
https://autobuilder.yoctoproject.org/typhoon/#/builders/92/builds/4453

We're going to need to disable these events on the performance metrics
targets...

Cheers,

Richard
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#53153): https://lists.yoctoproject.org/g/yocto/message/53153
Mute This Topic: https://lists.yoctoproject.org/mt/82074297/3617530
Group Owner: yocto+owner@lists.yoctoproject.org
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub [oe-patchwork@oe-patch.openembedded.org]
-=-=-=-=-=-=-=-=-=-=-=-
Richard Purdie April 16, 2021, 9:05 a.m.
On Fri, 2021-04-16 at 09:28 +0100, Richard Purdie via lists.yoctoproject.org wrote:
> On Tue, 2021-04-13 at 13:02 -0400, sakib.sajal@windriver.com wrote:
> > add the variables required to collect data to "defaults"
> > so that data is collected on all builds.
> > 
> > Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com>
> > Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
> > ---
> >  config.json | 5 ++++-
> >  1 file changed, 4 insertions(+), 1 deletion(-)
> > 
> > diff --git a/config.json b/config.json
> > index c43d231..cd82047 100644
> > --- a/config.json
> > +++ b/config.json
> > @@ -55,7 +55,10 @@
> >              "SDK_INCLUDE_TOOLCHAIN = '1'",
> >              "BB_DISKMON_DIRS = 'STOPTASKS,${TMPDIR},1G,100K STOPTASKS,${DL_DIR},1G STOPTASKS,${SSTATE_DIR},1G STOPTASKS,/tmp,100M,100K ABORT,${TMPDIR},100M,1K ABORT,${DL_DIR},100M ABORT,${SSTATE_DIR},100M ABORT,/tmp,10M,1K'",
> >              "BB_HASHSERVE = 'typhoon.yocto.io:8686'",
> > -            "RUNQEMU_TMPFS_DIR = '/home/pokybuild/tmp'"
> > +            "RUNQEMU_TMPFS_DIR = '/home/pokybuild/tmp'",
> > +            "BB_HEARTBEAT_EVENT = '10'",
> > +            "BB_LOG_HOST_STAT_ON_INTERVAL = '1'",
> > +            "BB_LOG_HOST_STAT_CMDS = 'oe-time-dd-test.sh 100'"
> >          ]
> >      },
> >      "templates" : {
> 
> I merged 2-4 of this series, unfortunately this resulted in a few issues overnight:
> 
> https://autobuilder.yoctoproject.org/typhoon/#/builders/85/builds/1393
> 
> which is due to the non-executable script which there is a patch for, it just
> wasn't in master due to the release. I've fixed that by merging the patches.
> 
> The bigger issue is the performance metrics which this broke:
> 
> https://autobuilder.yoctoproject.org/typhoon/#/builders/91/builds/4427
> https://autobuilder.yoctoproject.org/typhoon/#/builders/92/builds/4453
> 
> We're going to need to disable these events on the performance metrics
> targets...

There is also another issue as BB_HEARTBEAT_EVENT defaults to 1, the change to 10 
changes the default timings for buildstats and other pieces of code. In particular
I suspect this is breaking:

https://autobuilder.yoctoproject.org/typhoon/#/builders/80/builds/1993

and again in:

https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2014

in the disk monitoring selftest...

Cheers,

Richard
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#53154): https://lists.yoctoproject.org/g/yocto/message/53154
Mute This Topic: https://lists.yoctoproject.org/mt/82074297/3617530
Group Owner: yocto+owner@lists.yoctoproject.org
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub [oe-patchwork@oe-patch.openembedded.org]
-=-=-=-=-=-=-=-=-=-=-=-