Patchwork [bitbake-devel] cache broken in master

login
mail settings
Submitter Dongxiao Xu
Date Feb. 25, 2012, 6:56 a.m.
Message ID <1330153006.1957.10.camel@dongxiao-osel>
Download mbox | patch
Permalink /patch/22039/
State New
Headers show

Comments

Dongxiao Xu - Feb. 25, 2012, 6:56 a.m.
On Sat, 2012-02-25 at 00:47 +0100, Andreas Oberritter wrote:
> Hi,
> 
> commit 1c1df03a6c4717bfd5faab144c4f8bbfcbae0b57 broke bitbake's
> dependency cache for me, i.e. it parses all recipes on every invocation
> and always displays "(0 cached, 1269 parsed)". Deleting tmp/cache didn't
> help. Reverting this commit restores the functionality.

Hi Andreas,

Sorry for the inconvenience that this commit brought to you.

Could you help to try the following and send me your "/tmp/1.log
and /tmp/2.log"?

1) apply the attached "cache_debug.patch"
2) remove tmp/cache
3) bitbake -p &> /tmp/1.log
4) bitbake -p &> /tmp/2.log

Besides, you can have a try of the attached cache_whitelist.patch to see
if it fixes your problem.

Thanks,
Dongxiao

> 
> Regards,
> Andreas
Andreas Oberritter - Feb. 26, 2012, 6:30 p.m.
Hello Dongxiao,

On 25.02.2012 07:56, Xu, Dongxiao wrote:
> On Sat, 2012-02-25 at 00:47 +0100, Andreas Oberritter wrote:
>> Hi,
>>
>> commit 1c1df03a6c4717bfd5faab144c4f8bbfcbae0b57 broke bitbake's
>> dependency cache for me, i.e. it parses all recipes on every invocation
>> and always displays "(0 cached, 1269 parsed)". Deleting tmp/cache didn't
>> help. Reverting this commit restores the functionality.
> 
> Hi Andreas,
> 
> Sorry for the inconvenience that this commit brought to you.
> 
> Could you help to try the following and send me your "/tmp/1.log
> and /tmp/2.log"?
> 
> 1) apply the attached "cache_debug.patch"
> 2) remove tmp/cache
> 3) bitbake -p &> /tmp/1.log
> 4) bitbake -p &> /tmp/2.log
> 
> Besides, you can have a try of the attached cache_whitelist.patch to see
> if it fixes your problem.

your patch cache_whitelist.patch fixes the problem. Thanks!

Regards,
Andreas
Martin Jansa - Feb. 26, 2012, 11:05 p.m.
On Sun, Feb 26, 2012 at 7:30 PM, Andreas Oberritter
<obi@opendreambox.org> wrote:
> Hello Dongxiao,
>
> On 25.02.2012 07:56, Xu, Dongxiao wrote:
>> On Sat, 2012-02-25 at 00:47 +0100, Andreas Oberritter wrote:
>>> Hi,
>>>
>>> commit 1c1df03a6c4717bfd5faab144c4f8bbfcbae0b57 broke bitbake's
>>> dependency cache for me, i.e. it parses all recipes on every invocation
>>> and always displays "(0 cached, 1269 parsed)". Deleting tmp/cache didn't
>>> help. Reverting this commit restores the functionality.
>>
>> Hi Andreas,
>>
>> Sorry for the inconvenience that this commit brought to you.
>>
>> Could you help to try the following and send me your "/tmp/1.log
>> and /tmp/2.log"?
>>
>> 1) apply the attached "cache_debug.patch"
>> 2) remove tmp/cache
>> 3) bitbake -p &> /tmp/1.log
>> 4) bitbake -p &> /tmp/2.log
>>
>> Besides, you can have a try of the attached cache_whitelist.patch to see
>> if it fixes your problem.

I see the same change in behavior here.

> your patch cache_whitelist.patch fixes the problem. Thanks!

unfortunately doesn't seem to fix it here.

I'll send requested debug info tomorrow, unless someone beats me to it

>
> Regards,
> Andreas
>
> _______________________________________________
> bitbake-devel mailing list
> bitbake-devel@lists.openembedded.org
> http://lists.linuxtogo.org/cgi-bin/mailman/listinfo/bitbake-devel
Martin Jansa - Feb. 27, 2012, 6:48 a.m.
On Mon, Feb 27, 2012 at 08:41:36AM +0800, Xu, Dongxiao wrote:
> On Mon, 2012-02-27 at 00:05 +0100, Martin Jansa wrote:
> > On Sun, Feb 26, 2012 at 7:30 PM, Andreas Oberritter
> > <obi@opendreambox.org> wrote:
> > > Hello Dongxiao,
> > >
> > > On 25.02.2012 07:56, Xu, Dongxiao wrote:
> > >> On Sat, 2012-02-25 at 00:47 +0100, Andreas Oberritter wrote:
> > >>> Hi,
> > >>>
> > >>> commit 1c1df03a6c4717bfd5faab144c4f8bbfcbae0b57 broke bitbake's
> > >>> dependency cache for me, i.e. it parses all recipes on every invocation
> > >>> and always displays "(0 cached, 1269 parsed)". Deleting tmp/cache didn't
> > >>> help. Reverting this commit restores the functionality.
> > >>
> > >> Hi Andreas,
> > >>
> > >> Sorry for the inconvenience that this commit brought to you.
> > >>
> > >> Could you help to try the following and send me your "/tmp/1.log
> > >> and /tmp/2.log"?
> > >>
> > >> 1) apply the attached "cache_debug.patch"
> > >> 2) remove tmp/cache
> > >> 3) bitbake -p &> /tmp/1.log
> > >> 4) bitbake -p &> /tmp/2.log
> > >>
> > >> Besides, you can have a try of the attached cache_whitelist.patch to see
> > >> if it fixes your problem.
> > 
> > I see the same change in behavior here.
> > 
> > > your patch cache_whitelist.patch fixes the problem. Thanks!
> > 
> > unfortunately doesn't seem to fix it here.
> > 
> > I'll send requested debug info tomorrow, unless someone beats me to it
> 
> Thanks Martin.
> 
> Andreas, it seems that the cache case in your side is different with
> Martin's. So hope you can also send me your debug info, I am really
> appreciate for that.

Hi,

sorry for noise, but it seems it does work with your patch now.. maybe
it was because yesterday I was fixing those quoting errors and it didn't
save cache because it found parsing error in the process and then I was
switching machines and it's probably expected to reparse all once for
each machine (as the cache is at least here in machine specific path
tmp-eglibc/cache/default-eglibc/om-gta02).

Cheers,

> 
> Thanks,
> Dongxiao
> 
> > 
> > >
> > > Regards,
> > > Andreas
> > >
> > > _______________________________________________
> > > bitbake-devel mailing list
> > > bitbake-devel@lists.openembedded.org
> > > http://lists.linuxtogo.org/cgi-bin/mailman/listinfo/bitbake-devel
> > 
> > _______________________________________________
> > bitbake-devel mailing list
> > bitbake-devel@lists.openembedded.org
> > http://lists.linuxtogo.org/cgi-bin/mailman/listinfo/bitbake-devel
> 
>
Martin Jansa - March 10, 2012, 7:44 a.m.
On Sat, Feb 25, 2012 at 7:56 AM, Xu, Dongxiao <dongxiao.xu@intel.com> wrote:
> On Sat, 2012-02-25 at 00:47 +0100, Andreas Oberritter wrote:
>> Hi,
>>
>> commit 1c1df03a6c4717bfd5faab144c4f8bbfcbae0b57 broke bitbake's
>> dependency cache for me, i.e. it parses all recipes on every invocation
>> and always displays "(0 cached, 1269 parsed)". Deleting tmp/cache didn't
>> help. Reverting this commit restores the functionality.
>
> Hi Andreas,
>
> Sorry for the inconvenience that this commit brought to you.
>
> Could you help to try the following and send me your "/tmp/1.log
> and /tmp/2.log"?
>
> 1) apply the attached "cache_debug.patch"
> 2) remove tmp/cache
> 3) bitbake -p &> /tmp/1.log
> 4) bitbake -p &> /tmp/2.log
>
> Besides, you can have a try of the attached cache_whitelist.patch to see
> if it fixes your problem.

Today I noticed another cache rebuild, here is diff from parse output:

3286c3286
< XAUTHORITY: /root/.xauthljqB8X
---
> XAUTHORITY: /root/.xauth1of3YX
3532c3532
< PSEUDO_BUILD: 2
---
> PSEUDO_BUILD: 0
5223c5222
< _: /OE/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/bin/pseudo
---
> _: /usr/bin/bitbake

and long one BBINCLUDED where only order of some items was changed:
@@ -21,13 +21,14 @@
 /OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass
 /OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc
 /OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf
-/OE/shr-core/openembedded-core/meta/conf/bitbake.conf
 /OE/shr-core/openembedded-core/meta/classes/package.bbclass
 /OE/shr-core/openembedded-core/meta/conf/abi_version.conf
 /OE/shr-core/meta-handheld/conf/layer.conf
 /OE/shr-core/openembedded-core/meta/classes/license.bbclass
 /OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc
+/OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
 /OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc
+/OE/shr-core/openembedded-core/meta/conf/bitbake.conf
 /OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc
 /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc
 /OE/shr-core/meta-smartphone/meta-samsung/conf/layer.conf
@@ -37,7 +38,6 @@
 /OE/shr-core/openembedded-core/meta/conf/distro/defaultsetup.conf
 /OE/shr-core/meta-jama/conf/layer.conf
 /OE/shr-core/meta-openembedded/meta-gnome/conf/layer.conf
-/OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
 /OE/shr-core/meta-smartphone/meta-aurora/conf/layer.conf
 /OE/shr-core/openembedded-core/meta/classes/debian.bbclass
 /OE/shr-core/openembedded-core/meta/conf/layer.conf

391c391
< BBINCLUDED: /OE/shr-core/conf/local.conf
/OE/shr-core/conf/local-builds.inc
/OE/shr-core/openembedded-core/meta/classes/patch.bbclass
/OE/shr-core/openembedded-core/meta/conf/machine-sdk/x86_64.conf
/OE/shr-core/meta-smartphone/meta-palm/conf/layer.conf
/OE/shr-core/openembedded-core/meta/conf/documentation.conf
/OE/shr-core/meta-openembedded/meta-oe/conf/layer.conf
/OE/shr-core/openembedded-core/meta/conf/distro/include/tclibc-eglibc.inc
/OE/shr-core/openembedded-core/meta/classes/packagedata.bbclass
/OE/shr-core/openembedded-core/meta/conf/distro/include/default-providers.inc
/OE/shr-core/openembedded-core/meta/classes/package_ipk.bbclass
/OE/shr-core/openembedded-core/meta/classes/logging.bbclass
/OE/shr-core/openembedded-core/meta/classes/devshell.bbclass
/OE/shr-core/openembedded-core/meta/classes/insane.bbclass
/OE/shr-core/openembedded-core/meta/classes/sstate.bbclass
/OE/shr-core/openembedded-core/meta/conf/distro/include/as-needed.inc
/OE/shr-core/meta-openembedded/meta-gpe/conf/layer.conf
/OE/shr-core/meta-smartphone/meta-htc/conf/layer.conf
/OE/shr-core/meta-smartphone/meta-openmoko/conf/layer.conf
/OE/shr-core/conf/bblayers.conf
/OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass
/OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc
/OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf
/OE/shr-core/openembedded-core/meta/conf/bitbake.conf
/OE/shr-core/openembedded-core/meta/classes/package.bbclass
/OE/shr-core/openembedded-core/meta/conf/abi_version.conf
/OE/shr-core/meta-handheld/conf/layer.conf
/OE/shr-core/openembedded-core/meta/classes/license.bbclass
/OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc
/OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc
/OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc
/OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc
/OE/shr-core/meta-smartphone/meta-samsung/conf/layer.conf
/OE/shr-core/conf/auto.conf
/OE/shr-core/meta-smartphone/meta-fso/conf/layer.conf
/OE/shr-core/openembedded-core/meta/classes/staging.bbclass
/OE/shr-core/openembedded-core/meta/conf/distro/defaultsetup.conf
/OE/shr-core/meta-jama/conf/layer.conf
/OE/shr-core/meta-openembedded/meta-gnome/conf/layer.conf
/OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
/OE/shr-core/meta-smartphone/meta-aurora/conf/layer.conf
/OE/shr-core/openembedded-core/meta/classes/debian.bbclass
/OE/shr-core/openembedded-core/meta/conf/layer.conf
/OE/shr-core/openembedded-core/meta/conf/distro/include/world-broken.inc
/OE/shr-core/meta-openembedded/meta-initramfs/conf/layer.conf
/OE/shr-core/openembedded-core/meta/classes/prserv.bbclass
/OE/shr-core/openembedded-core/meta/classes/rm_work.bbclass
/OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-arm.inc
/OE/shr-core/openembedded-core/meta/classes/utility-tasks.bbclass
/OE/shr-core/meta-openembedded/meta-efl/conf/distro/include/efl-from-svn.inc
/OE/shr-core/openembedded-core/meta/conf/sanity.conf
/OE/shr-core/openembedded-core/meta/classes/metadata_scm.bbclass
/OE/shr-core/openembedded-core/meta/classes/utils.bbclass
/OE/shr-core/openembedded-core/meta/classes/buildhistory.bbclass
/OE/shr-core/openembedded-core/meta/conf/distro/include/default-distrovars.inc
/OE/shr-core/openembedded-core/meta/classes/terminal.bbclass
/OE/shr-core/openembedded-core/meta/classes/sanity.bbclass
/OE/shr-core/conf/site.conf
/OE/shr-core/openembedded-core/meta/classes/mirrors.bbclass
/OE/shr-core/meta-smartphone/meta-nokia/conf/layer.conf
/OE/shr-core/meta-openembedded/meta-oe/classes/blacklist.bbclass
/OE/shr-core/meta-openembedded/meta-efl/conf/layer.conf
/OE/shr-core/openembedded-core/meta/classes/base.bbclass
/OE/shr-core/meta-mozilla/conf/layer.conf
/OE/shr-core/openembedded-core/meta/conf/machine/include/arm/feature-arm-thumb.inc
/OE/shr-core/meta-smartphone/meta-shr/conf/layer.conf
---
> BBINCLUDED: /OE/shr-core/conf/local.conf /OE/shr-core/conf/local-builds.inc /OE/shr-core/openembedded-core/meta/classes/patch.bbclass /OE/shr-core/openembedded-core/meta/conf/machine-sdk/x86_64.conf /OE/shr-core/meta-smartphone/meta-palm/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/documentation.conf /OE/shr-core/meta-openembedded/meta-oe/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/tclibc-eglibc.inc /OE/shr-core/openembedded-core/meta/classes/packagedata.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/include/default-providers.inc /OE/shr-core/openembedded-core/meta/classes/package_ipk.bbclass /OE/shr-core/openembedded-core/meta/classes/logging.bbclass /OE/shr-core/openembedded-core/meta/classes/devshell.bbclass /OE/shr-core/openembedded-core/meta/classes/insane.bbclass /OE/shr-core/openembedded-core/meta/classes/sstate.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/include/as-needed.inc /OE/shr-core/meta-openembedded/meta-gpe/conf/layer.conf /OE/shr-core/meta-smartphone/meta-htc/conf/layer.conf /OE/shr-core/meta-smartphone/meta-openmoko/conf/layer.conf /OE/shr-core/conf/bblayers.conf /OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass /OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc /OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf /OE/shr-core/openembedded-core/meta/classes/package.bbclass /OE/shr-core/openembedded-core/meta/conf/abi_version.conf /OE/shr-core/meta-handheld/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/license.bbclass /OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc /OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc /OE/shr-core/openembedded-core/meta/conf/bitbake.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc /OE/shr-core/meta-smartphone/meta-samsung/conf/layer.conf /OE/shr-core/conf/auto.conf /OE/shr-core/meta-smartphone/meta-fso/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/staging.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/defaultsetup.conf /OE/shr-core/meta-jama/conf/layer.conf /OE/shr-core/meta-openembedded/meta-gnome/conf/layer.conf /OE/shr-core/meta-smartphone/meta-aurora/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/debian.bbclass /OE/shr-core/openembedded-core/meta/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/world-broken.inc /OE/shr-core/meta-openembedded/meta-initramfs/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/prserv.bbclass /OE/shr-core/openembedded-core/meta/classes/rm_work.bbclass /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-arm.inc /OE/shr-core/openembedded-core/meta/classes/utility-tasks.bbclass /OE/shr-core/meta-openembedded/meta-efl/conf/distro/include/efl-from-svn.inc /OE/shr-core/openembedded-core/meta/conf/sanity.conf /OE/shr-core/openembedded-core/meta/classes/metadata_scm.bbclass /OE/shr-core/openembedded-core/meta/classes/utils.bbclass /OE/shr-core/openembedded-core/meta/classes/buildhistory.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/include/default-distrovars.inc /OE/shr-core/openembedded-core/meta/classes/terminal.bbclass /OE/shr-core/openembedded-core/meta/classes/sanity.bbclass /OE/shr-core/conf/site.conf /OE/shr-core/openembedded-core/meta/classes/mirrors.bbclass /OE/shr-core/meta-smartphone/meta-nokia/conf/layer.conf /OE/shr-core/meta-openembedded/meta-oe/classes/blacklist.bbclass /OE/shr-core/meta-openembedded/meta-efl/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/base.bbclass /OE/shr-core/meta-mozilla/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/feature-arm-thumb.inc /OE/shr-core/meta-smartphone/meta-shr/conf/layer.conf

Cheers,
Dongxiao Xu - March 12, 2012, 2:54 a.m.
On Sat, 2012-03-10 at 08:44 +0100, Martin Jansa wrote:
> On Sat, Feb 25, 2012 at 7:56 AM, Xu, Dongxiao <dongxiao.xu@intel.com> wrote:
> > On Sat, 2012-02-25 at 00:47 +0100, Andreas Oberritter wrote:
> >> Hi,
> >>
> >> commit 1c1df03a6c4717bfd5faab144c4f8bbfcbae0b57 broke bitbake's
> >> dependency cache for me, i.e. it parses all recipes on every invocation
> >> and always displays "(0 cached, 1269 parsed)". Deleting tmp/cache didn't
> >> help. Reverting this commit restores the functionality.
> >
> > Hi Andreas,
> >
> > Sorry for the inconvenience that this commit brought to you.
> >
> > Could you help to try the following and send me your "/tmp/1.log
> > and /tmp/2.log"?
> >
> > 1) apply the attached "cache_debug.patch"
> > 2) remove tmp/cache
> > 3) bitbake -p &> /tmp/1.log
> > 4) bitbake -p &> /tmp/2.log
> >
> > Besides, you can have a try of the attached cache_whitelist.patch to see
> > if it fixes your problem.
> 
> Today I noticed another cache rebuild, here is diff from parse output:
> 
> 3286c3286
> < XAUTHORITY: /root/.xauthljqB8X
> ---
> > XAUTHORITY: /root/.xauth1of3YX
> 3532c3532
> < PSEUDO_BUILD: 2
> ---
> > PSEUDO_BUILD: 0
> 5223c5222
> < _: /OE/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/bin/pseudo
> ---
> > _: /usr/bin/bitbake
> 
> and long one BBINCLUDED where only order of some items was changed:

Thanks for reporting this issue, I will commit patches to fix it.

Thanks,
Dongxiao

> @@ -21,13 +21,14 @@
>  /OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass
>  /OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc
>  /OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf
> -/OE/shr-core/openembedded-core/meta/conf/bitbake.conf
>  /OE/shr-core/openembedded-core/meta/classes/package.bbclass
>  /OE/shr-core/openembedded-core/meta/conf/abi_version.conf
>  /OE/shr-core/meta-handheld/conf/layer.conf
>  /OE/shr-core/openembedded-core/meta/classes/license.bbclass
>  /OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc
> +/OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
>  /OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc
> +/OE/shr-core/openembedded-core/meta/conf/bitbake.conf
>  /OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc
>  /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc
>  /OE/shr-core/meta-smartphone/meta-samsung/conf/layer.conf
> @@ -37,7 +38,6 @@
>  /OE/shr-core/openembedded-core/meta/conf/distro/defaultsetup.conf
>  /OE/shr-core/meta-jama/conf/layer.conf
>  /OE/shr-core/meta-openembedded/meta-gnome/conf/layer.conf
> -/OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
>  /OE/shr-core/meta-smartphone/meta-aurora/conf/layer.conf
>  /OE/shr-core/openembedded-core/meta/classes/debian.bbclass
>  /OE/shr-core/openembedded-core/meta/conf/layer.conf
> 
> 391c391
> < BBINCLUDED: /OE/shr-core/conf/local.conf
> /OE/shr-core/conf/local-builds.inc
> /OE/shr-core/openembedded-core/meta/classes/patch.bbclass
> /OE/shr-core/openembedded-core/meta/conf/machine-sdk/x86_64.conf
> /OE/shr-core/meta-smartphone/meta-palm/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/conf/documentation.conf
> /OE/shr-core/meta-openembedded/meta-oe/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/conf/distro/include/tclibc-eglibc.inc
> /OE/shr-core/openembedded-core/meta/classes/packagedata.bbclass
> /OE/shr-core/openembedded-core/meta/conf/distro/include/default-providers.inc
> /OE/shr-core/openembedded-core/meta/classes/package_ipk.bbclass
> /OE/shr-core/openembedded-core/meta/classes/logging.bbclass
> /OE/shr-core/openembedded-core/meta/classes/devshell.bbclass
> /OE/shr-core/openembedded-core/meta/classes/insane.bbclass
> /OE/shr-core/openembedded-core/meta/classes/sstate.bbclass
> /OE/shr-core/openembedded-core/meta/conf/distro/include/as-needed.inc
> /OE/shr-core/meta-openembedded/meta-gpe/conf/layer.conf
> /OE/shr-core/meta-smartphone/meta-htc/conf/layer.conf
> /OE/shr-core/meta-smartphone/meta-openmoko/conf/layer.conf
> /OE/shr-core/conf/bblayers.conf
> /OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass
> /OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc
> /OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf
> /OE/shr-core/openembedded-core/meta/conf/bitbake.conf
> /OE/shr-core/openembedded-core/meta/classes/package.bbclass
> /OE/shr-core/openembedded-core/meta/conf/abi_version.conf
> /OE/shr-core/meta-handheld/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/classes/license.bbclass
> /OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc
> /OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc
> /OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc
> /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc
> /OE/shr-core/meta-smartphone/meta-samsung/conf/layer.conf
> /OE/shr-core/conf/auto.conf
> /OE/shr-core/meta-smartphone/meta-fso/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/classes/staging.bbclass
> /OE/shr-core/openembedded-core/meta/conf/distro/defaultsetup.conf
> /OE/shr-core/meta-jama/conf/layer.conf
> /OE/shr-core/meta-openembedded/meta-gnome/conf/layer.conf
> /OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
> /OE/shr-core/meta-smartphone/meta-aurora/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/classes/debian.bbclass
> /OE/shr-core/openembedded-core/meta/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/conf/distro/include/world-broken.inc
> /OE/shr-core/meta-openembedded/meta-initramfs/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/classes/prserv.bbclass
> /OE/shr-core/openembedded-core/meta/classes/rm_work.bbclass
> /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-arm.inc
> /OE/shr-core/openembedded-core/meta/classes/utility-tasks.bbclass
> /OE/shr-core/meta-openembedded/meta-efl/conf/distro/include/efl-from-svn.inc
> /OE/shr-core/openembedded-core/meta/conf/sanity.conf
> /OE/shr-core/openembedded-core/meta/classes/metadata_scm.bbclass
> /OE/shr-core/openembedded-core/meta/classes/utils.bbclass
> /OE/shr-core/openembedded-core/meta/classes/buildhistory.bbclass
> /OE/shr-core/openembedded-core/meta/conf/distro/include/default-distrovars.inc
> /OE/shr-core/openembedded-core/meta/classes/terminal.bbclass
> /OE/shr-core/openembedded-core/meta/classes/sanity.bbclass
> /OE/shr-core/conf/site.conf
> /OE/shr-core/openembedded-core/meta/classes/mirrors.bbclass
> /OE/shr-core/meta-smartphone/meta-nokia/conf/layer.conf
> /OE/shr-core/meta-openembedded/meta-oe/classes/blacklist.bbclass
> /OE/shr-core/meta-openembedded/meta-efl/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/classes/base.bbclass
> /OE/shr-core/meta-mozilla/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/feature-arm-thumb.inc
> /OE/shr-core/meta-smartphone/meta-shr/conf/layer.conf
> ---
> > BBINCLUDED: /OE/shr-core/conf/local.conf /OE/shr-core/conf/local-builds.inc /OE/shr-core/openembedded-core/meta/classes/patch.bbclass /OE/shr-core/openembedded-core/meta/conf/machine-sdk/x86_64.conf /OE/shr-core/meta-smartphone/meta-palm/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/documentation.conf /OE/shr-core/meta-openembedded/meta-oe/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/tclibc-eglibc.inc /OE/shr-core/openembedded-core/meta/classes/packagedata.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/include/default-providers.inc /OE/shr-core/openembedded-core/meta/classes/package_ipk.bbclass /OE/shr-core/openembedded-core/meta/classes/logging.bbclass /OE/shr-core/openembedded-core/meta/classes/devshell.bbclass /OE/shr-core/openembedded-core/meta/classes/insane.bbclass /OE/shr-core/openembedded-core/meta/classes/sstate.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/include/as-needed.inc /OE/shr-core/meta-openembedded/meta-gpe/conf/layer.conf /OE/shr-core/meta-smartphone/meta-htc/conf/layer.conf /OE/shr-core/meta-smartphone/meta-openmoko/conf/layer.conf /OE/shr-core/conf/bblayers.conf /OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass /OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc /OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf /OE/shr-core/openembedded-core/meta/classes/package.bbclass /OE/shr-core/openembedded-core/meta/conf/abi_version.conf /OE/shr-core/meta-handheld/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/license.bbclass /OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc /OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc /OE/shr-core/openembedded-core/meta/conf/bitbake.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc /OE/shr-core/meta-smartphone/meta-samsung/conf/layer.conf /OE/shr-core/conf/auto.conf /OE/shr-core/meta-smartphone/meta-fso/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/staging.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/defaultsetup.conf /OE/shr-core/meta-jama/conf/layer.conf /OE/shr-core/meta-openembedded/meta-gnome/conf/layer.conf /OE/shr-core/meta-smartphone/meta-aurora/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/debian.bbclass /OE/shr-core/openembedded-core/meta/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/world-broken.inc /OE/shr-core/meta-openembedded/meta-initramfs/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/prserv.bbclass /OE/shr-core/openembedded-core/meta/classes/rm_work.bbclass /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-arm.inc /OE/shr-core/openembedded-core/meta/classes/utility-tasks.bbclass /OE/shr-core/meta-openembedded/meta-efl/conf/distro/include/efl-from-svn.inc /OE/shr-core/openembedded-core/meta/conf/sanity.conf /OE/shr-core/openembedded-core/meta/classes/metadata_scm.bbclass /OE/shr-core/openembedded-core/meta/classes/utils.bbclass /OE/shr-core/openembedded-core/meta/classes/buildhistory.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/include/default-distrovars.inc /OE/shr-core/openembedded-core/meta/classes/terminal.bbclass /OE/shr-core/openembedded-core/meta/classes/sanity.bbclass /OE/shr-core/conf/site.conf /OE/shr-core/openembedded-core/meta/classes/mirrors.bbclass /OE/shr-core/meta-smartphone/meta-nokia/conf/layer.conf /OE/shr-core/meta-openembedded/meta-oe/classes/blacklist.bbclass /OE/shr-core/meta-openembedded/meta-efl/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/base.bbclass /OE/shr-core/meta-mozilla/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/feature-arm-thumb.inc /OE/shr-core/meta-smartphone/meta-shr/conf/layer.conf
> 
> Cheers,
Dongxiao Xu - March 16, 2012, 8:28 a.m.
On Sat, 2012-03-10 at 08:44 +0100, Martin Jansa wrote:
> On Sat, Feb 25, 2012 at 7:56 AM, Xu, Dongxiao <dongxiao.xu@intel.com> wrote:
> > On Sat, 2012-02-25 at 00:47 +0100, Andreas Oberritter wrote:
> >> Hi,
> >>
> >> commit 1c1df03a6c4717bfd5faab144c4f8bbfcbae0b57 broke bitbake's
> >> dependency cache for me, i.e. it parses all recipes on every invocation
> >> and always displays "(0 cached, 1269 parsed)". Deleting tmp/cache didn't
> >> help. Reverting this commit restores the functionality.
> >
> > Hi Andreas,
> >
> > Sorry for the inconvenience that this commit brought to you.
> >
> > Could you help to try the following and send me your "/tmp/1.log
> > and /tmp/2.log"?
> >
> > 1) apply the attached "cache_debug.patch"
> > 2) remove tmp/cache
> > 3) bitbake -p &> /tmp/1.log
> > 4) bitbake -p &> /tmp/2.log
> >
> > Besides, you can have a try of the attached cache_whitelist.patch to see
> > if it fixes your problem.
> 
> Today I noticed another cache rebuild, here is diff from parse output:

Hi Martin,

Could this issue be reproduced stably in your environment? Or it happens
occasionally?

It seems that this kind of order change in variable values will also
impact the siggen result. Richard, do you have any comment on this one?

Thanks,
Dongxiao

> 
> 3286c3286
> < XAUTHORITY: /root/.xauthljqB8X
> ---
> > XAUTHORITY: /root/.xauth1of3YX
> 3532c3532
> < PSEUDO_BUILD: 2
> ---
> > PSEUDO_BUILD: 0
> 5223c5222
> < _: /OE/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/bin/pseudo
> ---
> > _: /usr/bin/bitbake
> 
> and long one BBINCLUDED where only order of some items was changed:
> @@ -21,13 +21,14 @@
>  /OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass
>  /OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc
>  /OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf
> -/OE/shr-core/openembedded-core/meta/conf/bitbake.conf
>  /OE/shr-core/openembedded-core/meta/classes/package.bbclass
>  /OE/shr-core/openembedded-core/meta/conf/abi_version.conf
>  /OE/shr-core/meta-handheld/conf/layer.conf
>  /OE/shr-core/openembedded-core/meta/classes/license.bbclass
>  /OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc
> +/OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
>  /OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc
> +/OE/shr-core/openembedded-core/meta/conf/bitbake.conf
>  /OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc
>  /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc
>  /OE/shr-core/meta-smartphone/meta-samsung/conf/layer.conf
> @@ -37,7 +38,6 @@
>  /OE/shr-core/openembedded-core/meta/conf/distro/defaultsetup.conf
>  /OE/shr-core/meta-jama/conf/layer.conf
>  /OE/shr-core/meta-openembedded/meta-gnome/conf/layer.conf
> -/OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
>  /OE/shr-core/meta-smartphone/meta-aurora/conf/layer.conf
>  /OE/shr-core/openembedded-core/meta/classes/debian.bbclass
>  /OE/shr-core/openembedded-core/meta/conf/layer.conf
> 
> 391c391
> < BBINCLUDED: /OE/shr-core/conf/local.conf
> /OE/shr-core/conf/local-builds.inc
> /OE/shr-core/openembedded-core/meta/classes/patch.bbclass
> /OE/shr-core/openembedded-core/meta/conf/machine-sdk/x86_64.conf
> /OE/shr-core/meta-smartphone/meta-palm/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/conf/documentation.conf
> /OE/shr-core/meta-openembedded/meta-oe/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/conf/distro/include/tclibc-eglibc.inc
> /OE/shr-core/openembedded-core/meta/classes/packagedata.bbclass
> /OE/shr-core/openembedded-core/meta/conf/distro/include/default-providers.inc
> /OE/shr-core/openembedded-core/meta/classes/package_ipk.bbclass
> /OE/shr-core/openembedded-core/meta/classes/logging.bbclass
> /OE/shr-core/openembedded-core/meta/classes/devshell.bbclass
> /OE/shr-core/openembedded-core/meta/classes/insane.bbclass
> /OE/shr-core/openembedded-core/meta/classes/sstate.bbclass
> /OE/shr-core/openembedded-core/meta/conf/distro/include/as-needed.inc
> /OE/shr-core/meta-openembedded/meta-gpe/conf/layer.conf
> /OE/shr-core/meta-smartphone/meta-htc/conf/layer.conf
> /OE/shr-core/meta-smartphone/meta-openmoko/conf/layer.conf
> /OE/shr-core/conf/bblayers.conf
> /OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass
> /OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc
> /OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf
> /OE/shr-core/openembedded-core/meta/conf/bitbake.conf
> /OE/shr-core/openembedded-core/meta/classes/package.bbclass
> /OE/shr-core/openembedded-core/meta/conf/abi_version.conf
> /OE/shr-core/meta-handheld/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/classes/license.bbclass
> /OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc
> /OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc
> /OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc
> /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc
> /OE/shr-core/meta-smartphone/meta-samsung/conf/layer.conf
> /OE/shr-core/conf/auto.conf
> /OE/shr-core/meta-smartphone/meta-fso/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/classes/staging.bbclass
> /OE/shr-core/openembedded-core/meta/conf/distro/defaultsetup.conf
> /OE/shr-core/meta-jama/conf/layer.conf
> /OE/shr-core/meta-openembedded/meta-gnome/conf/layer.conf
> /OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
> /OE/shr-core/meta-smartphone/meta-aurora/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/classes/debian.bbclass
> /OE/shr-core/openembedded-core/meta/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/conf/distro/include/world-broken.inc
> /OE/shr-core/meta-openembedded/meta-initramfs/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/classes/prserv.bbclass
> /OE/shr-core/openembedded-core/meta/classes/rm_work.bbclass
> /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-arm.inc
> /OE/shr-core/openembedded-core/meta/classes/utility-tasks.bbclass
> /OE/shr-core/meta-openembedded/meta-efl/conf/distro/include/efl-from-svn.inc
> /OE/shr-core/openembedded-core/meta/conf/sanity.conf
> /OE/shr-core/openembedded-core/meta/classes/metadata_scm.bbclass
> /OE/shr-core/openembedded-core/meta/classes/utils.bbclass
> /OE/shr-core/openembedded-core/meta/classes/buildhistory.bbclass
> /OE/shr-core/openembedded-core/meta/conf/distro/include/default-distrovars.inc
> /OE/shr-core/openembedded-core/meta/classes/terminal.bbclass
> /OE/shr-core/openembedded-core/meta/classes/sanity.bbclass
> /OE/shr-core/conf/site.conf
> /OE/shr-core/openembedded-core/meta/classes/mirrors.bbclass
> /OE/shr-core/meta-smartphone/meta-nokia/conf/layer.conf
> /OE/shr-core/meta-openembedded/meta-oe/classes/blacklist.bbclass
> /OE/shr-core/meta-openembedded/meta-efl/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/classes/base.bbclass
> /OE/shr-core/meta-mozilla/conf/layer.conf
> /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/feature-arm-thumb.inc
> /OE/shr-core/meta-smartphone/meta-shr/conf/layer.conf
> ---
> > BBINCLUDED: /OE/shr-core/conf/local.conf /OE/shr-core/conf/local-builds.inc /OE/shr-core/openembedded-core/meta/classes/patch.bbclass /OE/shr-core/openembedded-core/meta/conf/machine-sdk/x86_64.conf /OE/shr-core/meta-smartphone/meta-palm/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/documentation.conf /OE/shr-core/meta-openembedded/meta-oe/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/tclibc-eglibc.inc /OE/shr-core/openembedded-core/meta/classes/packagedata.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/include/default-providers.inc /OE/shr-core/openembedded-core/meta/classes/package_ipk.bbclass /OE/shr-core/openembedded-core/meta/classes/logging.bbclass /OE/shr-core/openembedded-core/meta/classes/devshell.bbclass /OE/shr-core/openembedded-core/meta/classes/insane.bbclass /OE/shr-core/openembedded-core/meta/classes/sstate.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/include/as-needed.inc /OE/shr-core/meta-openembedded/meta-gpe/conf/layer.conf /OE/shr-core/meta-smartphone/meta-htc/conf/layer.conf /OE/shr-core/meta-smartphone/meta-openmoko/conf/layer.conf /OE/shr-core/conf/bblayers.conf /OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass /OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc /OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf /OE/shr-core/openembedded-core/meta/classes/package.bbclass /OE/shr-core/openembedded-core/meta/conf/abi_version.conf /OE/shr-core/meta-handheld/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/license.bbclass /OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc /OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc /OE/shr-core/openembedded-core/meta/conf/bitbake.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc /OE/shr-core/meta-smartphone/meta-samsung/conf/layer.conf /OE/shr-core/conf/auto.conf /OE/shr-core/meta-smartphone/meta-fso/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/staging.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/defaultsetup.conf /OE/shr-core/meta-jama/conf/layer.conf /OE/shr-core/meta-openembedded/meta-gnome/conf/layer.conf /OE/shr-core/meta-smartphone/meta-aurora/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/debian.bbclass /OE/shr-core/openembedded-core/meta/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/world-broken.inc /OE/shr-core/meta-openembedded/meta-initramfs/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/prserv.bbclass /OE/shr-core/openembedded-core/meta/classes/rm_work.bbclass /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-arm.inc /OE/shr-core/openembedded-core/meta/classes/utility-tasks.bbclass /OE/shr-core/meta-openembedded/meta-efl/conf/distro/include/efl-from-svn.inc /OE/shr-core/openembedded-core/meta/conf/sanity.conf /OE/shr-core/openembedded-core/meta/classes/metadata_scm.bbclass /OE/shr-core/openembedded-core/meta/classes/utils.bbclass /OE/shr-core/openembedded-core/meta/classes/buildhistory.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/include/default-distrovars.inc /OE/shr-core/openembedded-core/meta/classes/terminal.bbclass /OE/shr-core/openembedded-core/meta/classes/sanity.bbclass /OE/shr-core/conf/site.conf /OE/shr-core/openembedded-core/meta/classes/mirrors.bbclass /OE/shr-core/meta-smartphone/meta-nokia/conf/layer.conf /OE/shr-core/meta-openembedded/meta-oe/classes/blacklist.bbclass /OE/shr-core/meta-openembedded/meta-efl/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/base.bbclass /OE/shr-core/meta-mozilla/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/feature-arm-thumb.inc /OE/shr-core/meta-smartphone/meta-shr/conf/layer.conf
> 
> Cheers,
Martin Jansa - March 16, 2012, 8:54 a.m.
On Fri, Mar 16, 2012 at 04:28:16PM +0800, Xu, Dongxiao wrote:
> On Sat, 2012-03-10 at 08:44 +0100, Martin Jansa wrote:
> > On Sat, Feb 25, 2012 at 7:56 AM, Xu, Dongxiao <dongxiao.xu@intel.com> wrote:
> > > On Sat, 2012-02-25 at 00:47 +0100, Andreas Oberritter wrote:
> > >> Hi,
> > >>
> > >> commit 1c1df03a6c4717bfd5faab144c4f8bbfcbae0b57 broke bitbake's
> > >> dependency cache for me, i.e. it parses all recipes on every invocation
> > >> and always displays "(0 cached, 1269 parsed)". Deleting tmp/cache didn't
> > >> help. Reverting this commit restores the functionality.
> > >
> > > Hi Andreas,
> > >
> > > Sorry for the inconvenience that this commit brought to you.
> > >
> > > Could you help to try the following and send me your "/tmp/1.log
> > > and /tmp/2.log"?
> > >
> > > 1) apply the attached "cache_debug.patch"
> > > 2) remove tmp/cache
> > > 3) bitbake -p &> /tmp/1.log
> > > 4) bitbake -p &> /tmp/2.log
> > >
> > > Besides, you can have a try of the attached cache_whitelist.patch to see
> > > if it fixes your problem.
> > 
> > Today I noticed another cache rebuild, here is diff from parse output:
> 
> Hi Martin,
> 
> Could this issue be reproduced stably in your environment? Or it happens
> occasionally?

I can reproduce XAUTHORITY change very easily, will try to reproduce
BBINCLUDED ordering change.

Cheers,

> It seems that this kind of order change in variable values will also
> impact the siggen result. Richard, do you have any comment on this one?
> 
> Thanks,
> Dongxiao
> 
> > 
> > 3286c3286
> > < XAUTHORITY: /root/.xauthljqB8X
> > ---
> > > XAUTHORITY: /root/.xauth1of3YX
> > 3532c3532
> > < PSEUDO_BUILD: 2
> > ---
> > > PSEUDO_BUILD: 0
> > 5223c5222
> > < _: /OE/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/bin/pseudo
> > ---
> > > _: /usr/bin/bitbake
> > 
> > and long one BBINCLUDED where only order of some items was changed:
> > @@ -21,13 +21,14 @@
> >  /OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass
> >  /OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc
> >  /OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf
> > -/OE/shr-core/openembedded-core/meta/conf/bitbake.conf
> >  /OE/shr-core/openembedded-core/meta/classes/package.bbclass
> >  /OE/shr-core/openembedded-core/meta/conf/abi_version.conf
> >  /OE/shr-core/meta-handheld/conf/layer.conf
> >  /OE/shr-core/openembedded-core/meta/classes/license.bbclass
> >  /OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc
> > +/OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
> >  /OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc
> > +/OE/shr-core/openembedded-core/meta/conf/bitbake.conf
> >  /OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc
> >  /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc
> >  /OE/shr-core/meta-smartphone/meta-samsung/conf/layer.conf
> > @@ -37,7 +38,6 @@
> >  /OE/shr-core/openembedded-core/meta/conf/distro/defaultsetup.conf
> >  /OE/shr-core/meta-jama/conf/layer.conf
> >  /OE/shr-core/meta-openembedded/meta-gnome/conf/layer.conf
> > -/OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
> >  /OE/shr-core/meta-smartphone/meta-aurora/conf/layer.conf
> >  /OE/shr-core/openembedded-core/meta/classes/debian.bbclass
> >  /OE/shr-core/openembedded-core/meta/conf/layer.conf
> > 
> > 391c391
> > < BBINCLUDED: /OE/shr-core/conf/local.conf
> > /OE/shr-core/conf/local-builds.inc
> > /OE/shr-core/openembedded-core/meta/classes/patch.bbclass
> > /OE/shr-core/openembedded-core/meta/conf/machine-sdk/x86_64.conf
> > /OE/shr-core/meta-smartphone/meta-palm/conf/layer.conf
> > /OE/shr-core/openembedded-core/meta/conf/documentation.conf
> > /OE/shr-core/meta-openembedded/meta-oe/conf/layer.conf
> > /OE/shr-core/openembedded-core/meta/conf/distro/include/tclibc-eglibc.inc
> > /OE/shr-core/openembedded-core/meta/classes/packagedata.bbclass
> > /OE/shr-core/openembedded-core/meta/conf/distro/include/default-providers.inc
> > /OE/shr-core/openembedded-core/meta/classes/package_ipk.bbclass
> > /OE/shr-core/openembedded-core/meta/classes/logging.bbclass
> > /OE/shr-core/openembedded-core/meta/classes/devshell.bbclass
> > /OE/shr-core/openembedded-core/meta/classes/insane.bbclass
> > /OE/shr-core/openembedded-core/meta/classes/sstate.bbclass
> > /OE/shr-core/openembedded-core/meta/conf/distro/include/as-needed.inc
> > /OE/shr-core/meta-openembedded/meta-gpe/conf/layer.conf
> > /OE/shr-core/meta-smartphone/meta-htc/conf/layer.conf
> > /OE/shr-core/meta-smartphone/meta-openmoko/conf/layer.conf
> > /OE/shr-core/conf/bblayers.conf
> > /OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass
> > /OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc
> > /OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf
> > /OE/shr-core/openembedded-core/meta/conf/bitbake.conf
> > /OE/shr-core/openembedded-core/meta/classes/package.bbclass
> > /OE/shr-core/openembedded-core/meta/conf/abi_version.conf
> > /OE/shr-core/meta-handheld/conf/layer.conf
> > /OE/shr-core/openembedded-core/meta/classes/license.bbclass
> > /OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc
> > /OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc
> > /OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc
> > /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc
> > /OE/shr-core/meta-smartphone/meta-samsung/conf/layer.conf
> > /OE/shr-core/conf/auto.conf
> > /OE/shr-core/meta-smartphone/meta-fso/conf/layer.conf
> > /OE/shr-core/openembedded-core/meta/classes/staging.bbclass
> > /OE/shr-core/openembedded-core/meta/conf/distro/defaultsetup.conf
> > /OE/shr-core/meta-jama/conf/layer.conf
> > /OE/shr-core/meta-openembedded/meta-gnome/conf/layer.conf
> > /OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf
> > /OE/shr-core/meta-smartphone/meta-aurora/conf/layer.conf
> > /OE/shr-core/openembedded-core/meta/classes/debian.bbclass
> > /OE/shr-core/openembedded-core/meta/conf/layer.conf
> > /OE/shr-core/openembedded-core/meta/conf/distro/include/world-broken.inc
> > /OE/shr-core/meta-openembedded/meta-initramfs/conf/layer.conf
> > /OE/shr-core/openembedded-core/meta/classes/prserv.bbclass
> > /OE/shr-core/openembedded-core/meta/classes/rm_work.bbclass
> > /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-arm.inc
> > /OE/shr-core/openembedded-core/meta/classes/utility-tasks.bbclass
> > /OE/shr-core/meta-openembedded/meta-efl/conf/distro/include/efl-from-svn.inc
> > /OE/shr-core/openembedded-core/meta/conf/sanity.conf
> > /OE/shr-core/openembedded-core/meta/classes/metadata_scm.bbclass
> > /OE/shr-core/openembedded-core/meta/classes/utils.bbclass
> > /OE/shr-core/openembedded-core/meta/classes/buildhistory.bbclass
> > /OE/shr-core/openembedded-core/meta/conf/distro/include/default-distrovars.inc
> > /OE/shr-core/openembedded-core/meta/classes/terminal.bbclass
> > /OE/shr-core/openembedded-core/meta/classes/sanity.bbclass
> > /OE/shr-core/conf/site.conf
> > /OE/shr-core/openembedded-core/meta/classes/mirrors.bbclass
> > /OE/shr-core/meta-smartphone/meta-nokia/conf/layer.conf
> > /OE/shr-core/meta-openembedded/meta-oe/classes/blacklist.bbclass
> > /OE/shr-core/meta-openembedded/meta-efl/conf/layer.conf
> > /OE/shr-core/openembedded-core/meta/classes/base.bbclass
> > /OE/shr-core/meta-mozilla/conf/layer.conf
> > /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/feature-arm-thumb.inc
> > /OE/shr-core/meta-smartphone/meta-shr/conf/layer.conf
> > ---
> > > BBINCLUDED: /OE/shr-core/conf/local.conf /OE/shr-core/conf/local-builds.inc /OE/shr-core/openembedded-core/meta/classes/patch.bbclass /OE/shr-core/openembedded-core/meta/conf/machine-sdk/x86_64.conf /OE/shr-core/meta-smartphone/meta-palm/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/documentation.conf /OE/shr-core/meta-openembedded/meta-oe/conf/layer.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/tclibc-eglibc.inc /OE/shr-core/openembedded-core/meta/classes/packagedata.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/include/default-providers.inc /OE/shr-core/openembedded-core/meta/classes/package_ipk.bbclass /OE/shr-core/openembedded-core/meta/classes/logging.bbclass /OE/shr-core/openembedded-core/meta/classes/devshell.bbclass /OE/shr-core/openembedded-core/meta/classes/insane.bbclass /OE/shr-core/openembedded-core/meta/classes/sstate.bbclass /OE/shr-core/openembedded-core/meta/conf/distro/include/as-needed.inc /OE/shr-core/meta-openembedded/meta-gpe/conf/layer.conf /OE/shr-core/meta-smartphone/meta-htc/conf/layer.conf /OE/shr-core/meta-smartphone/meta-openmoko/conf/layer.conf /OE/shr-core/conf/bblayers.conf /OE/shr-core/meta-smartphone/meta-shr/classes/shr-mirrors.bbclass /OE/shr-core/openembedded-core/meta/conf/machine/include/tune-arm920t.inc /OE/shr-core/meta-smartphone/meta-openmoko/conf/machine/om-gta02.conf /OE/shr-core/openembedded-core/meta/classes/package.bbclass /OE/shr-core/openembedded-core/meta/conf/abi_version.conf /OE/shr-core/meta-handheld/conf/layer.conf /OE/shr-core/openembedded-core/meta/classes/license.bbclass /OE/shr-core/meta-smartphone/meta-shr/conf/distro/include/preferred-shr-versions.inc /OE/shr-core/meta-smartphone/meta-shr/conf/distro/shr.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/default-versions.inc /OE/shr-core/openembedded-core/meta/conf/bitbake.conf /OE/shr-core/openembedded-core/meta/conf/distro/include/tcmode-default.inc /OE/shr-core/openembedded-core/meta/conf/machine/include/arm/arch-armv4.inc /OE/shr-core/meta-smartph
> > 
> > Cheers,
> 
>

Patch

diff --git a/bitbake/lib/bb/data_smart.py b/bitbake/lib/bb/data_smart.py
index 24c7a8f..dbf2002 100644
--- a/bitbake/lib/bb/data_smart.py
+++ b/bitbake/lib/bb/data_smart.py
@@ -463,20 +463,12 @@  class DataSmart(MutableMapping):
 
     def get_hash(self):
         data = ""
-        keys = iter(self)
+        basewhitelist = set((self.getVar("BB_HASHBASE_WHITELIST", True) or "").split())
+        keys = set(key for key in iter(self) if not key.startswith("__"))
         for key in keys:
-            if key in ["TIME", "DATE"]:
+            if key in basewhitelist:
                 continue
-            if key == "__depends":
-                deps = list(self.getVar(key, False))
-                deps.sort()
-                value = [deps[i][0] for i in range(len(deps))]
-            elif key == "PATH":
-                path = list(set(self.getVar(key, False).split(':')))
-                path.sort()
-                value = " ".join(path)
-            else:
-                value = self.getVar(key, False) or ""
+            value = self.getVar(key, False) or ""
             data = data + key + ': ' + str(value) + '\n'
 
         return hashlib.md5(data).hexdigest()
diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
index 90e5f7a..133a957 100644
--- a/meta/conf/bitbake.conf
+++ b/meta/conf/bitbake.conf
@@ -727,7 +727,7 @@  BB_CONSOLELOG = "${TMPDIR}/cooker.log.${DATETIME}"
 
 # Setup our default hash policy
 BB_SIGNATURE_HANDLER ?= "OEBasic"
-BB_HASHBASE_WHITELIST ?= "TMPDIR FILE PATH PWD BB_TASKHASH BBPATH DL_DIR SSTATE_DIR THISDIR FILESEXTRAPATHS FILE_DIRNAME HOME LOGNAME SHELL TERM USER FILESPATH STAGING_DIR_HOST STAGING_DIR_TARGET COREBASE PRSERV_HOST PRSERV_PORT PRSERV_DUMPDIR PRSERV_DUMPFILE PRSERV_LOCKDOWN"
+BB_HASHBASE_WHITELIST ?= "TMPDIR FILE PATH PWD BB_TASKHASH BBPATH DL_DIR SSTATE_DIR THISDIR FILESEXTRAPATHS FILE_DIRNAME HOME LOGNAME SHELL TERM USER FILESPATH STAGING_DIR_HOST STAGING_DIR_TARGET COREBASE PRSERV_HOST PRSERV_PORT PRSERV_DUMPDIR PRSERV_DUMPFILE PRSERV_LOCKDOWN DATE TIME"
 
 MLPREFIX ??= ""
 MULTILIB_VARIANTS ??= ""