diff mbox series

[6/6] oeqa/selftest/sstatetests: re-disable CDN tests

Message ID 20231208101522.198832-6-alex@linutronix.de
State New
Headers show
Series [1/6] selftest/sstatetest: print output from bitbake with actual newlines, not \n | expand

Commit Message

Alexander Kanavin Dec. 8, 2023, 10:15 a.m. UTC
With the rework of printdiff, it is not longer useful for checking
absence of sstate objects in a remote http cache, as it would only
report the top level missing signatures, and leave the recursive
investigation to diffsigs (which relies on ability to list cache
files - not available over http).

The CDN check will be performed via a separate 'printmissing'
function, which would be written specifically for the purpose,
and so until then disable the test as it would only persistently fail.

Signed-off-by: Alexander Kanavin <alex@linutronix.de>
---
 meta/lib/oeqa/selftest/cases/sstatetests.py | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

Comments

Richard Purdie Dec. 8, 2023, 12:22 p.m. UTC | #1
On Fri, 2023-12-08 at 11:15 +0100, Alexander Kanavin wrote:
> With the rework of printdiff, it is not longer useful for checking
> absence of sstate objects in a remote http cache, as it would only
> report the top level missing signatures, and leave the recursive
> investigation to diffsigs (which relies on ability to list cache
> files - not available over http).
> 
> The CDN check will be performed via a separate 'printmissing'
> function, which would be written specifically for the purpose,
> and so until then disable the test as it would only persistently fail.
> 
> Signed-off-by: Alexander Kanavin <alex@linutronix.de>
> ---
>  meta/lib/oeqa/selftest/cases/sstatetests.py | 4 ++--
>  1 file changed, 2 insertions(+), 2 deletions(-)
> 
> diff --git a/meta/lib/oeqa/selftest/cases/sstatetests.py b/meta/lib/oeqa/selftest/cases/sstatetests.py
> index 07e82d25c62..97ac0d2e9d9 100644
> --- a/meta/lib/oeqa/selftest/cases/sstatetests.py
> +++ b/meta/lib/oeqa/selftest/cases/sstatetests.py
> @@ -930,12 +930,12 @@ SSTATE_MIRRORS ?= "file://.* http://cdn.jsdelivr.net/yocto/sstate/all/PATH;downl
>          result = bitbake("-D -S printdiff {}".format(targets))
>          self.check_bb_output(result.output, exceptions)
>  
> -    def test_cdn_mirror_qemux86_64(self):
> +    def _test_cdn_mirror_qemux86_64(self):
>          # Example:
>          # exceptions = [ ["packagegroup-core-sdk","do_package"] ]
>          exceptions = []
>          self.run_test_cdn_mirror("qemux86-64", "core-image-minimal core-image-full-cmdline core-image-sato-sdk", exceptions)
>  
> -    def test_cdn_mirror_qemuarm64(self):
> +    def _test_cdn_mirror_qemuarm64(self):
>          exceptions = []
>          self.run_test_cdn_mirror("qemuarm64", "core-image-minimal core-image-full-cmdline core-image-sato-sdk", exceptions)

Crazy question - for the CDN tests, why don't we try just setting a
dummy SSTATE_DIR, then "bitbake <images> -n" and check the "State
Summary:" line in the output?

Cheers,

Richard
Alexander Kanavin Dec. 8, 2023, 12:24 p.m. UTC | #2
On Fri, 8 Dec 2023 at 13:22, Richard Purdie
<richard.purdie@linuxfoundation.org> wrote:

> Crazy question - for the CDN tests, why don't we try just setting a
> dummy SSTATE_DIR, then "bitbake <images> -n" and check the "State
> Summary:" line in the output?

It would be good to know what is missing though, not just how many?

Alex
Richard Purdie Dec. 8, 2023, 12:27 p.m. UTC | #3
On Fri, 2023-12-08 at 13:24 +0100, Alexander Kanavin wrote:
> On Fri, 8 Dec 2023 at 13:22, Richard Purdie
> <richard.purdie@linuxfoundation.org> wrote:
> 
> > Crazy question - for the CDN tests, why don't we try just setting a
> > dummy SSTATE_DIR, then "bitbake <images> -n" and check the "State
> > Summary:" line in the output?
> 
> It would be good to know what is missing though, not just how many?

Ideally, yes.

You could do that with a -DD option added and filter the output for the
misses?

Cheers,

Richard
diff mbox series

Patch

diff --git a/meta/lib/oeqa/selftest/cases/sstatetests.py b/meta/lib/oeqa/selftest/cases/sstatetests.py
index 07e82d25c62..97ac0d2e9d9 100644
--- a/meta/lib/oeqa/selftest/cases/sstatetests.py
+++ b/meta/lib/oeqa/selftest/cases/sstatetests.py
@@ -930,12 +930,12 @@  SSTATE_MIRRORS ?= "file://.* http://cdn.jsdelivr.net/yocto/sstate/all/PATH;downl
         result = bitbake("-D -S printdiff {}".format(targets))
         self.check_bb_output(result.output, exceptions)
 
-    def test_cdn_mirror_qemux86_64(self):
+    def _test_cdn_mirror_qemux86_64(self):
         # Example:
         # exceptions = [ ["packagegroup-core-sdk","do_package"] ]
         exceptions = []
         self.run_test_cdn_mirror("qemux86-64", "core-image-minimal core-image-full-cmdline core-image-sato-sdk", exceptions)
 
-    def test_cdn_mirror_qemuarm64(self):
+    def _test_cdn_mirror_qemuarm64(self):
         exceptions = []
         self.run_test_cdn_mirror("qemuarm64", "core-image-minimal core-image-full-cmdline core-image-sato-sdk", exceptions)