mbox series

[bitbake-devel,0/5] Implement parallel Query API

Message ID 20240218200743.2982923-1-JPEWhacker@gmail.com
Headers show
Series Implement parallel Query API | expand

Message

Joshua Watt Feb. 18, 2024, 8:07 p.m. UTC 
Implements API to allows querying if a hash exists in the server, and to
do so using multiple connections to the server in parallel. This will be
used to query if an sstate object exists before actually looking for it
in the sstate cache, which is important for e.g. on a CDN where negative
lookups are expensive

Joshua Watt (5):
  hashserv: sqlalchemy: Use _execute() helper
  hashserv: Add unihash-exists API
  asyncrpc: Add Client Pool object
  hashserv: Add Client Pool
  siggen: Add parallel query API

 bitbake/bin/bitbake-hashclient      |  13 ++
 bitbake/lib/bb/asyncrpc/__init__.py |   2 +-
 bitbake/lib/bb/asyncrpc/client.py   |  77 +++++++
 bitbake/lib/bb/siggen.py            | 121 +++++++----
 bitbake/lib/hashserv/client.py      | 124 ++++++++++-
 bitbake/lib/hashserv/server.py      |  61 +++---
 bitbake/lib/hashserv/sqlalchemy.py  | 306 ++++++++++++++--------------
 bitbake/lib/hashserv/sqlite.py      |  16 ++
 bitbake/lib/hashserv/tests.py       | 122 +++++++++++
 9 files changed, 618 insertions(+), 224 deletions(-)