diff options
author | Sergio Gimeno <sgimeno@wikimedia.org> | 2023-09-18 22:23:45 +0200 |
---|---|---|
committer | Gerrit Code Review <gerrit@wikimedia.org> | 2023-09-18 20:23:45 +0000 |
commit | 72a2d40b39cde7da4e32994b6b5747eb9c6dd860 (patch) | |
tree | 4361bc6964ce5c50fa5e5cd70b2431e176654f3f | |
parent | a03861ecdf227c40033d8f70a7bd218f8256c3d9 (diff) |
Update git submoduleswmf/1.41.0-wmf.26
* Update extensions/GrowthExperiments from branch 'wmf/1.41.0-wmf.26'
to bae90b913c094e0e219b4a67bda2025797b3e4c1
- Link recommendations: prevent too large offsets in cirrus queries
Why:
- Cirrus has a limit of 10K for the offset
- Accumulating a single offset for all topics processed batches
leads to skip possible invalid page ids in sequent topics
What:
- The check for reaching 10K articles for a given topic
was using the $from value before its update for the current
iteration allowing an extra iteration with a too large offset.
Check after updating
- Start each topic with an offset of 0
- Accumulate fixed pages and diff against batched pageids
to avoid extra counts from pages in two topics or more
Bug: T345713
Depends-On: I85f47d71f7f444f1c5b7bfea7897e4187d20d15c
Change-Id: I042ec34a609ea582aaf285ffdc9ec4a6fe35449c
(cherry picked from commit ef08685ec76f1b84357ace10104dfe11813a7e15)
m--------- | extensions/GrowthExperiments | 0 |
1 files changed, 0 insertions, 0 deletions
diff --git a/extensions/GrowthExperiments b/extensions/GrowthExperiments -Subproject 000fddd0693910f23b339c5f330caacb382f92f +Subproject bae90b913c094e0e219b4a67bda2025797b3e4c |