MIGRAGENT

What the reading job did

Nobody starts these. Cloud Scheduler does, four times before six in the morning, and the job writes down what it found. Every number on this page was read off a row that job wrote when it finished, including the rounds that failed. The last one ran 23 hours ago.

24rounds recorded
24finished clean
348pages fetched
310unchanged, cost nothing
38pages that moved
2414requirements held

What runs, and when

The order is the point. Read the government pages first, then ask the job boards, then work out who needs telling. Run the digest first and it reports on yesterday.

UTCJobWhat it is for
03:17retention sweepdeletes every case past its window
04:40watch roundre-reads what we hold, and works out what moved
05:00job listingsnew postings off government boards
05:20digestwho does today's changes affect, and tell them

The rounds themselves

Newest first. A page whose bytes did not move is never re-read and never sent to a model, which is why the unchanged column is usually the biggest one and why a round that does almost nothing is a round working correctly.

StartedLaneWhat it didTook
06 Sep 04:45 23 hours ago AE work re-read what we hold 14 fetched · 14 unchanged, so nothing was re-read 50s clean
06 Sep 04:44 23 hours ago ES work re-read what we hold 2 fetched · 2 unchanged, so nothing was re-read 101s clean
06 Sep 04:44 23 hours ago AE study re-read what we hold 7 fetched · 7 unchanged, so nothing was re-read 19s clean
06 Sep 04:44 23 hours ago ES study re-read what we hold 3 fetched · 2 unchanged, so nothing was re-read · 1 moved · 11 requirements kept 335s clean
06 Sep 04:44 23 hours ago FR work re-read what we hold 19 fetched · 19 unchanged, so nothing was re-read 28s clean
06 Sep 04:42 23 hours ago UK study re-read what we hold 28 fetched · 28 unchanged, so nothing was re-read 26s clean
06 Sep 04:42 23 hours ago CA study re-read what we hold 10 fetched · 10 unchanged, so nothing was re-read 24s clean
06 Sep 04:42 23 hours ago CA work re-read what we hold 28 fetched · 28 unchanged, so nothing was re-read 70s clean
06 Sep 04:42 23 hours ago FR study re-read what we hold 19 fetched · 19 unchanged, so nothing was re-read 24s clean
06 Sep 04:42 23 hours ago UK work re-read what we hold 20 fetched · 20 unchanged, so nothing was re-read 18s clean
05 Sep 04:47 47 hours ago AE work re-read what we hold 14 fetched · 13 unchanged, so nothing was re-read · 1 moved · 1 requirements kept 61s clean
05 Sep 04:45 47 hours ago AE study re-read what we hold 7 fetched · 7 unchanged, so nothing was re-read 17s clean
05 Sep 04:43 47 hours ago ES work re-read what we hold 9 fetched · 5 unchanged, so nothing was re-read · 4 moved · 68 requirements kept 147s clean
05 Sep 04:43 47 hours ago FR work re-read what we hold 19 fetched · 7 unchanged, so nothing was re-read · 12 moved · 12 material · 93 requirements kept 518s clean
05 Sep 04:43 47 hours ago ES study re-read what we hold 7 fetched · 3 unchanged, so nothing was re-read · 4 moved · 40 requirements kept 97s clean
05 Sep 04:41 47 hours ago CA study re-read what we hold 10 fetched · 10 unchanged, so nothing was re-read 25s clean
05 Sep 04:41 47 hours ago FR study re-read what we hold 19 fetched · 13 unchanged, so nothing was re-read · 6 moved · 5 material · 47 requirements kept 236s clean
05 Sep 04:41 47 hours ago CA work re-read what we hold 28 fetched · 26 unchanged, so nothing was re-read · 2 moved · 33 requirements kept 126s clean
05 Sep 04:41 47 hours ago UK study re-read what we hold 28 fetched · 28 unchanged, so nothing was re-read 26s clean
05 Sep 04:41 47 hours ago UK work re-read what we hold 20 fetched · 19 unchanged, so nothing was re-read · 1 moved · 2 requirements kept 30s clean
04 Sep 04:45 2 days ago AE study re-read what we hold 7 fetched · 7 unchanged, so nothing was re-read 22s clean
04 Sep 04:45 2 days ago AE work re-read what we hold 14 fetched · 13 unchanged, so nothing was re-read · 1 moved · 1 requirements kept 47s clean
04 Sep 04:45 2 days ago ES study re-read what we hold 7 fetched · 2 unchanged, so nothing was re-read · 5 moved · 48 requirements kept 143s clean
04 Sep 04:45 2 days ago ES work re-read what we hold 9 fetched · 8 unchanged, so nothing was re-read · 1 moved · 27 requirements kept 48s clean

What actually moved

Both versions are kept with both dates. The sentence about what changed is written by a model and says so; the counts underneath it are measured.

Read from the same store the job writes to, not from a copy. 1221 of 1229 registered pages have been read at least once. This page does not ask the Cloud Run API what happened, because the web service cannot become the watcher and is not getting a new role so a page can look busier. How it is put together · Everything we have read · Back to the start