Fold the review of 2026-09-30 into the decisions and open items, and delete the plan

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
WolfandClaude Fable 5.1 committed 2026-09-30 16:11:27 +02:00
1 parent a63eed2e56
commit a211cf7414
4 files changed
+29 -86

No files matched your search

+9 -8
View File
@@ -20,17 +20,18 @@ The order of the stages is `CASCADES` in `app/jobs/cascade.py`; this section say
| `complete` | `stamp` | `close_boards`: only a complete read closes |
| `ids` | `stamp`, the compound ids the read listed | `close_boards`: closes open roles not in it |
| `filtered` | `stamp`, a read by country, place or remote | `close_boards`: keeps roles with a vote or an application |
| `narrowed` | `stamp`, a read by fetch terms | `close_boards`: closes nothing |
| `remote_unasked` | `stamp`, a filtered read while the agents wanted remote and the host has no remote filter | `close_boards`: keeps remote roles, closes them by age; the Companies line says "remote not asked" |
| `narrowed` | `stamp`, a read by fetch terms | `close_boards`: closes only roles not listed for `STALE_DAYS` |
| `swept` | `stamp`, a complete read that finished a sweep begun on an earlier pull | `close_boards`: applies the two-strikes rule |
| `sweep` | `stamp`, the cursor of a read cut at `MAX_PAGES` | `_runner.read` on the next pull |
| `count` | `stamp`, the roles a whole read listed | `_runner.read`, the 10% guard |
| `count` | `stamp`, the roles the last read listed; reset by Recheck | `_runner.read`, the 10% guard |
| `missing` | `close_boards` (`_close_swept`), the ids the last finished sweep missed | the next finished sweep |
| `failing` | `ats._board` through `record_failure`, `{since, reason}`; removed on the next answer | `close_boards` (21 days), the Companies list, `enrich` |
| `failing` | `ats._board` and `run_batch` through `record_failure`, `{since, reason}`; removed after the next stamp. `search:failing:<target>` is the same for a search | `close_boards` (21 days), the Companies list and the search row, `enrich`, the guard's escape after 21 days |
| `facets` | `_runner.facets_for`, kept one day | `reach.site_facets`, the Companies line |
| `size`, `sizechecked` | `ats.keep_size`: `set_board`, Recheck, `app companies size`, or the first read of an unsized board | `reach.sizes`, which decides whether the board is filtered |
| `detailed`, `detailfailed`, `detailempty` | `ats.read_board_details` (`enrich`): ids read, ids whose read failed, `{id: date}` of reads that gave no text; the pull drops the ids a complete listing no longer lists | `enrich.plan` through `detail_due` |
4. `close_boards`, the settle of the pull, closes what a complete read did not list, closes a board that failed for `STALE_DAYS`, and releases the run.
4. `close_boards`, the settle of the pull, closes what a complete read did not list, closes a board or search that failed for `STALE_DAYS`, releases the run, and raises one `pull.settled` notice in the Problems log when a target did not answer or was read incomplete, or a board closed more than 50 roles or more than half of its open ones.
5. Then, in order: `prep` (maps the hosts' words, resolves places and company aliases, folds copies with `app/dupes.py`), `embed`, `score`, `enrich` (reads the role pages of the best-ranked roles without text), `prep`, `embed` and `score` again for the roles it filled (skipped when it filled none), `extract`, `score`, `summarise`. Extract and summarise are switches under Runs; enrich is on by default.
## The three ways a source is read
@@ -99,10 +100,10 @@ Numbers are from the live database on 2026-09-30, after the pull of 12:52. "Open
| Pages per board | 100 a pull | A board above it is swept across pulls: each pull stores what it read and the next continues from the cursor. A role of a swept board closes only when two finished sweeps in a row missed it, so a new role on a later page waits up to one sweep. A read that reaches the host's `ceiling` (Workday 2,000) is not swept and closes nothing; a filter must bring the board under it. |
| Wait | 0.5 s before every page after the first, for boards and searches alike, and before every role page | The list of a Workday board of 1,000 roles spends about 25 s waiting. |
| Per-role reads | `enrich`, after scoring: 200 per board and 1,000 per run, ranked roles first | See "List, then each role". Roles the agents do not rank are not read. |
| Closing a role | after a complete read, every open role of the board it did not list | An incomplete read closes nothing. A role listed again reopens. A board switched off closes its roles at once. A filtered read keeps roles with a vote or an application; a read by fetch terms closes nothing. |
| Search roles | a complete search closes what it did not list; otherwise a role closes when no search has listed it for 21 days | A search result is never a company's whole list. A Jobindex search is never complete, so its roles close by the 21 days only. |
| A board that fails | first failure: logged, roles stay open, the Companies list shows "not answering since" | Any error counts: refused host, timeout, HTTP error, parse error, oversize, and a filtered, terms or `empty="suspect"` read that lists under 10% of what the same read listed last time (`SUSPECT_SHARE`). A search that fails is skipped for the pull and leaves no record. |
| A board that fails for 21 days | all its open roles close at the next pull | The next answer reopens what it lists. `STALE_DAYS` is the one 21. |
| Closing a role | after a complete read, every open role of the board it did not list | An incomplete read closes nothing, and so does a read that asked nothing. A role listed again reopens. A board switched off closes its roles at once. A filtered read keeps roles with a vote or an application, and remote roles when the host could not be asked for remote; a read by fetch terms closes only roles not listed for 21 days. |
| Search roles | a complete search closes what it did not list; otherwise a role closes when no search has listed it for 21 days | A search result is never a company's whole list. A Jobindex search is never complete, so its roles close by the 21 days only. A search failing for 21 days closes its roles. |
| A board that fails | first failure: logged, roles stay open, the Companies list shows "not answering since" | Any error counts: refused host, timeout, HTTP error, parse error, oversize, a row that would not store, and a read that lists under 10% of what the same read listed last time (`SUSPECT_SHARE`) once that was at least `SUSPECT_MIN`, 10. A search that fails is recorded the same way and its row says so. |
| A board that fails for 21 days | all its open roles close at the next pull, and a suspect answer that has stood that long is accepted | The next answer reopens what it lists. `STALE_DAYS` is the one 21. |
| robots.txt | not read at run time | Decided per reader when it is built and recorded in `READS.robots` with the date (`docs/decisions.md`). `Crawl-delay` is not honoured. |
| 429 | first page: the board fails; a later page: the read stops, keeps what it read and is incomplete; a role page: the reads of that board stop until the next enrich run | Nothing is closed on a list cut short by a 429. |