From 377cbf7e2d3839cc44e3d39f35390cad5d19b161 Mon Sep 17 00:00:00 2001 From: Wolf Date: Wed, 30 Sep 2026 15:44:24 +0200 Subject: [PATCH] Correct docs/plan-hosts-wave-2.md: seed versus live counts, dead references, WP9 scope and ordering State that the 76 is the seed's count, name the survey files that do not exist, make WP9 own _runner.py because detail cannot fill a title until DETAIL_FIELDS has it, and make it wait for plan-remote's WP-A and the review's R1, which own the same files. Co-Authored-By: Claude Fable 5.1 --- docs/plan-hosts-wave-2.md | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/docs/plan-hosts-wave-2.md b/docs/plan-hosts-wave-2.md index 2be7b3f..813eac8 100644 --- a/docs/plan-hosts-wave-2.md +++ b/docs/plan-hosts-wave-2.md @@ -6,7 +6,7 @@ The board filter this plan had as WP11 landed as the agents' reach (`decisions.m ## Where it stands -76 companies are on the Watchlist, each with the careers page opened on 2026-09-29 and, but for nine, a reason. 35 of them carry `unread`: a program can read them and nothing does yet. +In the seed (`seed/companies.json`, 362 companies, 286 with a board), 76 companies have no board, each with the careers page opened on 2026-09-29 and, but for nine, a reason; 35 carry `unread`: a program can read them and nothing does yet. The live Watchlist has moved on: 89 companies have no board (14 more were added by hand), Infineon and Microsoft are attached as Eightfold boards, and Novonesis, Darktrace and Criteo as Workday boards. | Route | Companies | Roles seen | |---|---|---| @@ -16,11 +16,11 @@ The board filter this plan had as WP11 landed as the agents' reach (`decisions.m | A host that is read, with a gap | Tryg, DNB, Allegro (SuccessFactors), Quantum Systems (Recruitee on a custom domain), Siemens (Avature), Metacore, Wallbox (empty boards) | | | Teamtailor, career host not found | Templafy, Queue-it, Telenor, Polestar, IQM, TeamViewer, Tractive, Starship, Factorial | | -The survey's record of each company is in `docs/plan-hosts/survey-own.json` (class, host, identifier, listing URL, roles seen, the request that showed it), with a paragraph per host in `own-1.md` to `own-4.md`. Arm and Mambu are not in it; their notes are under WP10. The raw responses were not kept, so a builder fetches its own fixtures. +The survey's record of each company is in `docs/plan-hosts/survey-own.json` (class, host, identifier, listing URL, roles seen, the request that showed it), with a paragraph per host in `own-1.md` to `own-4.md`. Arm and Mambu are not in it; their notes are under WP10. The raw responses were not kept, so a builder fetches its own fixtures; `own-1.md` and `own-2.md` name `out-own-1.json` and `out-own-2.json`, which do not exist, and `survey-own.json` is the whole record. ## Decisions to take first -**A listing that knows no title.** A sitemap lists URLs, and the listing rewrites the title on every pull, so a sitemap reader would show a title made from the URL. The contract already has `Reads(title="provisional")` (`plugins/readers/_contract.py`), but nothing honours it: `upsert_role` still overwrites a title that `detail` filled. WP9 adds that rule. +**A listing that knows no title.** A sitemap lists URLs, and the listing rewrites the title on every pull, so a sitemap reader would show a title made from the URL. The contract already has `Reads(title="provisional")` (`plugins/readers/_contract.py`), but nothing honours it: `upsert_role` overwrites the title on every pull. And `detail` cannot fill a title yet, since `_runner.DETAIL_FIELDS` has no `title` and the contract says the listing rewrites it. WP9 adds both rules: `title` in `DETAIL_FIELDS`, so the runner takes it from `detail`, and `upsert_role` keeping a stored title over a provisional one. **One module per company.** An own API or an own HTML list is read by a module named after the company, with a fixed slug. `RANK` puts them after the hosts, and they have no `PATTERNS`, since discovery finds nothing a slug could be made from. @@ -30,26 +30,26 @@ Each owns its modules in `plugins/readers/`, `tests/test_ats_.py` and `tes | WP | Model | Builds | Needs | |---|---|---|---| -| 9 Provisional title | Opus | `upsert_role` keeps a stored title over a provisional one, and its tests; owns `app/storage/store.py`, `plugins/ats.py`, `tests/test_storage.py` | | -| 10 Sitemap reader | Sonnet | `sitemap`: job URLs from a sitemap, the role from the page's JSON-LD or microdata | WP9 | +| 9 Provisional title | Opus | `title` in `DETAIL_FIELDS`, `upsert_role` keeping a stored title over a provisional one, and their tests; owns `plugins/readers/_runner.py`, `app/storage/store.py`, `plugins/ats.py`, `tests/test_storage.py` | `plan-remote.md` WP-A | +| 10 Sitemap reader | Sonnet | `sitemap`: role URLs from a sitemap, the role from the page's JSON-LD or microdata | WP9 | | 12 Own APIs | Sonnet | Ørsted, Amazon, Vinted, Dynatrace, RELEX, Siteimprove, Bending Spoons | | | 13 Own lists, Nordic and German | Sonnet | Zalando, Netcompany, CHECK24, Bolt | | | 14 Own lists, the rest | Sonnet | Google with DeepMind, Lucca, Shopify; Framer, Bird and Ableton only if an afternoon is left | | | 15 Gaps in hosts that are read | Sonnet | Recruitee on a custom domain; the SuccessFactors pages of Tryg, DNB and Allegro; Avature for Siemens | | -WP12 to WP15 can start at once and in parallel. WP10 waits for WP9. +WP9 owns files that `plan-remote.md` WP-A also owns (`app/storage/`, `plugins/`, `tests/`) and `plan-review.md` R1 edits (`_runner.py`, `ats.py`), so it waits until those have merged. WP12 to WP15 own new modules only and can start at once and in parallel. WP10 waits for WP9. ### WP10 notes: Mambu and Arm Both were read live on 2026-09-29 without a browser or a block. -- **Mambu, classic iCIMS.** `https://careers-mambu.icims.com/sitemap.xml` has one `` per job (`/jobs/{id}/{slug}/job`) with `lastmod`, plus `/jobs/intro`; robots.txt allows it and lists the sitemap. The detail `.../jobs/{id}/x/job?in_iframe=1` carries a JSON-LD `JobPosting` with `datePosted`, `description`, `jobLocation[].address.addressCountry`, `validThrough` and `employmentType`. Tenants use other subdomain prefixes, so the target stores the whole host. 8 roles. +- **Mambu, classic iCIMS.** `https://careers-mambu.icims.com/sitemap.xml` has one `` per role (`/jobs/{id}/{slug}/job`) with `lastmod`, plus `/jobs/intro`; robots.txt allows it and lists the sitemap. The detail `.../jobs/{id}/x/job?in_iframe=1` carries a JSON-LD `JobPosting` with `datePosted`, `description`, `jobLocation[].address.addressCountry`, `validThrough` and `employmentType`. Tenants use other subdomain prefixes, so the target stores the whole host. 8 roles. - **Arm, TalentBrew (Radancy).** The `*-arm.icims.com` hosts only redirect to `careers.arm.com`. `https://careers.arm.com/sitemap.xml` lists all 399 `/job/...` URLs in one request, without titles. The detail's JSON-LD has `datePosted` (unpadded, "2026-6-25"), `description`, `identifier` and `jobLocation[].address`. The paged list at `/search-jobs/results` is HTML inside JSON and only answers the full parameter set; its `data-total-results` counts content pages, `data-total-job-results` counts roles. ## Planner, after the merges - Attach each board with `app companies set-board`, which reads it first and clears the reason. -- Bring `seed/companies.json` in line with the live database: the board of every company that has one, the reason of every company that has none. +- Bring `seed/companies.json` in line with the live database: the board of every company that has one (24 more than the seed's 286, among them Microsoft, Infineon, Novonesis, Darktrace, Criteo and NVIDIA), the reason of every company that has none (five differ; `app companies seed` never replaces a board, so this is done by hand). - Declare `Fields(posted="trusted")` on a reader whose date is a posting date, with the evidence in the docstring. - Restart the server by its PID after a backup in `../jobboard-backups/`. - Find the career host of the nine Teamtailor companies by opening each careers page.