4.9 KiB
Plan: the readers left after the hosts of 2026-09-29
Planned 2026-09-29, after wave 0 and wave 1 of the hosts plan landed. What landed is in decisions.md under Ingestion and The phone; what is open without a plan is in open.md. This file and docs/plan-hosts/ are deleted when the packages below land or are dropped.
Where it stands
286 of 362 companies have a board. 76 are on the Watchlist, each with the careers page that was opened on 2026-09-29 and, but for nine, a reason. 35 of them carry unread: a program can read them and nothing does yet.
| Route | Companies | Roles seen |
|---|---|---|
| Sitemap and structured data | Arm, Mambu, Odoo, Aiven, SOPHiA GENETICS, AUTO1, Apple, ASML | about 2,000 |
| Own JSON API | Ørsted, Amazon, Vinted, Dynatrace, RELEX, Siteimprove, Bending Spoons | about 570 |
| Own HTML list | Zalando, Netcompany, Bolt, CHECK24, Google with DeepMind, Lucca, Shopify, Framer, Bird, Ableton | about 950 |
| A host that is read, with a gap | Infineon, Microsoft (Eightfold's page cap), Tryg, DNB, Allegro (SuccessFactors), Quantum Systems (Recruitee on a custom domain), Siemens (Avature), Metacore, Wallbox (empty boards) | |
| Teamtailor, career host not found | Templafy, Queue-it, Telenor, Polestar, IQM, TeamViewer, Tractive, Starship, Factorial |
The survey's record of each company is in docs/plan-hosts/survey-own.json (class, host, identifier, listing URL, roles seen, the request that showed it), with a paragraph per host in own-1.md to own-4.md and the smaller hosts in otherhosts.md. The raw responses were not kept; a builder fetches its own fixtures.
Decisions to take first
A listing that knows no title. A sitemap lists URLs. detail may not set a title, since the listing rewrites it on every pull, so a sitemap reader would show a title made from the URL. Two ways out: the module reads the role pages inside page, which costs one request per role on every pull, or the contract gains a row key that marks the title as provisional, and upsert_role keeps a stored title over a provisional one. The second is the smaller cost per pull and touches app/storage/store.py.
A filter in a target. Eightfold takes a location, Workday and SuccessFactors a country facet. A target is host:slug and has nowhere to state one. subscriptions.params exists for searches; a board could use it, and page would receive it. This brings Infineon and Microsoft under the page cap and cuts a pull of Bosch (4,812 roles), Philips or SAP to the countries the agents accept.
One module per company. An own API or an own HTML list is read by a module named after the company, with a fixed slug. Fourteen hosts landed as fourteen files without a shared edit, so the package takes a module per company as it is; RANK puts them after the hosts, and they have no PATTERNS, since discovery finds nothing a slug could be made from.
Work packages
Each owns its modules in plugins/atshosts/, tests/test_ats_<name>.py and tests/fixtures/ats/<name>*, and nothing else. The common rules of wave 1 apply: the live request limits, robots.txt read first, no key from a script, a final report with the targets to attach.
| WP | Model | Builds | Needs |
|---|---|---|---|
| 9 Provisional title | Opus | the row key, upsert_role's rule and its tests; owns plugins/ats.py, plugins/atshosts/__init__.py, app/storage/store.py, tests/test_atshosts.py, tests/test_storage.py |
the first decision |
| 10 Sitemap reader | Sonnet | sitemap: job URLs from a sitemap, the role from the page's JSON-LD or microdata |
WP9 |
| 11 Board filters | Opus | params on a board subscription, handed to page; owns plugins/ats.py, app/jobs/pull.py, app/jobs/sources.py, app/web/api.py, app/static/companies.js and their tests |
the second decision |
| 12 Own APIs | Sonnet | Ørsted, Amazon, Vinted, Dynatrace, RELEX, Siteimprove, Bending Spoons | |
| 13 Own lists, Nordic and German | Sonnet | Zalando, Netcompany, CHECK24, Bolt | |
| 14 Own lists, the rest | Sonnet | Google with DeepMind, Lucca, Shopify; Framer, Bird and Ableton only if an afternoon is left | |
| 15 Gaps in hosts that are read | Sonnet | Recruitee on a custom domain; the SuccessFactors pages of Tryg, DNB and Allegro; Avature for Siemens |
WP12 to WP15 can start at once and in parallel. WP10 waits for WP9, and WP9 and WP11 both own plugins/ats.py, so they run one after the other.
Planner, after the merges
- Attach each board with
app companies set-board, which reads it first and clears the reason. - Bring
seed/companies.jsonin line with the live database: the board of every company that has one shown, the reason of every company that has none. - Add a host to
TRUSTED_POSTED_HOSTSwhere its date is a posting date, with the evidence in the comment. - Restart the server by its PID after a backup in
../jobboard-backups/. - Find the career host of the nine Teamtailor companies by opening each careers page.