Files
jobboard/plugins/README.md
T
WolfandClaude Opus 5.5 e52857dea5 Split the All tag into two company overrides: All countries and All roles (WP L)
Fetching has two filters, and a company now overrides each on its own.
All countries (companies.all_countries) is the old All roles tag: its big
boards are read with the agents' wide reach. All roles (companies.all_roles,
new meaning) drops the agents' fetch terms and any later role filter.

- Migration 24 copies the old tag to all_countries and keeps all_roles for
  those companies, and moves a board's {"terms": false} to its company.
- The runner no longer reads {"terms": false}; the plan leaves the terms out
  for a company set to All roles.
- POST /api/companies/{key}/all-countries and /all-roles, each queueing a
  pull when turned on; CompanyOut carries both.
- Two toggles replace All on the Companies row, the reader and the Roles
  strip; the reach line states countries and role types in plain words;
  the filter select gets both options.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 12:50:45 +02:00

517 lines
45 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# Where roles come from
This file lists every source roledesk reads roles from, how each is read and what it cannot deliver, as of the code and the live database of 2026-09-29. The contract for writing a reader (a host module or a search provider) is the docstring of `plugins/readers/__init__.py`, with its types and the declaration check in `plugins/readers/_contract.py` and the conformance test in `tests/test_readers_contract.py`, not this file.
The code has two plugins: `ats` (`plugins/ats.py`) reads the board of a company someone listed, with one module per host in `plugins/readers/`; `search` (`plugins/search.py`) runs saved queries on sites that list roles across companies. Below, a module of `ats` is a "host" and a module of `search` is a "provider". A company's list of roles on a host is its "board"; a board is attached as a target `host:slug`, e.g. `workday:lego.wd103/LEGO_External`.
## The three ways a source is read
**Whole board.** One request returns every role on the board with its text. The read is complete whenever the answer parses, so the pull can close every role the answer no longer lists.
**Paged.** The list arrives in pages of a fixed size, read one after another 0.5 s apart, at most 100 pages per board. The read is complete when the number of distinct roles read equals the total the host states, or, for a host that states none, when the read reaches an empty page. A board larger than 100 pages is read incomplete on every pull (see the shared rules).
**List, then each role.** The list, in one request or in pages, carries title, place and mostly a date, but no text. The text is on each role's own page, which is read once per role: at most 200 roles per board per pull, roles never tried before roles whose read failed. A new board of 800 roles has all its text after four pulls. Until its own page is read, a role is in the feed with title, place and the list's date, and it is ranked without its text. Three consequences follow from the code:
- `embed` encodes a role once. A role listed before its page was read is encoded from its title; when the text arrives on a later pull its vector is dropped, and the next `embed` encodes it again with the text. Until then its fit is the title's.
- The per-role read may fill only description, place, remote, pay figures and date. Title, link, department and the pay line come from the list, which states them on every pull. A role whose page was read is sent without the list's place and remote on later pulls, so what its page said stays; a place the host changes after that is not picked up.
- Completeness, and so closing, is decided by the list alone. A board of 800 roles closes its roles from the first pull.
## Overview
Numbers are from the live database after the pull of 2026-09-29. For the "list, then each role" hosts the description share is after one pull and rises by up to 200 roles per board per pull.
| Source | Boards | Open roles | How it is read | Roles per request | Description | Pay | Limit that matters most |
|---|---|---|---|---|---|---|---|
| Greenhouse | 85 | 10,216 | whole board | all | in the list | figures | a board over 96 MiB loses its text and pay |
| SmartRecruiters | 10 | 7,238 | paged | 100 | none | none | no text: ranked on the title alone |
| Ashby | 69 | 4,261 | whole board | all | in the list | figures | an unknown board name answers an empty board |
| SuccessFactors | 14 | 3,738 | list, then each role | the site's own | per role | none | default locale only |
| Workday | 13 | 2,377 | list, then each role | 20 | per role | none | 2,000 roles per board; country arrives per role |
| Lever | 24 | 1,033 | whole board | all | in the list | figures | one place per role |
| Phenom | 3 | 1,007 | list, then each role | 100 | per role | none | three sites checked |
| Oracle Recruiting Cloud | 4 | 826 | list, then each role | 200 | per role | none | no pay field |
| Eightfold | 1 | 630 | list, then each role | 10 | per role | none | 1,000 roles per board |
| Teamtailor | 35 | 598 | paged | 50 | in the list | none | no pay; nine companies without a found site |
| Jobindex (search) | – | 538 | paged | 20 | excerpt in the list | none | excerpt only; at most 200 results per search |
| Platsbanken (search) | – | 446 | paged | 100 | in the list | none | at most 1,000 results per search |
| Personio | 3 | 322 | whole board | all | in the list | figures | one place, no country |
| Recruitee | 8 | 177 | whole board | all | in the list | figures | an empty board looks like no board to discovery |
| Workable | 7 | 153 | paged | 10 | none | none | no text: ranked on the title alone |
| Jibe | 1 | 140 | paged | 100 | in the list | none | Booking Holdings' roles read with Booking.com's |
| Deel | 1 | 96 | whole board | all | in the list | line only | pay has no period |
| Gem | 2 | 44 | list, then each role | all | per role | none | undocumented query, can break |
| Jobylon | 2 | 33 | list, then each role | all | per role | none | scraped from the careers widget |
| Rippling | 1 | 2 | list, then each role | all | per role | figures | text, date and pay cost one request per role |
| Pinpoint | 1 | 2 | whole board | all | in the list | figures | no date |
| HiBob | 1 | 2 | whole board | all | in the list | figures | pay never seen filled |
| BambooHR | 1 | 2 | list, then each role | all | per role | none | paging of a large board unverified |
| Adzuna (search) | – | 0 | paged | 50 | excerpt in the list | figures | never run live; needs a key |
| HR Manager | 0 | 0 | paged | 100 | in the list | none | not attached: the portal's robots.txt disallows reading |
"Figures" means yearly `salary_min`, `salary_max` and `currency`, plus a pay line; "line only" means a pay line (`salary_text`) and no figures. Figures are yearly: a monthly figure is multiplied by 12 where the host states the period, and an hourly, daily or weekly one is kept as a line only.
## Rules every source shares
| Limit | Value | What it means |
|---|---|---|
| Schedule | `pull` every 6 h by default, editable under Runs | Each pull starts the cascade `pull`, `embed`, `score`, `extract`, `score`, `summarise`; `extract` and `summarise` are off by default. |
| Batches | 10 boards or searches per batch, 8 batches at once (`workers.http: 8`) | Within a batch boards are read one after another. One pull runs at a time. |
| Where requests go | https on port 443, only to the host names the host module allows; no IP address, no local name; at most 3 redirects, each checked | A slug cannot point a request anywhere else. |
| Size cap | 96 MiB per response | A larger answer fails the board. Greenhouse retries once without text and pay; no other host has a fallback. |
| Time limits | 10 s to connect, 30 s between bytes, 60 s for the whole request; 15 s per request for the search providers | A slow board fails for this pull and is asked again next pull. |
| Pages per board | 100 | A board above it (1,000 roles at Workable or Eightfold, 2,000 at Workday, 5,000 at Teamtailor, 10,000 at SmartRecruiters) is read incomplete: roles on the first 100 pages are stored and new ones found, but no role of that board is ever closed by list. |
| Wait | 0.5 s before every page after the first and before every per-role read; none between search pages | The list of a Workday board of 1,000 roles spends about 25 s waiting. |
| Per-role reads | 200 per board per pull | The rest wait for the next pull. A 404 or 410 counts as read; another failure is retried on a later pull. |
| Closing a role | after a complete read, every open role of the board it did not list | An incomplete read closes nothing. A role listed again reopens. A board switched off closes its roles at once. |
| Search roles | a complete search closes what it did not list; otherwise a role closes when no search has listed it for 21 days | A search result is never a company's whole list. |
| A board that fails | first failure: logged, roles stay open, the Companies list shows "not answering since" | Any error counts: refused host, timeout, HTTP error, parse error, oversize, robots.txt. |
| A board that fails for 21 days | all its open roles close at the next pull | The next answer reopens what it lists. |
| robots.txt | read before the list for the 14 hosts that name a page: Workday, SuccessFactors, Oracle, Phenom, Eightfold, Jibe, Gem, BambooHR, Pinpoint, Deel, Jobylon, Rippling, HiBob, HR Manager; kept for one day per board | A disallow fails the board with "robots.txt disallows it" and counts toward the 21 days. An unreachable file (5xx, 429, timeout) fails the board for this pull and is asked again next pull. A 4xx means no rules, which allows. `Crawl-delay` is not honoured. The eight API hosts (Greenhouse, Lever, Ashby, Workable, SmartRecruiters, Recruitee, Personio, Teamtailor) and the search providers read no robots.txt. |
| 429 | first page: the board fails; a later page: the read stops, keeps what it read and is incomplete; a per-role read: the per-role reads of that board stop until the next pull | Nothing is closed on a list cut short by a 429. A search that fails is skipped for the pull. |
How far a board is read: a pull asks each board over 300 roles for the reach of the search agents that are switched on (`app/jobs/reach.py`): the union of their `any` gates on country, town (as its country) and remote, or every role when one agent can take a role from anywhere. A company set to All countries is asked for the agents' wide reach, the union of their `require` reach, Europe today; a host that asks one country a request reads such a board whole instead of 30 times, unless fetch terms narrow it. A board's own reach, set on the Companies list, wins. A complete filtered read closes the roles outside the reach, except those with a vote or an application.
Fetch terms narrow a wide read by words. Each agent has a list of them (`fetch_terms`, set in the agent editor); the terms of a pull are the union over the agents that are on, and none when one of those agents has none. They go only to a board read with the wide reach: a company set to All countries, or a board whose reach is more countries than a one-country host is asked for (`MAX_SERIES`, 8). The narrow reach (Denmark, Sweden) leaves at most about 150 roles on any big board, so it takes no terms, and nor does a board under 300 roles, one never read whole, or one with its own reach. A company set to All roles takes none on any of its boards. A host that takes a keyword gets one series per term, unioned by id, each combined with the country series (an AND on every host the survey tested). When terms times the country series exceed 8, the place part of the reach goes first, whole, and the terms stay; more than 8 terms read the board unfiltered. Every host matches the whole text, not only the title, so a term like `engineer` cuts less than it looks. A read with terms is never the whole board: it records no size, closes no role it did not list, and the 10% guard holds it only to a read with the same terms and places. The search providers take no terms: each saved search has its own query.
What no source does:
- Filter on the host's side for a host other than SmartRecruiters, SuccessFactors, Workday, Oracle, Phenom and Eightfold. Greenhouse, Ashby, Recruitee and the rest are read whole.
- Filter by category or level at the source. Workday, Oracle, Jibe and Eightfold state category ids, but nothing maps an agent's terms to them yet (`docs/filter-survey.md`).
- Read more than one board per company. DFDS is read from its Danish Teamtailor board only.
- Use a key taken from a site's script. Maersk, New Work and Welcome to the Jungle are on the Watchlist for that reason.
- Read a page that needs a browser to run its script.
- Log in anywhere.
## Hosts read as a whole board
### Greenhouse
| | |
|---|---|
| Target | the board token, e.g. `greenhouse:trustpilot` |
| Companies | 85 boards: Trustpilot, Cognite, Wolt |
| List | `boards-api.greenhouse.io/v1/boards/<token>/jobs` with `content=true` and `pay_transparency=true`, the whole board in one answer; no total |
| Requests per pull | 1; 2 when the first answer is over 96 MiB |
| Description | in the list, full text (`content`); live: 10,216 of 10,216 |
| Date | `first_published`, else `updated_at`; trusted as the posting date |
| Place and country | `location.name`, one place; the app reads the country from that line (9,307 of 10,216) |
| Remote | none from the host; the app reads remote or hybrid from the place line (2,131 roles) |
| Pay | figures from `pay_input_ranges` when there is exactly one range; a range whose title says hour or day is a line only; any other range is taken as yearly. Several ranges give one line per range and no figures. Live: 2,170 with figures, 2,503 with a line |
| Found by discovery | yes, from a link to `boards.greenhouse.io`, `job-boards.greenhouse.io` or the embed script; a guessed name is probed first of all hosts |
| Limitations | Over 96 MiB the board is read again without `content=true`: titles land, text and pay of the whole board are lost. An `eu.greenhouse.io` link is read from the main API. The pay flag must be sent, or no range comes back. |
### Lever
| | |
|---|---|
| Target | the site name, or `eu/<site>` on Lever's EU instance, e.g. `lever:spotify`, `lever:eu/tomtom` |
| Companies | 24 boards: Spotify, TomTom, Pipedrive |
| List | `api.lever.co/v0/postings/<site>?mode=json` (`api.eu.lever.co` for `eu/`), the whole board in one answer; no total, no paging parameter sent |
| Requests per pull | 1 |
| Description | in the list, `description` (else `descriptionPlain`); the module reads no `lists` or `additional` sections, so it is the opening text; live: 1,023 of 1,033 |
| Date | `createdAt`; trusted |
| Place and country | `categories.location`, one place; `allLocations` is not read; country from that line (1,012 of 1,033) |
| Remote | `workplaceType`, the host's own word (1,032 of 1,033) |
| Pay | figures from `salaryRange` for `per-year-salary` and `per-month-salary` (×12); other intervals a line only; live: 207 with figures, 210 with a line |
| Found by discovery | yes, from a `jobs.lever.co` or `api.lever.co` link on either instance; a guessed name is probed on the US instance, then on the EU one |
| Limitations | The same site name on the two instances is two companies. Only one place per role is read. |
### Ashby
| | |
|---|---|
| Target | the board name, which may carry a dot or be a uuid, e.g. `ashby:pleo`, `ashby:jimdo.com` |
| Companies | 69 boards: Pleo, Too Good To Go, Lovable |
| List | `api.ashbyhq.com/posting-api/job-board/<name>?includeCompensation=true`, the whole board in one answer; no total |
| Requests per pull | 1 |
| Description | in the list, full text (`descriptionHtml`); live: 4,261 of 4,261 |
| Date | `publishedAt`; trusted |
| Place and country | `location`, one place; secondary places are not read; country from that line (4,003 of 4,261) |
| Remote | `isRemote`, true or false (2,625 with a value) |
| Pay | figures from the first `Salary` component with interval `1 YEAR` or `1 MONTH` (×12); an hourly one a line only; bonus and equity appear in the line only. Live: 1,482 with figures, 1,499 with a line |
| Found by discovery | yes, from a `jobs.ashbyhq.com` link; a guessed name is probed |
| Limitations | The pay flag must be sent, or no compensation comes back. An unknown board name answers an empty board, so a board with no open roles looks like no board to discovery, and a mistyped name reads as an empty, complete board. The name is read without case, so a lowercased slug works. |
### Recruitee
| | |
|---|---|
| Target | the subdomain, e.g. `recruitee:bunq` |
| Companies | 8 boards: bunq, idealo, Climeworks |
| List | `https://<sub>.recruitee.com/api/offers/`, the whole board in one answer; no total |
| Requests per pull | 1 |
| Description | in the list, `description` only (`requirements` is not read); live: 177 of 177 |
| Date | `published_at`, else `created_at`; trusted |
| Place and country | `location`, else `city`, one place; country from that line (149 of 177) |
| Remote | `remote`, true or false (29 with a value) |
| Pay | figures from `salary` for period `year` and `month` (×12); other periods a line only; live: 12 with figures, 41 with a line |
| Found by discovery | yes, from a `<sub>.recruitee.com` link; a guessed name is probed |
| Limitations | A board with no offers answers an empty list and looks like no board to discovery. A board on the company's own domain is not read (planned in wave 2, Quantum Systems). |
### Personio
| | |
|---|---|
| Target | the subdomain, e.g. `personio:penneo` |
| Companies | 3 boards: Penneo, tado, 1KOMMA5° |
| List | the XML feed `https://<sub>.jobs.personio.de/xml`, the whole board in one answer; no total |
| Requests per pull | 1 |
| Description | in the list, every `jobDescription` value joined; live: 321 of 322 |
| Date | `createdAt`; trusted |
| Place and country | `office`, one place, no country field; country from that line (232 of 322) |
| Remote | true when the office text contains "remote", else unknown (37 roles) |
| Pay | figures from `salaryInformation` for `yearly` and `monthly` (×12); hourly, daily, weekly a line only; live: 1 role |
| Found by discovery | yes, from a `jobs.personio.de` or `jobs.personio.com` link; a guessed name is probed |
| Limitations | The feed has no role link; it is built as `/job/<id>`. Only the feed's default language is read. The company Personio itself is on the Watchlist as `blocked`. |
### Pinpoint
| | |
|---|---|
| Target | the subdomain, e.g. `pinpoint:xeneta` |
| Companies | 1 board: Xeneta |
| List | `https://<sub>.pinpointhq.com/postings.json`, the whole board in one answer; no total, no paging keys |
| Requests per pull | 1, plus robots.txt once a day |
| Description | in the list, full text: description, responsibilities, skills and benefits sections; live: 2 of 2 |
| Date | none: the list states none and the role page is not read for it; the role counts as posted when first seen |
| Place and country | `location.name` (else `city`) plus `province`, one place; country from that line |
| Remote | `workplace_type`: onsite, hybrid, remote |
| Pay | figures when `compensation_visible`, for annual and monthly (×12) frequencies; others a line only. The frequency spellings are guessed, since no board read so far shows pay |
| Found by discovery | yes, from a `<sub>.pinpointhq.com` link; not probed |
| Limitations | Written from Xeneta's board, two roles. Whether a large board pages `/postings.json` is unverified. A board shared by several brands (inMusic with Native Instruments) is read whole, with no filter on division. |
### Deel
| | |
|---|---|
| Target | the board slug on `jobs.deel.com`, with case, e.g. `deel:klarna` |
| Companies | 1 board: Klarna |
| List | the HTML page `https://jobs.deel.com/<slug>`, from which the Next.js server payload is read; the whole board in one answer; no total |
| Requests per pull | 1, plus robots.txt once a day |
| Description | in the list, full text (`richtextDescription`); live: 96 of 96 |
| Date | the publication's `createdAt`, else the posting's; not trusted, so the role counts as posted when first seen |
| Place and country | every `jobLocations` name, joined with "; "; country from that line (91 of 96) |
| Remote | `workArrangementEnum`: onsite, hybrid, remote (95 of 96) |
| Pay | line only, when visible: currency and two amounts with no period, so no yearly figure can be told from a monthly one (90 roles) |
| Found by discovery | yes, from a `jobs.deel.com` link, case kept; not probed |
| Limitations | Deel's `/api/` is disallowed by robots.txt, so the board is read out of the page's React payload, which a Next.js release can change. Written from Klarna's board only. A wrongly cased slug answers `Job Board Not Found` and fails the board. |
### HiBob
| | |
|---|---|
| Target | the subdomain of `careers.hibob.com`, e.g. `hibob:dixa` |
| Companies | 1 board: Dixa |
| List | `https://<sub>.careers.hibob.com/api/job-ad` with the header `companyIdentifier: <sub>`, the whole board in one answer; no total |
| Requests per pull | 1, plus robots.txt once a day |
| Description | in the list, full text: description, responsibilities, requirements, benefits; live: 2 of 2 |
| Date | `publishedAt`; not trusted, so the role counts as posted when first seen |
| Place and country | `site` plus `country`, one place |
| Remote | `workspaceTypeId`: remote, hybrid, onsite |
| Pay | figures from the `payTransparency*` fields for year and month (×12); hour, day and week a line only. No board seen had them filled, so the period spellings are guessed |
| Found by discovery | yes, from a `<sub>.careers.hibob.com` link; not probed |
| Limitations | Written from two boards (Dixa, Liquidia). The header is the public subdomain, not a key; without it the API answers 401. |
## Hosts read in pages
### SmartRecruiters
| | |
|---|---|
| Target | the company identifier, e.g. `smartrecruiters:BoschGroup` |
| Companies | 10 boards: Bosch (about 4,800 roles), Delivery Hero, Wise |
| List | `api.smartrecruiters.com/v1/companies/<id>/postings`, 100 per request by offset; states `totalFound` |
| Requests per pull | roles / 100, rounded up; 49 for Bosch |
| Description | none. The list carries no text, and the module does not read the per-posting endpoint, which would cost one request per role. These 7,238 roles are ranked on the title alone, and `extract` and `summarise` have nothing to read. Live: 0 of 7,238 |
| Date | `releasedDate`; trusted |
| Place and country | `fullLocation`, else city and country; country 7,230 of 7,238 |
| Remote | `location.remote`, true or false (122 remote) |
| Pay | none: the list states no pay |
| Found by discovery | yes, from a `jobs.`, `careers.` or `api.smartrecruiters.com` link; a guessed name is probed |
| Filter at the source | `?country=dk`, one country a request; remote is ignored by the API, so a remote role outside the reach is not read. Bosch DK: 2 of 4,830 (2026-09-30). Which countries is the agents' reach, see below. Fetch terms as `?q=engineer`, one a request, AND with the country; it matches title and text (Bosch: 1,713 of 4,830) |
| Limitations | 10,000 roles per board (100 pages). The identifier is read without case, so a lowercased slug works. An unknown identifier answers an empty list, not an error: a mistyped slug reads as a complete board with no roles and would close a company's roles. |
The reader's "Fetch the posting" button shows for these roles, since their description is empty; it reads one posting page on demand and does not feed `embed` or `extract`. Whether it reads a SmartRecruiters page cleanly was not checked.
### Workable
| | |
|---|---|
| Target | the account name, e.g. `workable:huggingface` |
| Companies | 7 boards: Hugging Face, Kahoot!, Starling Bank |
| List | a POST to `apply.workable.com/api/v3/accounts/<account>/jobs`, 10 per request with a `nextPage` token; states `total` |
| Requests per pull | roles / 10, rounded up, 0.5 s apart; at most 16 for any board attached (153 roles in all) |
| Description | none. The text is only on a per-role endpoint, which the module does not call. These roles are ranked on the title alone, and `extract` and `summarise` have nothing to read. Live: 0 of 153 |
| Date | `published`; trusted |
| Place and country | city, region and country joined; country 153 of 153 |
| Remote | the `remote` flag or `workplace` remote gives remote; the rest is stored as unknown (22 remote); hybrid is not read |
| Pay | none: the list states no pay |
| Found by discovery | yes, from an `apply.workable.com` or `<account>.workable.com` link; not probed, since a run of guesses trips Workable's rate limit |
| Limitations | 1,000 roles per board (100 pages of 10). Workable answers bursts with 429, which is why pages are 0.5 s apart; a 429 after the first page ends the read incomplete. The role link is built from the shortcode. |
### Teamtailor
| | |
|---|---|
| Target | the subdomain of `teamtailor.com`, or the whole host of a career site on the company's domain, e.g. `teamtailor:lunar`, `teamtailor:careers.trackunit.com` |
| Companies | 35 boards: Lunar, Trackunit, DFDS |
| List | the RSS feed `https://<site>/jobs.rss`, 50 per request by offset; no total, so the read goes on to an empty page |
| Requests per pull | roles / 50, rounded up, plus 1 for the empty page; at most 13 for any board attached (598 roles in all) |
| Description | in the list, full text; live: 598 of 598 |
| Date | `pubDate`; trusted |
| Place and country | every `tt:location` as "city, country", joined with "; "; country 582 of 598 |
| Remote | `remoteStatus`: fully is remote, hybrid, onsite; `none` and `temporary` stay unknown (290 with a value) |
| Pay | none: the feed states no pay |
| Found by discovery | yes, from a `<sub>.teamtailor.com` link; a page that loads Teamtailor's CDN names the page's own host as the board; a guessed name is probed |
| Limitations | 5,000 roles per board; a board of exactly 5,000 is also incomplete, since no empty page is reached. A page with nothing new ends the read incomplete. Nine seed companies have no board because their careers link is a marketing site, not the career host. |
### Jibe
| | |
|---|---|
| Target | the career site's host, e.g. `jibe:jobs.booking.com` |
| Companies | 1 board: Booking.com |
| List | `https://<host>/api/jobs?limit=100&page=<n>`, 100 per request, the most the host serves; states `totalCount` |
| Requests per pull | roles / 100, rounded up, plus robots.txt once a day; 2 for Booking.com |
| Description | in the list, full text: description and qualifications; live: 140 of 140 |
| Date | `posted_date`; not trusted, so the role counts as posted when first seen |
| Place and country | `full_location`, several places joined by the host; country 140 of 140 |
| Remote | none (`location_type` is a kind of coordinates) |
| Pay | none: the `salary_*` fields were 0 on every role and carry no currency |
| Found by discovery | no slug: a link to Jibe's CDN names the host only; the target is set by hand |
| Limitations | Only Booking.com's site was read. No brand filter: the Booking Holdings roles are read with the Booking.com ones. The site's robots.txt asks for `Crawl-delay: 5`, which is not honoured. |
### HR Manager
| | |
|---|---|
| Target | the portal's customer name, e.g. `hrmanager:stsgroup_tr` |
| Companies | none attached; Seaborg, the one seed company on it, is on the Watchlist as `robots` |
| List | the RSS feed `api.hr-manager.net/JobPortal.svc/<customer>/PositionList/rss/?incads=true`, 100 per request by `skip`; no total, so the read goes on to an empty page |
| Requests per pull | roles / 100, rounded up, plus 1 for the empty page, plus robots.txt once a day |
| Description | in the list, the whole advertisement |
| Date | `pubDate`; not trusted |
| Place and country | none: the feed names no place |
| Remote | none |
| Pay | none |
| Found by discovery | yes, from a portal or API link; not probed |
| Limitations | The portal's robots.txt on `candidate.hr-manager.net` disallows everything but the application form; the feed's API host has no robots.txt, so the module's check allows it. The owner decided to leave the board unattached. Without `take` the host answers 25 roles. |
## Hosts read as list, then each role
### SuccessFactors
| | |
|---|---|
| Target | the career site's host, or host plus a brand path, e.g. `successfactors:careers.vestas.com`, `successfactors:jobs.teradyne.com/MiR` |
| Companies | 14 boards: Novo Nordisk, Vestas, Carlsberg |
| List | the site's HTML search page `/search/?startrow=<n>`, parsed in its two known layouts; page size is the site's own (10, 15, 25 or 100) and cannot be set; a total where the pagination label states one |
| Requests per pull | roles / the site's page size, rounded up, plus up to 200 role pages, plus robots.txt once a day; per-board sizes are not in these notes |
| Description | per role, the `itemprop="description"` block of the role page; live: 1,651 of 3,738 after one pull |
| Date | the list's date column where it parses; the role page's `datePosted` replaces it when earlier; trusted |
| Place and country | the list's location, with a two-letter country code turned into the name; the role page's microdata replaces it; country 3,675 of 3,738 |
| Remote | none |
| Pay | none |
| Found by discovery | yes, from a link to a role, `/go/` page or search on the site's own host; a link to the SAP back end names the host only; not probed. A site on the company's own domain whose pages link only the back end is set by hand |
| Filter at the source | `optionsFacetsDD_country=DK`, one country a request; no remote facet. Vestas DK: 64 of 668 (2026-09-30). Which countries is the agents' reach, see below. Fetch terms as the form's `q=engineer`, one a request, AND with the country (Vestas DK: 40 of 64) |
| Limitations | Only the default locale's roles are listed: a role that exists only in another locale (Carlsberg's French brand, 37 of 105) is not read. Only `/search/` and `/job/` are read, never `/services/` or the `successfactors.eu` back end, so a company with only the back end (Bang & Olufsen) cannot be read. 100 pages per board, so 1,000 to 10,000 roles depending on the page size. A third layout or a bot wall that answers 200 fails the board with "not a SuccessFactors search page". Read from this machine only; not yet from the deployed server. |
### Workday
| | |
|---|---|
| Target | `<tenant>.<wdN>/<Site>`, site with case, e.g. `workday:lego.wd103/LEGO_External` |
| Companies | 13 boards: LEGO Group, Zendesk, Equinor |
| List | a POST to `/wday/cxs/<tenant>/<Site>/jobs`, 20 per request by offset (21 or more answers 400); the first page states the total |
| Requests per pull | roles / 20, rounded up, plus up to 200 role reads, plus robots.txt once a day; for a board of 1,000 roles 50 + 200 on the first pull |
| Description | per role, `jobDescription` from the role's JSON; live: 1,411 of 2,377 after one pull |
| Date | the list's "Posted N Days Ago" as a day, possibly one day off; "Posted 30+ Days Ago" and other languages give none; the role's `startDate` replaces it; trusted |
| Place and country | the list has `locationsText` ("Copenhagen" or "2 Locations"); the per-role read adds every location and the country. The country therefore arrives with the per-role read: 1,724 of 2,377 after one pull |
| Remote | `remoteType`, where the tenant sends it: remote, hybrid, onsite (585 with a value) |
| Pay | none: no pay field; pay appears only inside the text |
| Found by discovery | yes, from a `myworkdayjobs.com` link with a site; not probed |
| Filter at the source | the tenant's own facets in `appliedFacets`, ids read by `facets` once a day: the facet whose values are countries, and any value that reads as remote. Two facets intersect, so remote is a series of its own. LEGO DK: 97 of 455 (2026-09-30). A tenant with no country facet is read whole. Which countries is the agents' reach, see below. Fetch terms as `searchText` in the body, one a request, AND with the facets (LEGO: 106 for `engineer`) |
| Limitations | 2,000 roles per board (100 pages of 20). A tenant has several sites and each is its own board. robots.txt paths are matched without case, as Workday serves any case. Every tenant is behind Cloudflare and was read from this machine only. |
### Oracle Recruiting Cloud
| | |
|---|---|
| Target | `<pod host>/<siteNumber>`, e.g. `oracle:fa-evmr-saasfaprod1.fa.ocs.oraclecloud.com/CX_1` |
| Companies | 4 boards: Danske Bank, Nokia, Milestone Systems, Sinch |
| List | the REST resource `recruitingCEJobRequisitions`, 200 per request by offset, with secondary places expanded; states `TotalJobsCount` |
| Requests per pull | roles / 200, rounded up, plus up to 200 role reads, plus robots.txt once a day; 3 + 200 for Nokia's roughly 600 on the first pull |
| Description | per role: external description, responsibilities and qualifications joined; the list's one-paragraph `ShortDescriptionStr` is not stored; live: 432 of 826 after one pull |
| Date | `PostedDate`; the role's `ExternalPostedStartDate` replaces it when earlier; trusted |
| Place and country | the primary place plus every secondary one, joined with "; "; country 769 of 826 |
| Remote | `WorkplaceTypeCode`: remote, hybrid, onsite (741 with a value) |
| Pay | none: the resource states no pay |
| Found by discovery | yes, from a candidate site or role link on the pod, or a REST call naming `siteNumber`; not probed |
| Filter at the source | `selectedLocationsFacet` with the pod's geography ids, and `selectedWorkplaceTypesFacet=ORA_REMOTE` as a series of its own. `locationsFacet` lists the ten biggest countries only, so a country missing from a full list is read unfiltered: fa-evmr (Nokia) has neither DK nor SE listed and is read whole. Which countries is the agents' reach, see below. Fetch terms as `keyword=` in the finder, one a request; it matches the text (Nokia: 468 of 554 for `engineer`) |
| Limitations | The host is the tenant's Fusion pod, not the company's domain (`jobs.nokia.com` redirects to it). Links are built for locale `en`. The department fields were empty on every role of the four boards. |
### Phenom
| | |
|---|---|
| Target | the career site's host plus its locale root, e.g. `phenom:www.careers.philips.com/global/en` |
| Companies | 3 boards: King, Just Eat Takeaway.com, Philips |
| List | a POST to `https://<host>/widgets`, 100 per request by offset; states `totalHits` |
| Requests per pull | roles / 100, rounded up, plus up to 200 role pages, plus robots.txt once a day; 9 + 200 for Philips' 865 on the first pull |
| Description | per role, the JSON-LD `JobPosting` description of the role page; the list's `descriptionTeaser` is not stored; live: 335 of 1,007 after one pull |
| Date | the list's `postedDate`; the role page's `datePosted` replaces it when earlier (Philips' list gave the day of the read for a role posted 2026-09-08); trusted |
| Place and country | every place of `multi_location`, joined with "; "; country 975 of 1,007 |
| Remote | per role only, from the page's `checkRemote` (120 with a value) |
| Pay | none |
| Found by discovery | yes, from a `/<country>/<lang>/search-results` link; a link to Phenom itself names the host only; not probed |
| Filter at the source | `selected_fields.country`, a list of English names in one request; no remote. Philips NL and DE: 111 of 873 (2026-09-30). Which countries is the agents' reach, see below. Fetch terms as `keywords` in the body, one a request, AND with the countries; it matches the text, not the title |
| Limitations | The locale is built as `<lang>_<country>`, the spelling of the three sites read; another site may spell it differently. 10,000 roles per board. A role page without a description fails the read and is retried on a later pull. |
### Eightfold
| | |
|---|---|
| Target | `<tenant host>/<company domain>`, e.g. `eightfold:jobs.ericsson.com/ericsson.com` |
| Companies | 1 board: Ericsson |
| List | `https://<host>/api/pcsx/search?domain=<domain>&sort_by=timestamp`, newest first, 10 per request whatever `num` asks; states `count` |
| Requests per pull | roles / 10, rounded up, at most 100, plus up to 200 `position_details` reads, plus robots.txt once a day; 63 + 200 for Ericsson's 630 on the first pull |
| Description | per role, `jobDescription`; live: 200 of 630 after one pull |
| Date | `postedTs`; not trusted, so the role counts as posted when first seen |
| Place and country | every location, repeated names dropped, joined with "; "; country 622 of 630 |
| Remote | `workLocationOption`: onsite, hybrid, remote (628 with a value) |
| Pay | none |
| Found by discovery | yes, from an `eightfold.ai` link that carries `domain=`; a bare `eightfold.ai` link names the host only; not probed |
| Filter at the source | `location=<country name>`, one country a request; no remote. Ericsson SE: 154 of 618 (2026-09-30). Which countries is the agents' reach, see below. Fetch terms as `query=`, one a request, AND with the location; it matches title, text and skills (Ericsson SE: 102 of 154 for `software`) |
| Limitations | With 10 per request and 100 pages, a board over 1,000 roles is never read to the end; unless the country filter brings it under the cap: Infineon (1,289, 163 in DK and SE) and Microsoft (about 2,300, 60) become readable that way. Verified on three tenants only. |
### Gem
| | |
|---|---|
| Target | the board name on `jobs.gem.com`, with case, e.g. `gem:productboard` |
| Companies | 2 boards: sennder, Productboard |
| List | a GraphQL POST to `jobs.gem.com/api/public/graphql`, the whole board in one answer; no total |
| Requests per pull | 1, plus one GraphQL POST per role not yet read (at most 200), plus robots.txt once a day |
| Description | per role, `descriptionHtml`; live: 44 of 44 |
| Date | per role only, `firstPublishedTsSec`; not trusted, so the role counts as posted when first seen |
| Place and country | every location's city, joined with "; "; `isoCountry` is fetched and not used; country from the line (41 of 44) |
| Remote | `locationType`: onsite, hybrid, remote (44 of 44) |
| Pay | none; `compensationHtml` is fetched but was null on every role read |
| Found by discovery | yes, from a `jobs.gem.com` link, case kept; not probed |
| Limitations | The GraphQL queries were read out of the page's script bundle and are undocumented; a new bundle from Gem can rename a field and fail the board. An unknown board answers an empty list, not an error, so a wrongly cased or mistyped name reads as an empty, complete board. |
### Jobylon
| | |
|---|---|
| Target | the numeric company id, e.g. `jobylon:3143` |
| Companies | 2 boards: Einride, Vipps MobilePay |
| List | the careers widget's embed page `cdn.jobylon.com/jobs/companies/<id>/embed/v2/`, whose script literal holds the whole board; no total |
| Requests per pull | 1, plus one role page on `emp.jobylon.com` per role not yet read (at most 200), plus robots.txt once a day; 1 + 33 for Einride on the first pull |
| Description | per role, the JSON-LD description of the role page; live: 33 of 33 |
| Date | the list's day ("Sept. 25, 2026"); the role page's `datePosted` replaces it when earlier; trusted |
| Place and country | the list's place names, which can be cut short ("Houston +3 more"); the per-role read fills every place; country 32 of 33 |
| Remote | `workspace`: remote, hybrid, onsite (32 of 33) |
| Pay | none; JSON-LD pay is not read |
| Found by discovery | yes, from an `emp.` or `cdn.jobylon.com` link or a `jbl_company_id` on the company's own site; not probed |
| Limitations | Jobylon's own feeds are addressed by a uuid the company holds, so the widget is scraped; a change to its script literal breaks the board. An unknown id answers 404 and fails the board. |
### Rippling
| | |
|---|---|
| Target | the board slug on `ats.rippling.com`, with case, e.g. `rippling:prisma-careers` |
| Companies | 1 board: Prisma |
| List | `api.rippling.com/platform/api/ats/v1/board/<slug>/jobs`, the whole board in one array, one entry per role and place, merged by role; no total |
| Requests per pull | 1, plus one role record per role not yet read (at most 200), plus robots.txt once a day; 1 + 2 for Prisma |
| Description | per role, `description.role`; live: 2 of 2 |
| Date | per role only, `createdOn`; trusted |
| Place and country | the list's place labels, joined with "; "; the per-role read fills every work location |
| Remote | remote only when every place label starts with "remote"; otherwise unknown |
| Pay | figures, per role only, when the record has exactly one pay range with YEAR or MONTH (×12) frequency; no pay line |
| Found by discovery | yes, from an `ats.rippling.com` or API link, case kept; not probed |
| Limitations | Text, date and pay each wait for the per-role read. Several pay zones give no figures. A wrongly cased slug answers `Job Board not found` and fails the board. |
### BambooHR
| | |
|---|---|
| Target | the subdomain, e.g. `bamboohr:configit` |
| Companies | 1 board: Configit |
| List | `https://<sub>.bamboohr.com/careers/list`, the whole board in one answer; a list shorter than its `totalCount` fails the board rather than being read as whole |
| Requests per pull | 1, plus one `/careers/<id>/detail` per role not yet read (at most 200), plus robots.txt once a day; 1 + 2 for Configit |
| Description | per role; live: 2 of 2 |
| Date | per role only, `datePosted`; trusted |
| Place and country | the list's city and state; the country arrives with the per-role read |
| Remote | `isRemote`, else `locationType` 0 onsite, 1 remote, 2 hybrid; the codes are assumed from Configit's board |
| Pay | none; the per-role `compensation` was null |
| Found by discovery | yes, from a `<sub>.bamboohr.com` link; not probed |
| Limitations | Written from one board of two roles. Whether a large board pages `/careers/list` is unverified. |
## The search providers
A saved search is a query with its parameters, stored as a `search` subscription `provider:name`. It reads up to 5 pages by default and at most 10. A search that finds nothing is not saved. The text a provider sends is stored as the description; the reader shows "Fetch the posting" for any role whose description is under 500 characters, which fetches the posting page once, on demand, and stores it beside the description. The fetched text is what the reader and `summarise` use; `embed` and `extract` read the description only. A search that fails is skipped for the pull. No provider reads robots.txt.
### Jobindex
| | |
|---|---|
| Saved search | `q` in Jobindex's syntax (words are OR, `"a b"` a phrase, `+word` required) and optionally `area`, Jobindex's region id (1 Region Hovedstaden, 8 Aarhus, ...) |
| List | the RSS twin of the search page, `jobindex.dk/jobsoegning.rss`, newest first, 20 per page; no total. Complete when a page within the limit comes back short |
| Pages read | 5 by default (100 results), 10 at most (200) |
| Text | an excerpt of a couple of hundred characters from the feed; live: 537 of 538 have one. The full text only through "Fetch the posting", on demand, since every fetch of Jobindex's link counts as a click in its statistics |
| Date | `pubDate`; trusted |
| Place | the item's area, else the search's area; country always Denmark |
| Remote | from place and title words (41 roles) |
| Pay | none |
| Key | none |
| Limitations | The company is the logo's alt text or what follows the title's last comma. Items are not followed to the employer's site. |
### Platsbanken
| | |
|---|---|
| Saved search | `q` and optionally `region`, a län id from JobTech's taxonomy (Skåne is `CaRE_1nn_cSU`); empty for all of Sweden |
| List | `jobsearch.api.jobtechdev.se/search`, newest first, 100 per page; states `total` |
| Pages read | 5 by default (500 results), 10 at most (1,000); the API refuses an offset above 2,000, which the page limit never reaches |
| Text | `description.text` of the ad; live: 446 of 446. The code does not say whether this is the whole ad or a shortened one |
| Date | `publication_date`; trusted |
| Place | the municipality, else the region; country always Sweden |
| Remote | from headline words only, since `workplace_model` is mostly empty (0 roles) |
| Pay | none |
| Key | none |
| Limitations | A region is a län; there is no municipality or city filter. Free text ranks by all words rather than requiring them; a quoted phrase narrows it. |
### Adzuna
| | |
|---|---|
| Saved search | `q`, `country` (gb, de, nl, fr, at, be, es, it, pl, ch; not Denmark) and optionally `where`, a free place text |
| List | `api.adzuna.com/v1/api/jobs/<country>/search/<page>`, newest first, 50 per page; states `count` |
| Pages read | 5 by default (250 results), 10 at most (500) |
| Text | Adzuna's `description` snippet; its length is not stated in the code |
| Date | `created`; trusted |
| Place | `location.display_name`; country from the search |
| Remote | from title words only |
| Pay | figures from `salary_min` and `salary_max` in the country's currency, dropped when Adzuna marks them as predicted |
| Key | a free key from developer.adzuna.com, as `sources.search.adzuna` in the config or `ADZUNA_APP_ID` and `ADZUNA_APP_KEY`; without one the search fails |
| Limitations | Built against Adzuna's documented response and never run live; no Adzuna role is in the database. |
Jobnet and Jooble were left out: Jobnet's search answers 401 outside its own site's session, and Jooble gives a key only on a manual application and answered a Cloudflare challenge. LinkedIn and Indeed have no public search API.
## Sources that cannot be read, and why
76 of the 362 seed companies have no board and are on the Watchlist with a careers link opened on 2026-09-29.
| Reason | Count | What it means | Companies |
|---|---|---|---|
| `unread` | 35 | readable by a program; no module reads it yet | Zalando, Ørsted, Siemens, Infineon, Microsoft, Google DeepMind, Amazon, Apple, ASML, Netcompany, Tryg, DNB |
| `robots` | 10 | the site's robots.txt disallows the page a board would be read from | Novonesis, Darktrace, Criteo (Workday), Bang & Olufsen (SuccessFactors), Pandora, Terma, Zenegy, Umbraco, Snyk, Seaborg (HR Manager) |
| `group` | 8 | the roles are inside another company's board, with no field that separates them | Onfido, Tink, Glovo, Cognigy, Contractbook, Signavio, Native Instruments, Visma |
| `blocked` | 7 | the site answers a program with a challenge | Tradeshift, Personio, Adjust, Revolut, Silverfin, HashiCorp, Meta |
| `gone` | 4 | no careers page | wefox, WeTransfer, Featurespace, Unbabel |
| `key` | 3 | the only listing answers with a key the page's script carries | Maersk, New Work SE, Yousign (Welcome to the Jungle) |
| no reason | 9 | on Teamtailor, but the careers link is a marketing site and the career host is not found | Templafy, Queue-it, Telenor, Polestar, IQM, TeamViewer, Tractive, Starship, Factorial |
What is planned for the `unread` companies and for the gaps in hosts already read (Eightfold's page cap, SuccessFactors sites of Tryg, DNB and Allegro, Recruitee on a custom domain, a country filter in a target) is in `docs/plan-hosts-wave-2.md`. What is open without a plan is in `docs/open.md`.