Commit Graph
299 Commits
Author SHA1 Message Date
WolfandClaude Opus 5.5 699bf81e3b Fetch a role's posting text through fetch_posting, so a Jobindex role is read from its Se jobbet link
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:47:06 +02:00
WolfandClaude Opus 5.5 8c66aeb445 Merge board size set once, Recheck, and the Companies line naming what a site does not know (wp-a-size)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:45:27 +02:00
WolfandClaude Opus 5.5 27e24d0342 Merge the Jobindex link-out: the Se jobbet link kept as posting_url (wp-d-jobindex)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:45:27 +02:00
WolfandClaude Opus 5.5 6085017943 Recheck a board's size from the Companies row, the route and app companies size
POST /api/sources/{id}/size sizes the board again, keeps the day and queues a pull; /api/companies returns size and size_checked, and the row shows "999 roles · checked 30 Sep" with Recheck beside Change. app companies size <key> does the same from the CLI, and --missing sizes every board without a size.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:44:54 +02:00
WolfandClaude Opus 5.5 a0882e9659 Size a board once with board_size, before a pull reads it with no size, and name what a site's ids leave out
set_board sizes a board from page 1's total, or reads to the end on a host that states none, instead of reading it whole up to page 100. A pull no longer rewrites ats:size; a board with none is handed the agents' reach marked unsized and is sized in its batch first, or by its whole read on a host that cannot narrow the reach. reach.sizes drops the open-role fallback. The Companies line names countries a Workday or Oracle site does not list and a missing remote option.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:43:52 +02:00
WolfandClaude Opus 5.5 802656aca4 Prune done work from the docs: fold the ingest review's open findings into open.md and delete it, cut the hosts wave-2 plan to what is unbuilt, drop the smaller-hosts survey
The plugins README no longer describes a run-time robots.txt check or boards that never close past the page cap.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:40:43 +02:00
Wolf a44bf5dacb my todo 2026-09-30 13:38:46 +02:00
WolfandClaude Opus 5.5 3e3060ba50 Link the obvious towns of the Unmapped list: 460 unlinked place texts down to 50
About 190 German towns (mostly 1KOMMA5°'s) and the German states, French,
Italian, Dutch, Asian and other towns, the ISO3 codes and German or French
country names boards write. Towns keep their marks through spelling groups.
The tests that used Paderborn, Jena and Überlingen as unknown towns use
Bopfingen, Lauchheim and Ellwangen instead. Left: names that are no place,
ambiguous ones (Halifax, Richmond, Victoria, Durham, Warwick) and bare codes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:34:27 +02:00
WolfandClaude Opus 5.5 cb5f9e5e74 Open the posting_url over the original_url in the reader, its Also posted list and the o key
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:26:20 +02:00
WolfandClaude Opus 5.5 b98561f64a Fetch a posting's text on demand, following a Jobindex ad to the posting itself
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:26:20 +02:00
WolfandClaude Opus 5.5 d168d9eb6c Add migration 26, roles.posting_url, kept across pulls and carried on the row and its copies
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:26:20 +02:00
WolfandClaude Opus 5.5 54b56ac370 Read the Se jobbet link off a Jobindex vis-job page
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:26:20 +02:00
WolfandClaude Opus 5.5 19401cfc7a Merge two strikes for boards swept across pulls (wp-b-strikes)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:25:33 +02:00
WolfandClaude Opus 5.5 d2552ad6be Merge per-role text for SmartRecruiters and Workable (wp-c-text)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:24:13 +02:00
WolfandClaude Opus 5.5 70aa4b3117 Read the text of SmartRecruiters and Workable roles through detail, keeping Workable's shortcode in the row
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:23:58 +02:00
WolfandClaude Opus 5.5 a91032b60f Close a role of a swept board only when two finished sweeps in a row missed it
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:23:57 +02:00
WolfandClaude Opus 5.5 5410131f4a Link DEU, Deutschlandweit, the German remote regions, AMER and North America
DEU and Deutschlandweit are spellings of Germany, AMER and North America of
the United States. Seevetal and Neukirchen-Vluyn are German towns, and
Niedersachsen, Nord-, Ost- and Süddeutschland are regions of Germany named
without towns. Fleet Place Office and Solaris SE stay unlinked.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:22:33 +02:00
WolfandClaude Opus 5.5 a19c528e3f Plan board size set once, two strikes for swept boards, SmartRecruiters and Workable text, Jobindex link-out
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:19:07 +02:00
WolfandClaude Opus 5.5 5ed36b7301 Fold the seniority plan into the decisions and delete it
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:16:36 +02:00
WolfandClaude Opus 5.5 d529f6c0ce Merge the seniority range filter: From, To and Track in the rail (wp-sen-b-range)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:14:45 +02:00
Wolf dd9e359609 Merge the seniority ladder's levels: title rules, host tables, extract, migration 25 (wp-sen-a-levels)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

# Conflicts:
#	app/prep/hosts/jobylon.py
#	app/prep/hosts/recruitee.py
2026-09-30 13:14:45 +02:00
WolfandClaude Opus 5.5 b2c9a9ec29 Link the German towns, Villach, Americas and Asia Pacific; map the unmapped host words
Fifteen towns join Germany and Villach joins Austria. Americas is a spelling of
the United States, and Asia Pacific (APAC) is a continent over no country.
The Lever, HiBob, Jobylon, Personio, SmartRecruiters and Recruitee tables
learn the 40 words the Unmapped list showed, most of Lever's commitments.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:14:21 +02:00
WolfandClaude Opus 5.5 322db49773 Title levels on the ladder: principal, senior manager, distinguished, lead split (WP A)
from_title matches a title twice, for the highest people level and the
highest individual grade. A people level wins on its own rung; a grade
above that rung lifts it one rung (Principal Engineering Manager is a
senior manager). Senior Staff is principal, Senior Principal, Distinguished
and Technical Fellow are distinguished; Associate Director, AVP and Senior
Manager are senior managers. lead is now a team lead only (Team Lead, Shift
Lead, Supervisor, Teamleiter); Tech Lead, Lead X and X Lead(er) are staff.
A slash names two levels, so Senior/Staff is staff.

- Jobylon "lead" maps to staff; Recruitee maps student_college, manager,
  senior_manager and executive.
- extract's prompt describes the ladder and its two tracks; enum from LEVELS.
- prep VERSION 2, so the next prep maps every open role again.
- Migration 25 clears seniority_model where it is staff, lead, manager or
  director, so extract reads those roles again, and sets roles.seniority to
  the first filled of model, stated and title.
- The coverage test of tests/test_seniority.py passes; its xfail is gone.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:11:26 +02:00
WolfandClaude Opus 5.5 e03305ff87 Say how fetch terms are separated and that they match the whole ad
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:07:25 +02:00
WolfandClaude Opus 5.5 06ff9f549b List unlinked places and unmapped words under Sources, fix them in code with the unmapped skill
Settings > Sources > Unmapped shows the place texts no place resolves, with
their roles' countries and companies, and the host words no table maps, and
copies both as text. Prep fingerprints places.seed(), so a town or spelling
added to the code is seeded and every open role is mapped again at the next
prep. app prep unlinked lists the places on the command line.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:06:22 +02:00
WolfandClaude Opus 5.5 4e390d97ca Filter seniority by a range of rungs and a track: level_from, level_to, track; From, To and Track in the rail (WP B)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:03:31 +02:00
WolfandClaude Opus 5.5 ae978594b4 Plan seniority as a ladder with two tracks and a range filter; the ladder in models
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 12:58:12 +02:00
WolfandClaude Opus 5.5 d858020068 Merge branch 'wp-l-two-overrides'
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 12:51:13 +02:00
WolfandClaude Opus 5.5 e52857dea5 Split the All tag into two company overrides: All countries and All roles (WP L)
Fetching has two filters, and a company now overrides each on its own.
All countries (companies.all_countries) is the old All roles tag: its big
boards are read with the agents' wide reach. All roles (companies.all_roles,
new meaning) drops the agents' fetch terms and any later role filter.

- Migration 24 copies the old tag to all_countries and keeps all_roles for
  those companies, and moves a board's {"terms": false} to its company.
- The runner no longer reads {"terms": false}; the plan leaves the terms out
  for a company set to All roles.
- POST /api/companies/{key}/all-countries and /all-roles, each queueing a
  pull when turned on; CompanyOut carries both.
- Two toggles replace All on the Companies row, the reader and the Roles
  strip; the reach line states countries and role types in plain words;
  the filter select gets both options.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 12:50:45 +02:00
WolfandClaude Opus 5.5 795ca3628c Fold the prep plan into the decisions, keep the filter survey as reference
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 12:01:35 +02:00
WolfandClaude Opus 5.5 1538c776d6 Merge branch 'wp-f2-terms'
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 12:00:00 +02:00
WolfandClaude Opus 5.5 0fd45b333a Fetch terms narrow what big boards read with the wide reach send (WP F2)
An agent has fetch_terms (migration 23, API, a chip field in the agent
editor). The terms of a pull are the union over the enabled agents, none
when one of them has none. They go only to wide reads: a company tagged All
roles, or a reach ask_for drops as too many countries for a one host; a
board's {"terms": false} switches them off. SmartRecruiters q,
SuccessFactors q, Workday searchText, Phenom keywords, Eightfold query and
Oracle keyword declare query="one"; the runner makes one series per term
times the country series, drops the places first over MAX_SERIES, then the
terms. A term read is narrowed: it writes no ats:size, closes nothing and
prunes no per-role state, and the 10% guard holds it to its own
fingerprint. The Companies reach line counts the terms.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 11:59:27 +02:00
WolfandClaude Opus 5.5 3917b31209 Merge the prep stage with the readers that hand on host words (wp-p-prep, wp-r1-raw, wp-r2-raw)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 11:32:15 +02:00
WolfandClaude Opus 5.5 55757c41e5 Integration check: wp-p-prep with wp-r1-raw and wp-r2-raw
Resolves tests/test_readers_shared.py, adds MATCH_MODE to the pinpoint,
recruitee and rippling tables, and removes table_word, country_if_single and
remote_word from plugins/readers/_shared.py with their tests and the Helpers
paragraph.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 11:31:31 +02:00
Wolf 45604e9316 Merge branch 'wp-r1-raw' into scratch-p-integration 2026-09-30 11:28:38 +02:00
WolfandClaude Opus 5.5 56fad284a6 Prep reads remote from a Danish or Swedish place line, and from a search role's title
The search providers stop mapping remote_word themselves (R2), so prep reads
the same words: in any role's place line after remote_of, and in the title of
a role from a search.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 11:23:34 +02:00
WolfandClaude Opus 5.5 d04ceae7e0 Prep stage: host words stored raw, mapped centrally in app/prep after every pull
upsert_role stores the host's own words (roles.*_host), the place texts
unresolved when they change, and the company key unresolved on insert, and
marks the role prep_due. app.prep maps seniority, employment, remote and
country through the host tables in app/prep/hosts, resolves places and
company aliases, lists unknown words in `unmapped`, remaps every open role
when the tables' fingerprint changes, and runs rebuild_dupes, which moves
out of the pull's settle. Migration 22 adds the columns and the table and
fills the host words from raw. Cascade: pull, prep, embed, score, enrich,
prep, embed, score, extract, score, summarise. `app prep [unmapped]
[--remap]`, /api/prep/unmapped and a fold on the Sources page.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 11:19:22 +02:00
WolfandClaude Opus 5.5 06eb929eaf Readers oracle to workday and the providers hand on the host's words; their word tables move to app/prep/hosts
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 11:07:07 +02:00
WolfandClaude Opus 5.5 6c7ce1090d Readers ashby to lever hand on the host's words; their word tables move to app/prep/hosts
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:54:19 +02:00
WolfandClaude Opus 5.5 a66aac95cf Merge branch 'wp-k-all-roles'
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:45:03 +02:00
WolfandClaude Opus 5.5 5d5b7e7d3f Tag a company All roles to read its big boards with the agents' wide reach; favourite scores only
Migration 21 adds companies.all_roles, tags every favourite of any agent and each company whose board had params {"reach": "all"} (logged per board, the param removed). reach.plan reads a tagged company's boards with the union of the enabled agents' require reach and the base reach; favourite no longer widens the fetch. POST /api/companies/{key}/all-roles sets it and queues a pull when on. The Companies list, the reader and the company strip draw the toggle beside the affinity buttons, the list filters on it, and the board's reach editor drops its All roles option.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:44:41 +02:00
WolfandClaude Opus 5.5 5fa05d5f73 Plan prep: narrow the terms package to what the survey found
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:40:40 +02:00
WolfandClaude Opus 5.5 ce3857c14d Merge branch 'wp-s-survey'
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:40:26 +02:00
WolfandClaude Opus 5.5 535eb86f3e Survey which source-side filters the hosts take, and how towns reach the fetch
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:40:06 +02:00
WolfandClaude Opus 5.5 11ba94cfd7 Plan: readers only scrape, a prep stage maps centrally, agents' terms narrow big boards
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:32:01 +02:00
WolfandClaude Opus 5.5 8d9a059e24 Read Adzuna's keyed API although its robots.txt disallows /: the owner's decision
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:14:42 +02:00
WolfandClaude Opus 5.5 87202c163d Merge branch 'wp-j-cleanup'
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:13:40 +02:00
WolfandClaude Opus 5.5 903b69b6d3 Share the readers' place, table-lookup and country helpers, unify the employment vocabulary, and list the enrich switch with the stages
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:13:24 +02:00
WolfandClaude Opus 5.5 b567144612 Fold the readers plan into the decisions and delete it
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:06:50 +02:00
WolfandClaude Opus 5.5 ca80219bbb Merge branch 'wp-f-reach'
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 10:04:26 +02:00