Commit Graph
226 Commits
Author SHA1 Message Date
WolfandClaude Sonnet 5.5 0ed0360b09 Add the Jobnet search reader, which reads jobnet.dk's backend with the x-csrf header and 100 ads a page
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-03 12:21:00 +02:00
WolfandClaude Opus 5.5 c497fe965d Keep a description's headings, bullets and paragraphs, and draw them in the reader
The readers flattened a posting's HTML into one line with strip_html, so
sections and bullets ran together. _shared.html_text gives a line per
paragraph, '• ' before a list item and '## ' before a heading; every
reader's description goes through it, sections read per role get their
own headings, and the reader pane draws the lines as h3, ul and p.
Excerpts leave the marks out.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 21:40:12 +02:00
WolfandClaude Opus 5.5 9e2631ffe3 Offer only the remote tokens within the asking agent's scope, so an agent kept to Europe is not offered Remote · United States
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:27:09 +02:00
Wolf 5c3c187dca Merge the remote pages: scope line, Remote select, remote chips and badge (wp-remote-b)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

# Conflicts:
#	app/static/agents.js
2026-09-30 16:22:22 +02:00
Wolf e5572cab9d Merge the remote area: remote tokens, role_remote, remote_from, model wins for remote (wp-remote-a)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

# Conflicts:
#	app/models.py
2026-09-30 16:21:57 +02:00
WolfandClaude Fable 5.1 a63eed2e56 Say remote not asked on the Companies line, show a failing search on its row, forget a removed search's record, and mark a read that asked nothing as not closing
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 16:11:27 +02:00
WolfandClaude Fable 5.1 0ad47605fd Expect limits, board_open and the full reader declaration in the exact-row tests
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 16:03:48 +02:00
WolfandClaude Fable 5.1 750d3d1311 Merge main into wp-review-limits
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 16:01:30 +02:00
WolfandClaude Fable 5.1 a221625eff Give the test readers a READS, a dated robots record and the search params the contract now requires
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 16:01:30 +02:00
WolfandClaude Fable 5.1 f626e06ac5 Test the limit words and the two endpoints
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 16:00:45 +02:00
WolfandClaude Opus 5.5 2a0f7fe0c3 Test the remote area with the live boards' place texts
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:00:06 +02:00
WolfandClaude Opus 5.5 6f2b1ff72a Ask extract where a remote hire may live and map its answer before the rescore
remote_where is a list of names, [] when not stated. Remote is remote with a regular office week and hybrid with set office days each week.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:00:06 +02:00
WolfandClaude Opus 5.5 e4c0de4465 Compose remote as model, host word, place line and map a remote role's area in prep
The area is the model's names, else the parts of the place texts that say remote, else the resolved places as their countries. VERSION 3 maps every open role again. run_roles maps the roles extract answered. "Remote Sensing" in a title is no remote work.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:00:06 +02:00
WolfandClaude Opus 5.5 57cac5f896 Add migration 27 and read a remote role's area in the chips, the gates and the rows
roles.remote_model, roles.remote_where_model and role_remote, with a stored remote no host word gives kept as the host's word. The remote tokens filter over role_remote, remote_from and a require gate on country read a remote role through its area, extract waits while remote_where_model is NULL and writes the model's remote outright, and rows carry remote_where.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:00:06 +02:00
WolfandClaude Opus 5.5 189cf81350 Read remote: place tokens, the Anywhere place and a remote area's overlap in places
remote:country:DK is a remote role whose area overlaps Denmark: what lies in it, what it lies in, Anywhere. remote:anywhere is Anywhere alone and remote:any the viewing agent's scope. Anywhere is a continent outside the tree with no alias. Remote parts of a line are no town, and the suggestions offer the remote tokens after the countries.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:00:06 +02:00
WolfandClaude Fable 5.1 fe2a1b0347 Merge main into wp-review-contract
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:57:46 +02:00
WolfandClaude Fable 5.1 fac3487925 Merge main into wp-review-losses
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:54:33 +02:00
WolfandClaude Fable 5.1 2cc83b1d84 Correct the contract docstring: detail is read by enrich, the example is Workday's, the touch points of a new reader
Adds the search providers' PARAMS, clean_params and company, and a test
that the example READS is workday.py's.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:54:13 +02:00
WolfandClaude Fable 5.1 9c8a610787 Guard each target in a batch, close remote-unasked and narrowed roles by age, settle failing searches, and raise one notice per settle naming what needs a look
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:53:47 +02:00
WolfandClaude Fable 5.1 36bc639384 Guard every read that is not a sweep, treat a read that asks nothing as incomplete, and mark a filtered read that could not ask remote, so no board loses its roles to a changed answer or a filter it could not send
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:53:47 +02:00
WolfandClaude Fable 5.1 72252a1c04 Hold plugins/readers/ to its contract, helpers, the standard library, httpx and pydantic
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:52:38 +02:00
WolfandClaude Fable 5.1 531c8bc337 Delete the _UNREADABLE entries of hosts that have a module
Ten entries were shadowed by their modules. A test now holds that no entry
names a reader, which replaces the per-host checks.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:51:48 +02:00
WolfandClaude Fable 5.1 5f1b9e93e1 Check each declared field against the reader's fixtures
A missing fixture fails with the path to add. Detail fixtures are named
<name>-detail*, the rows of a paged read state a total as complete says,
and a host that states words has a prep table for them.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:51:13 +02:00
WolfandClaude Fable 5.1 2349fc424b Require READS, search params and a dated robots record; record robots.txt per requested path
Every reader declares, so undeclared(), the scope() fallback, robots_page and
ROBOTS_ANY_CASE go. A search provider needs PARAMS and clean_params, a row may
carry company, places gains none. Each robots record names the paths the
reader requests, from robots.txt read again on 2026-09-30. Platsbanken states
remote, HR Manager states no place.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:51:13 +02:00
WolfandClaude Fable 5.1 09468455d1 Merge main into wp-review-bugs
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:47:05 +02:00
WolfandClaude Fable 5.1 5fdda078ff Test the pages' links and the excerpt fallback
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:44:32 +02:00
WolfandClaude Fable 5.1 0e268f3f3c Compare the full board target in Replace board
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:44:32 +02:00
WolfandClaude Fable 5.1 0ebaa852f6 Store a board's reach countries as ISO codes and refuse an empty seniority range
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:44:32 +02:00
WolfandClaude Opus 5.5 888586c29b Make the agent's scope a line of its own: Only roles in Europe, chosen countries or Everywhere, read and written as the require gate on country
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 15:31:40 +02:00
WolfandClaude Opus 5.5 8c6ea0ffb6 Leave out titles by phrase: an exclude gate mode and a title gate field
A role whose title holds one of the agent's phrases as whole words is gated
with the phrase as its reason, a favourite's too. The agent form has a
Leave out titles line under Where. function = sales could not do it, since
the classifier files Solutions Engineer and pre-sales under sales.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 15:27:43 +02:00
WolfandClaude Opus 5.5 593c351037 Add remote.js: the remote badge words, the picks of the remote_from line and how gates share out between Where and Other rules, with tests
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 15:23:04 +02:00
WolfandClaude Opus 5.5 8c66aeb445 Merge board size set once, Recheck, and the Companies line naming what a site does not know (wp-a-size)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:45:27 +02:00
WolfandClaude Opus 5.5 27e24d0342 Merge the Jobindex link-out: the Se jobbet link kept as posting_url (wp-d-jobindex)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:45:27 +02:00
WolfandClaude Opus 5.5 6085017943 Recheck a board's size from the Companies row, the route and app companies size
POST /api/sources/{id}/size sizes the board again, keeps the day and queues a pull; /api/companies returns size and size_checked, and the row shows "999 roles · checked 30 Sep" with Recheck beside Change. app companies size <key> does the same from the CLI, and --missing sizes every board without a size.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:44:54 +02:00
WolfandClaude Opus 5.5 a0882e9659 Size a board once with board_size, before a pull reads it with no size, and name what a site's ids leave out
set_board sizes a board from page 1's total, or reads to the end on a host that states none, instead of reading it whole up to page 100. A pull no longer rewrites ats:size; a board with none is handed the agents' reach marked unsized and is sized in its batch first, or by its whole read on a host that cannot narrow the reach. reach.sizes drops the open-role fallback. The Companies line names countries a Workday or Oracle site does not list and a missing remote option.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:43:52 +02:00
WolfandClaude Opus 5.5 802656aca4 Prune done work from the docs: fold the ingest review's open findings into open.md and delete it, cut the hosts wave-2 plan to what is unbuilt, drop the smaller-hosts survey
The plugins README no longer describes a run-time robots.txt check or boards that never close past the page cap.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:40:43 +02:00
WolfandClaude Opus 5.5 3e3060ba50 Link the obvious towns of the Unmapped list: 460 unlinked place texts down to 50
About 190 German towns (mostly 1KOMMA5°'s) and the German states, French,
Italian, Dutch, Asian and other towns, the ISO3 codes and German or French
country names boards write. Towns keep their marks through spelling groups.
The tests that used Paderborn, Jena and Überlingen as unknown towns use
Bopfingen, Lauchheim and Ellwangen instead. Left: names that are no place,
ambiguous ones (Halifax, Richmond, Victoria, Durham, Warwick) and bare codes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:34:27 +02:00
WolfandClaude Opus 5.5 b98561f64a Fetch a posting's text on demand, following a Jobindex ad to the posting itself
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:26:20 +02:00
WolfandClaude Opus 5.5 d168d9eb6c Add migration 26, roles.posting_url, kept across pulls and carried on the row and its copies
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:26:20 +02:00
WolfandClaude Opus 5.5 54b56ac370 Read the Se jobbet link off a Jobindex vis-job page
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:26:20 +02:00
WolfandClaude Opus 5.5 19401cfc7a Merge two strikes for boards swept across pulls (wp-b-strikes)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:25:33 +02:00
WolfandClaude Opus 5.5 d2552ad6be Merge per-role text for SmartRecruiters and Workable (wp-c-text)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:24:13 +02:00
WolfandClaude Opus 5.5 70aa4b3117 Read the text of SmartRecruiters and Workable roles through detail, keeping Workable's shortcode in the row
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:23:58 +02:00
WolfandClaude Opus 5.5 a91032b60f Close a role of a swept board only when two finished sweeps in a row missed it
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:23:57 +02:00
WolfandClaude Opus 5.5 5410131f4a Link DEU, Deutschlandweit, the German remote regions, AMER and North America
DEU and Deutschlandweit are spellings of Germany, AMER and North America of
the United States. Seevetal and Neukirchen-Vluyn are German towns, and
Niedersachsen, Nord-, Ost- and Süddeutschland are regions of Germany named
without towns. Fleet Place Office and Solaris SE stay unlinked.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:22:33 +02:00
WolfandClaude Opus 5.5 d529f6c0ce Merge the seniority range filter: From, To and Track in the rail (wp-sen-b-range)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:14:45 +02:00
Wolf dd9e359609 Merge the seniority ladder's levels: title rules, host tables, extract, migration 25 (wp-sen-a-levels)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

# Conflicts:
#	app/prep/hosts/jobylon.py
#	app/prep/hosts/recruitee.py
2026-09-30 13:14:45 +02:00
WolfandClaude Opus 5.5 b2c9a9ec29 Link the German towns, Villach, Americas and Asia Pacific; map the unmapped host words
Fifteen towns join Germany and Villach joins Austria. Americas is a spelling of
the United States, and Asia Pacific (APAC) is a continent over no country.
The Lever, HiBob, Jobylon, Personio, SmartRecruiters and Recruitee tables
learn the 40 words the Unmapped list showed, most of Lever's commitments.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:14:21 +02:00
WolfandClaude Opus 5.5 322db49773 Title levels on the ladder: principal, senior manager, distinguished, lead split (WP A)
from_title matches a title twice, for the highest people level and the
highest individual grade. A people level wins on its own rung; a grade
above that rung lifts it one rung (Principal Engineering Manager is a
senior manager). Senior Staff is principal, Senior Principal, Distinguished
and Technical Fellow are distinguished; Associate Director, AVP and Senior
Manager are senior managers. lead is now a team lead only (Team Lead, Shift
Lead, Supervisor, Teamleiter); Tech Lead, Lead X and X Lead(er) are staff.
A slash names two levels, so Senior/Staff is staff.

- Jobylon "lead" maps to staff; Recruitee maps student_college, manager,
  senior_manager and executive.
- extract's prompt describes the ladder and its two tracks; enum from LEVELS.
- prep VERSION 2, so the next prep maps every open role again.
- Migration 25 clears seniority_model where it is staff, lead, manager or
  director, so extract reads those roles again, and sets roles.seniority to
  the first filled of model, stated and title.
- The coverage test of tests/test_seniority.py passes; its xfail is gone.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:11:26 +02:00
WolfandClaude Opus 5.5 06ff9f549b List unlinked places and unmapped words under Sources, fix them in code with the unmapped skill
Settings > Sources > Unmapped shows the place texts no place resolves, with
their roles' countries and companies, and the host words no table maps, and
copies both as text. Prep fingerprints places.seed(), so a town or spelling
added to the code is seeded and every open role is mapped again at the next
prep. app prep unlinked lists the places on the command line.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:06:22 +02:00