Commit Graph
237 Commits
Author SHA1 Message Date
WolfandClaude Opus 5.5 4fc474c437 Give an agent a CV, languages, avoid and must texts, and read a posting's languages with a level and its deadline (migration 28)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 21:54:16 +02:00
WolfandClaude Opus 5.5 8a033e028d Hand search roles without text to enrich too, so a Jobbank role above the bar is read on its own page
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 12:31:21 +02:00
WolfandClaude Opus 5.5 04f4c09a21 Merge text for search readers with detail (wp-src-searchdetail)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 12:29:34 +02:00
WolfandClaude Sonnet 5.5 b148647ac3 Read a search role's own page for its text in enrich and on the Fetch button when its reader has detail.
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-03 12:29:19 +02:00
WolfandClaude Opus 5.5 10dec33dce Decode HTML entities in freehire titles and companies, and separate the region ids in the searches help
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 12:28:19 +02:00
WolfandClaude Opus 5.5 a9c387c130 Merge the wiring of the new search providers (wp-src-wiring)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 12:24:56 +02:00
WolfandClaude Sonnet 5.5 6e6e655203 Wire freehire, Jobnet and Akademikernes Jobbank into the CLI, the Sources form, dupes and the docs
Provider names, the CLI's choices and the dupes rule's search hosts now come from readers.PROVIDERS, and the regions, work modes and remote words from the modules' REGIONS, MODES and REMOTE, read with getattr so main works before and after the readers merge.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-03 12:24:34 +02:00
WolfandClaude Opus 5.5 07e3bb4756 Merge the jobbank search reader (wp-src-jobbank)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 12:21:18 +02:00
WolfandClaude Opus 5.5 ee17fe3e30 Merge the jobnet search reader (wp-src-jobnet)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 12:21:18 +02:00
WolfandClaude Sonnet 5.5 0ed0360b09 Add the Jobnet search reader, which reads jobnet.dk's backend with the x-csrf header and 100 ads a page
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-03 12:21:00 +02:00
WolfandClaude Sonnet 5.5 59e43f18b7 Add the freehire search reader: tech roles of many countries with full text, yearly pay and work mode
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-03 12:19:15 +02:00
WolfandClaude Sonnet 5.5 43c0bc7523 Read Akademikernes Jobbank's search feed, with each ad's text from its own page
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-03 12:18:56 +02:00
WolfandClaude Opus 5.5 c497fe965d Keep a description's headings, bullets and paragraphs, and draw them in the reader
The readers flattened a posting's HTML into one line with strip_html, so
sections and bullets ran together. _shared.html_text gives a line per
paragraph, '• ' before a list item and '## ' before a heading; every
reader's description goes through it, sections read per role get their
own headings, and the reader pane draws the lines as h3, ul and p.
Excerpts leave the marks out.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 21:40:12 +02:00
WolfandClaude Opus 5.5 9e2631ffe3 Offer only the remote tokens within the asking agent's scope, so an agent kept to Europe is not offered Remote · United States
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:27:09 +02:00
Wolf 5c3c187dca Merge the remote pages: scope line, Remote select, remote chips and badge (wp-remote-b)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

# Conflicts:
#	app/static/agents.js
2026-09-30 16:22:22 +02:00
Wolf e5572cab9d Merge the remote area: remote tokens, role_remote, remote_from, model wins for remote (wp-remote-a)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

# Conflicts:
#	app/models.py
2026-09-30 16:21:57 +02:00
WolfandClaude Fable 5.1 a63eed2e56 Say remote not asked on the Companies line, show a failing search on its row, forget a removed search's record, and mark a read that asked nothing as not closing
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 16:11:27 +02:00
WolfandClaude Fable 5.1 0ad47605fd Expect limits, board_open and the full reader declaration in the exact-row tests
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 16:03:48 +02:00
WolfandClaude Fable 5.1 750d3d1311 Merge main into wp-review-limits
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 16:01:30 +02:00
WolfandClaude Fable 5.1 a221625eff Give the test readers a READS, a dated robots record and the search params the contract now requires
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 16:01:30 +02:00
WolfandClaude Fable 5.1 f626e06ac5 Test the limit words and the two endpoints
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 16:00:45 +02:00
WolfandClaude Opus 5.5 2a0f7fe0c3 Test the remote area with the live boards' place texts
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:00:06 +02:00
WolfandClaude Opus 5.5 6f2b1ff72a Ask extract where a remote hire may live and map its answer before the rescore
remote_where is a list of names, [] when not stated. Remote is remote with a regular office week and hybrid with set office days each week.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:00:06 +02:00
WolfandClaude Opus 5.5 e4c0de4465 Compose remote as model, host word, place line and map a remote role's area in prep
The area is the model's names, else the parts of the place texts that say remote, else the resolved places as their countries. VERSION 3 maps every open role again. run_roles maps the roles extract answered. "Remote Sensing" in a title is no remote work.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:00:06 +02:00
WolfandClaude Opus 5.5 57cac5f896 Add migration 27 and read a remote role's area in the chips, the gates and the rows
roles.remote_model, roles.remote_where_model and role_remote, with a stored remote no host word gives kept as the host's word. The remote tokens filter over role_remote, remote_from and a require gate on country read a remote role through its area, extract waits while remote_where_model is NULL and writes the model's remote outright, and rows carry remote_where.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:00:06 +02:00
WolfandClaude Opus 5.5 189cf81350 Read remote: place tokens, the Anywhere place and a remote area's overlap in places
remote:country:DK is a remote role whose area overlaps Denmark: what lies in it, what it lies in, Anywhere. remote:anywhere is Anywhere alone and remote:any the viewing agent's scope. Anywhere is a continent outside the tree with no alias. Remote parts of a line are no town, and the suggestions offer the remote tokens after the countries.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 16:00:06 +02:00
WolfandClaude Fable 5.1 fe2a1b0347 Merge main into wp-review-contract
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:57:46 +02:00
WolfandClaude Fable 5.1 fac3487925 Merge main into wp-review-losses
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:54:33 +02:00
WolfandClaude Fable 5.1 2cc83b1d84 Correct the contract docstring: detail is read by enrich, the example is Workday's, the touch points of a new reader
Adds the search providers' PARAMS, clean_params and company, and a test
that the example READS is workday.py's.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:54:13 +02:00
WolfandClaude Fable 5.1 9c8a610787 Guard each target in a batch, close remote-unasked and narrowed roles by age, settle failing searches, and raise one notice per settle naming what needs a look
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:53:47 +02:00
WolfandClaude Fable 5.1 36bc639384 Guard every read that is not a sweep, treat a read that asks nothing as incomplete, and mark a filtered read that could not ask remote, so no board loses its roles to a changed answer or a filter it could not send
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:53:47 +02:00
WolfandClaude Fable 5.1 72252a1c04 Hold plugins/readers/ to its contract, helpers, the standard library, httpx and pydantic
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:52:38 +02:00
WolfandClaude Fable 5.1 531c8bc337 Delete the _UNREADABLE entries of hosts that have a module
Ten entries were shadowed by their modules. A test now holds that no entry
names a reader, which replaces the per-host checks.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:51:48 +02:00
WolfandClaude Fable 5.1 5f1b9e93e1 Check each declared field against the reader's fixtures
A missing fixture fails with the path to add. Detail fixtures are named
<name>-detail*, the rows of a paged read state a total as complete says,
and a host that states words has a prep table for them.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:51:13 +02:00
WolfandClaude Fable 5.1 2349fc424b Require READS, search params and a dated robots record; record robots.txt per requested path
Every reader declares, so undeclared(), the scope() fallback, robots_page and
ROBOTS_ANY_CASE go. A search provider needs PARAMS and clean_params, a row may
carry company, places gains none. Each robots record names the paths the
reader requests, from robots.txt read again on 2026-09-30. Platsbanken states
remote, HR Manager states no place.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:51:13 +02:00
WolfandClaude Fable 5.1 09468455d1 Merge main into wp-review-bugs
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:47:05 +02:00
WolfandClaude Fable 5.1 5fdda078ff Test the pages' links and the excerpt fallback
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:44:32 +02:00
WolfandClaude Fable 5.1 0e268f3f3c Compare the full board target in Replace board
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:44:32 +02:00
WolfandClaude Fable 5.1 0ebaa852f6 Store a board's reach countries as ISO codes and refuse an empty seniority range
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 15:44:32 +02:00
WolfandClaude Opus 5.5 888586c29b Make the agent's scope a line of its own: Only roles in Europe, chosen countries or Everywhere, read and written as the require gate on country
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 15:31:40 +02:00
WolfandClaude Opus 5.5 8c6ea0ffb6 Leave out titles by phrase: an exclude gate mode and a title gate field
A role whose title holds one of the agent's phrases as whole words is gated
with the phrase as its reason, a favourite's too. The agent form has a
Leave out titles line under Where. function = sales could not do it, since
the classifier files Solutions Engineer and pre-sales under sales.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 15:27:43 +02:00
WolfandClaude Opus 5.5 593c351037 Add remote.js: the remote badge words, the picks of the remote_from line and how gates share out between Where and Other rules, with tests
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 15:23:04 +02:00
WolfandClaude Opus 5.5 8c66aeb445 Merge board size set once, Recheck, and the Companies line naming what a site does not know (wp-a-size)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:45:27 +02:00
WolfandClaude Opus 5.5 27e24d0342 Merge the Jobindex link-out: the Se jobbet link kept as posting_url (wp-d-jobindex)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:45:27 +02:00
WolfandClaude Opus 5.5 6085017943 Recheck a board's size from the Companies row, the route and app companies size
POST /api/sources/{id}/size sizes the board again, keeps the day and queues a pull; /api/companies returns size and size_checked, and the row shows "999 roles · checked 30 Sep" with Recheck beside Change. app companies size <key> does the same from the CLI, and --missing sizes every board without a size.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:44:54 +02:00
WolfandClaude Opus 5.5 a0882e9659 Size a board once with board_size, before a pull reads it with no size, and name what a site's ids leave out
set_board sizes a board from page 1's total, or reads to the end on a host that states none, instead of reading it whole up to page 100. A pull no longer rewrites ats:size; a board with none is handed the agents' reach marked unsized and is sized in its batch first, or by its whole read on a host that cannot narrow the reach. reach.sizes drops the open-role fallback. The Companies line names countries a Workday or Oracle site does not list and a missing remote option.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:43:52 +02:00
WolfandClaude Opus 5.5 802656aca4 Prune done work from the docs: fold the ingest review's open findings into open.md and delete it, cut the hosts wave-2 plan to what is unbuilt, drop the smaller-hosts survey
The plugins README no longer describes a run-time robots.txt check or boards that never close past the page cap.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:40:43 +02:00
WolfandClaude Opus 5.5 3e3060ba50 Link the obvious towns of the Unmapped list: 460 unlinked place texts down to 50
About 190 German towns (mostly 1KOMMA5°'s) and the German states, French,
Italian, Dutch, Asian and other towns, the ISO3 codes and German or French
country names boards write. Towns keep their marks through spelling groups.
The tests that used Paderborn, Jena and Überlingen as unknown towns use
Bopfingen, Lauchheim and Ellwangen instead. Left: names that are no place,
ambiguous ones (Halifax, Richmond, Victoria, Durham, Warwick) and bare codes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:34:27 +02:00
WolfandClaude Opus 5.5 b98561f64a Fetch a posting's text on demand, following a Jobindex ad to the posting itself
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:26:20 +02:00
WolfandClaude Opus 5.5 d168d9eb6c Add migration 26, roles.posting_url, kept across pulls and carried on the row and its copies
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 13:26:20 +02:00