Commit Graph
253 Commits
Author SHA1 Message Date
WolfandClaude Opus 5.5 3adafd8950 Read date trust only from the readers' declarations, now that every reader declares
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 09:39:07 +02:00
WolfandClaude Opus 5.5 5f0f4ad5b7 Merge branch 'wp-e1-places'
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 09:33:07 +02:00
WolfandClaude Opus 5.5 7f5530f35e Import Ask after the path set-up in the reader tests, so the file runs on its own
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 09:33:06 +02:00
WolfandClaude Opus 5.5 1d7b286374 Merge branch 'wp-d1-hosts'
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 09:32:46 +02:00
WolfandClaude Opus 5.5 bbd7522163 Places as a gazetteer, role_places, teaser and three seniority sources
Migration 19 adds places, place_aliases, place_includes (seeded from the
dictionaries in app/models.py and app/places.py, Europe as a continent over
the European countries) and role_places, one row per place of a role,
resolved by app.places.Gazetteer, NULL when unknown. upsert_role writes them
from raw["places"], else the place line cut at ";"; the migration builds them
from each role's place column.

The Place filter and the country and place gates are joins over the tree:
country:DK is any place under Denmark, region:skane any town in Skane, a
country gate is met by any place in its countries, and the EU fallback of
the word matcher is no longer used. A place: token the gazetteer does not
know still matches whole words. Store gains gazetteer, role_places,
unresolved_places, add_place_alias, add_place and relink_places.

roles.teaser is kept-filled and embedded while there is no description; a
vector is dropped when a better text arrives. seniority_model, _stated and
_title sit behind roles.seniority, which stays the first filled of them.

TRUSTED_POSTED_HOSTS gives way to trusted_posted(host), which reads
READS.fields.posted and falls back to the old set for undeclared readers.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 09:31:45 +02:00
WolfandClaude Opus 5.5 902089a5e2 Runner: readers read from their declaration, ats and search thin over it
plugins/readers/_runner.py takes the guarded fetch, the listing (whole,
paged, one series per filter value unioned by id), completeness from READS,
the sweep of a board over the page cap across pulls, the 10% guard on a
filtered or empty="suspect" read, facets kept a day, the detail reads, the
raw an Item carries and the failure bookkeeping out of plugins/ats.py.
Ask comes from a subscription's params (ask_for, open for the reach), with
a declared key resolved into Ask.params["key"] and refused when missing.

The runtime robots.txt check goes (decided at build time, READS.robots).
plugins/search.py reads the providers of readers.PROVIDERS through the
runner and applies the saved pages param. A filtered board's close keeps
roles with a vote or an application. DETAIL_FIELDS gain places, teaser,
country and employment.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 09:28:33 +02:00
WolfandClaude Opus 5.5 dec5fd5009 Merge branch 'wp-d2-hosts'
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 09:14:55 +02:00
WolfandClaude Opus 5.5 4316624769 Declare READS for Oracle, Personio, Phenom, Pinpoint, Recruitee, Rippling, SmartRecruiters, SuccessFactors, Teamtailor, Workable and Workday
Every row carries places (Personio additionalOffices, Workable and Recruitee
locations[], every SuccessFactors address, Workday's own read), the list
teaser of Phenom and Oracle is kept in teaser, and the level, employment and
country a host states are mapped. Workday "N Locations" and "Country - City",
and Recruitee "Remote job", are no longer places. Phenom takes dateCreated
as posted. robots_page and ROBOTS_ANY_CASE go; READS.robots records the
decision. Signatures are feed_url(slug, ask) and page(get, slug, cursor, ask),
with an empty Ask as the default so the runner of today still calls them.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 09:14:27 +02:00
WolfandClaude Opus 5.5 f2e652a8da Hosts a to l declare READS: places, teaser, stated seniority and employment
Ashby, BambooHR, Deel, Eightfold, Gem, Greenhouse, HiBob, HR Manager, Jibe,
Jobylon and Lever move to feed_url(slug, ask) and page(get, slug, cursor, ask),
declare READS with the robots decision, and drop robots_page. Rows carry
places (Ashby secondaryLocations, Lever allLocations, Greenhouse offices in
place of a Hybrid placeholder), Jobylon keeps its summary as teaser and maps
experience and employment, Eightfold reads creationTs as the posting date and
Ashby reads workplaceType. Fixtures <name>-places.* and jobylon-teaser.html
drive the conformance checks; the eleven names leave UNDECLARED.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 09:11:53 +02:00
WolfandClaude Opus 5.5 b78c9dfc67 Search providers as reader modules: jobindex, adzuna, platsbanken
Each declares READS with scope=search, keeps every place and hands the excerpt over as teaser. search_params and PROVIDERS follow the declarations.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 09:08:25 +02:00
WolfandClaude Opus 5.5 9f526356c0 Reader contract: READS declaration, Ask, Row with places and teaser, conformance test
plugins/readers/_contract.py holds Reads, Filters, Fields, Key, Ask, Place and
Row, and problems(), which checks a module's READS against its functions and
signatures. The package loader runs it for modules that declare READS and
lists the others with undeclared(); READERS holds every module, HOSTS the
boards and the undeclared, PROVIDERS the searches. The package docstring
documents the traits, Ask, facets, places, teaser and the robots.txt rule.

tests/test_readers_contract.py runs over every reader: READS declared (xfail
per module in UNDECLARED), declaration against functions, places="many"
and teaser fixtures, plus unit tests of the check with fake modules.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 08:55:47 +02:00
WolfandClaude Opus 5.5 73dec9028e Rename plugins/atshosts to plugins/readers
Every import, test and live doc follows the new path; behaviour is unchanged.
tests/test_atshosts.py becomes tests/test_readers.py. plan-readers.md and
review-ingest.md keep the old name, since they describe the state before.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 08:48:30 +02:00
WolfandClaude Opus 5.5 82b7902eff Regroup copies when a board or search is switched off, and fold the duplicates plan into the decisions
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 23:11:33 +02:00
WolfandClaude Opus 5.5 545c932f7b Store copies of one posting as roles.dup_of and leave them out of the feed, the counts and the model stages
Migration 18 adds roles.dup_of with a partial index and runs the first rebuild. Store.rebuild_dupes feeds app.dupes.assign the open roles of every (company_key, title_key) with more than one, rewrites dup_of where it changed, clears it on closed roles, and hands read_at and votes to a changed group's kept role. The pull's settle and `app dupes` run it. RoleRow.copies counts a row's open copies; Role.copies lists them and Role.dup_of names a copy's kept role.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 23:09:20 +02:00
WolfandClaude Fable 5.1 31abad4c8e Embed a role again when its text arrives, and keep the place its own page gave
A role listed before its page was read kept a title-only vector, and the listing's place replaced the page's on every later pull.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 22:23:43 +02:00
Wolf fd89381caa Merge branch 'wp-e-api' 2026-09-29 22:17:52 +02:00
WolfandClaude a91b4e99e0 Filter the feed by company keys, place tokens and seniority, and suggest companies and places
Migration 17 adds roles.place_fold and fills seniority from the title where extract has not read the role. Every connection registers place_match, so the Place filter and the place gate match whole folded words: Lund no longer finds Billund. GET /api/roles takes company_keys, places, seniority, seniority_unknown and pay_unknown; new routes suggest companies and places, label place tokens and count the seniority and pay facets.

Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-29 22:17:12 +02:00
WolfandClaude Opus 5.5 b09a2f6b33 Group copies only when they all match, compare towns through places.towns, and record the rule in the plan
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 22:12:39 +02:00
Wolf fdb6264c98 Merge main into wp-h-dupes 2026-09-29 22:07:34 +02:00
WolfandClaude Opus 5.5 1e22537ae5 Let a role that names no town join one group, never bridge two, and place dupes above places
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 22:07:05 +02:00
WolfandClaude Sonnet 5.5 d060bee5b7 Add the rule that decides which open roles are one posting
Pure module app/dupes.py: towns, same_posting, keep_order and assign, with
tests on the live cross-host pairs, the SAP requisitions and the edge cases.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 22:06:08 +02:00
Wolf 4b9403a0b9 Merge branch 'wp-a-places' 2026-09-29 22:04:50 +02:00
WolfandClaude 1898f2a8a6 Match places with a registered SQL function, suggest regions on their own names, fold lines that hold a town into it
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-29 22:04:21 +02:00
Wolf 4877459911 Merge branch 'wp-b-seniority' 2026-09-29 22:02:30 +02:00
WolfandClaude Fable 5.1 4ca362ef83 Let storage import places and seniority, two layers above the models
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 22:01:44 +02:00
WolfandClaude d7fa9527b4 Read a seniority level from the title
from_title folds the title and matches whole words in English, Danish,
Swedish, German, French, Dutch and Spanish, highest level first, with intern
tried before the rest. Individual-contributor managers (Account, Product,
Project ...) stay unknown; a manager is a level only where the word means a
team, a site or a shop.

Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-29 22:01:37 +02:00
Wolf 7a282a181d Merge branch 'wp-d-chips' 2026-09-29 22:01:07 +02:00
WolfandClaude bd7b20a0a8 Add the chip input for the rail's Company and Place fields
window.chipInput(root, {suggest, onChange, placeholder, label}) to the
contract in docs/plan-feed-filters.md: a combobox whose picks become
chips, suggest debounced and late answers dropped, Enter before the
answer picks its first, Escape that shuts the list stops there. Not
wired into the page yet; package G does that.

Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-29 21:58:34 +02:00
WolfandClaude ebb1f560de Add places: folded whole-word place matching, country, region and town tokens, suggestions
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-29 21:58:32 +02:00
WolfandClaude 3ab8035d0d Gate a favourite by the require gates and drop its 0.9 floor
A favourite company skips the any group only; a require gate it fails
gates it with the usual reason. Its score is the weighted sum with the
affinity term at 1, and weights that sum to 0 give "no weights" as for
every other company.

Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-29 21:52:26 +02:00
Wolf c7c5aebdb6 Merge branch 'wp7-small-hosts' 2026-09-29 20:15:47 +02:00
Wolf f38da929c9 Merge branch 'wp4-successfactors' 2026-09-29 20:15:47 +02:00
WolfandClaude Sonnet 5.5 d80754e985 Read HR Manager's public position feed by skip and take
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:13:23 +02:00
Wolf c18c93a55e Merge branch 'wp5-oracle-phenom' 2026-09-29 20:13:16 +02:00
Wolf 0eff7c9d13 Merge branch 'wp6-json-hosts' 2026-09-29 20:12:28 +02:00
WolfandClaude Sonnet 5.5 679d9ec938 Let discovery find a SuccessFactors board from a role, landing or search link
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:12:13 +02:00
WolfandClaude Sonnet 5.5 85bfe62fec Read Eightfold career sites through the PCSX search
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:11:18 +02:00
WolfandClaude Sonnet 5.5 cf182ad921 Read a Phenom role's description from the page state when the page has no JobPosting, and fail a page with neither
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:10:52 +02:00
WolfandClaude Sonnet 5.5 27a7723a1d Read HiBob's careers boards through the company header the site sends
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:10:37 +02:00
WolfandClaude Sonnet 5.5 9d915ab09a Test the SuccessFactors host against saved table, tile and job pages
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:10:11 +02:00
WolfandClaude Sonnet 5.5 8f0db38393 Test the Phenom host against saved King and Philips answers
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:09:08 +02:00
WolfandClaude Sonnet 5.5 8ee6f9b546 Read Phenom career sites through their search widget, with the description from each role page's JSON-LD
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:09:08 +02:00
WolfandClaude Sonnet 5.5 eac483ff13 Read Rippling's boards, merging a role's places, and its pay and description from the role's record
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:08:37 +02:00
WolfandClaude Sonnet 5.5 bd4121be91 Read Jibe career sites from their jobs API
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:08:35 +02:00
WolfandClaude Sonnet 5.5 2b1dc08714 Test the Oracle host against saved Nokia and Milestone answers
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:07:56 +02:00
WolfandClaude Sonnet 5.5 34d1f74e3a Read Oracle Recruiting Cloud boards from the REST listing, with the description from the role's own resource
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:07:56 +02:00
WolfandClaude Fable 5.1 bb8a9a3b8f Read robots.txt without case for a host that serves a path in any case, as Workday does
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 20:07:14 +02:00
WolfandClaude Sonnet 5.5 a41995da8e Read Jobylon's boards from the embed page and each role's page
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:06:16 +02:00
Wolf bd1ce44c6f Merge branch 'wp3-workday' 2026-09-29 20:05:34 +02:00
WolfandClaude Fable 5.1 bcbf5bb486 Let a host added after the eight keep a discovered slug's case
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 20:05:34 +02:00