Commit Graph
257 Commits
Author SHA1 Message Date
WolfandClaude Fable 5.1 bb8a9a3b8f Read robots.txt without case for a host that serves a path in any case, as Workday does
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 20:07:14 +02:00
WolfandClaude Sonnet 5.5 a41995da8e Read Jobylon's boards from the embed page and each role's page
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:06:16 +02:00
Wolf bd1ce44c6f Merge branch 'wp3-workday' 2026-09-29 20:05:34 +02:00
WolfandClaude Fable 5.1 bcbf5bb486 Let a host added after the eight keep a discovered slug's case
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 20:05:34 +02:00
WolfandClaude Sonnet 5.5 1fc9668110 Read Gem boards through the job board's GraphQL API
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:05:04 +02:00
WolfandClaude Sonnet 5.5 1282699ee5 Test the Workday host against trimmed listings, a fake tenant with the paging quirks, and the twelve career-site URLs
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:04:23 +02:00
WolfandClaude Sonnet 5.5 68a3858355 Read Deel's job boards from the page's server payload
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:02:49 +02:00
WolfandClaude Sonnet 5.5 76187d5862 Read BambooHR boards from their careers list and role pages
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:02:45 +02:00
WolfandClaude Sonnet 5.5 0b76b16daa Read Pinpoint boards from their postings.json
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 20:00:52 +02:00
Wolf a7bb6c20ae Merge branch 'main' into wp0-hosts 2026-09-29 19:49:00 +02:00
WolfandClaude Opus 5.5 0448a34ddb Type the fake host modules in the tests so mypy passes on them
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 19:47:09 +02:00
WolfandClaude Opus 5.5 4fb06191cf Load the host modules when the registry reads ats.py by path without the repo root on sys.path
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 19:44:03 +02:00
WolfandClaude Opus 5.5 7f04c10e9e Forget a replaced or detached board's robots.txt verdict and detail lists with its failure record
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 19:43:24 +02:00
WolfandClaude Opus 5.5 60136765b2 Refuse a fetch to another port than 443, an IP address or a local host name, at every hop
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 19:42:58 +02:00
WolfandClaude Opus 5.5 f61caddced Match a slug whole, and compare an allowed host name without case
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 19:42:10 +02:00
WolfandClaude Opus 5.5 0ffd0726e9 Read never-tried roles before failed ones in detail, count a 404 as read, and take only the fields a later pull keeps
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 19:41:39 +02:00
WolfandClaude Opus 5.5 1e47192aba Fail a board whose robots.txt cannot be read, and follow a robots.txt redirect to the host's www. twin only
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 19:40:14 +02:00
WolfandClaude Opus 5.5 13ce99304b Match robots.txt rules by RFC 9309, the longest rule winning, with wildcards, end anchors and case-sensitive paths
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 19:39:11 +02:00
WolfandClaude Opus 5.5 a9fb4397ac Order the hosts by a RANK per module, which restores the select's and the probes' order from before the modules
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 19:38:18 +02:00
WolfandClaude Opus 5.5 75a389d725 Keep a discovered slug's case for a host with KEEP_CASE, and check only group 1 against the hosts' own path words
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 19:37:26 +02:00
WolfandClaude Opus 5.5 fb83224007 Add, edit and remove a company on the Watchlist, and show its reason and note in the row
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 19:33:57 +02:00
WolfandClaude Fable 5.1 2c3bce99e3 Clear a company's by-hand reason when a board is attached to it
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 19:27:55 +02:00
WolfandClaude Sonnet 5.5 161e89c955 Sort the by-hand list by the Watchlist's careers_opened_at and print the watch rating
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 19:25:46 +02:00
Wolf 1a2689e08d Merge branch 'main' into wp1-byhand-api
# Conflicts:
#	app/models.py
#	app/storage/schema.py
#	app/storage/store.py
#	app/web/api.py
#	tests/test_storage.py
#	tests/test_web.py
2026-09-29 19:25:42 +02:00
Wolf 9cb35ae785 Merge branch 'main' into wp0-hosts 2026-09-29 19:21:59 +02:00
WolfandClaude Opus 5.5 a30b1ff09f Take discovery's readable hosts, patterns and probes from the host modules, and find Lever boards on its EU instance
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 17:07:34 +02:00
WolfandClaude Opus 5.5 8b14d8575b Read a role's own page once for a host with detail, and fail a board whose robots.txt disallows it
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 17:05:44 +02:00
WolfandClaude Opus 5.5 b02b72b4aa Move the eight hosts into a module each under plugins/atshosts and build the ats plugin's tables from them
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 17:03:37 +02:00
WolfandClaude Sonnet 5.5 28afc334c3 Add, edit, check and delete a company by hand through the API, and show the by-hand fields in the list
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 17:02:19 +02:00
WolfandClaude Sonnet 5.5 b3cb93d5aa Keep a typed careers link, seed the by-hand reason and add the by-hand commands to app companies
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 17:02:19 +02:00
WolfandClaude Sonnet 5.5 a466ea52b7 Give a company a by-hand reason and a date last checked, in migration 15
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 17:02:18 +02:00
WolfandClaude Fable 5.1 b998f4c270 Merge branch 'watchlist'
The search field on Roles takes the phone top bar while it is typed in,
since a third tab left it a few letters wide.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 17:00:42 +02:00
WolfandClaude Opus 5.5 51d2537d73 Search roles by company too, link the careers page in the reader, widen the list and reader
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 16:58:51 +02:00
WolfandClaude Sonnet 5.5 7dcb2c1705 Add a Watchlist tab for the companies the app cannot read a board of
Rate each one Yes or No apart from affinity, open its careers page with the
time noted, and set a missing or wrong link in the row. Migration 15 adds
companies.watch and careers_opened_at.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 16:56:16 +02:00
WolfandClaude Fable 5.1 4b722744a7 Show Viewing as on Roles as a select, also with one agent
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 16:40:33 +02:00
WolfandClaude Fable 5.1 0458c9c172 Take a Platsbanken region in the API and the CLI, and trust its and Teamtailor's posted date
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 16:23:19 +02:00
Wolf 7939b99a5c Merge branch 'wp4-prompts' 2026-09-29 16:22:26 +02:00
WolfandClaude Opus 5.5 2534803df3 Add app agents list and prompt, and document prompts for the seed agents
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 16:20:23 +02:00
WolfandClaude Opus 5.5 4e3c3f130e Give a search agent several prompts and score a role by its best one
Migration 14 moves each non-empty agents.intent into agent_prompts as one
prompt named after the agent, with its cached vector, and drops the three
intent columns. A role's fit is the maximum over the agent's prompts of the
calibrated cosine, and scores.prompt names the prompt that won. The agents
API takes prompts and still takes intent; the role endpoint serves the
agent's score and prompt.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 16:19:57 +02:00
WolfandClaude Fable 5.1 aabf2b4f1b Name an unreadable host in the two tests that used Teamtailor for one
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 16:15:55 +02:00
Wolf d887a91af0 Merge branch 'wp3-teamtailor' 2026-09-29 16:15:22 +02:00
WolfandClaude Sonnet 5.5 b2ab2a270d Discover Teamtailor boards as readable, own-domain sites by their host
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 16:14:41 +02:00
WolfandClaude Sonnet 5.5 50edf0eeeb Read Teamtailor career sites from their jobs.rss feed, paged by offset
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 16:14:41 +02:00
WolfandClaude Sonnet 5.5 00e111961e Add Platsbanken as a third search provider
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 16:10:45 +02:00
WolfandClaude Fable 5.1 92466e2cd4 Drop the retry around the queue's dedup race, fixed upstream
`_score_after_change` tried three times because `Jobs.enqueue` could re-raise an IntegrityError when the live job finished between its insert and its lookup. The queue now does both in one BEGIN IMMEDIATE transaction (boilerplate a1c6f0d), so the workaround and its test go.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 16:02:58 +02:00
WolfandClaude Sonnet 471ace703c Switch the extract and summarise stages on the page, over config.yaml
A stored `stage:extract` / `stage:summarise` in the state table overrides
extract.enabled / summarise.enabled; with none, the file applies. One
function, stages.stage_on, decides, and both tasks' finders ask it.
GET/PUT /api/stages and `app stages` show and set it with who would answer;
Runs has a "What the model reads" block, and a search agent's card says when
a stage is off and links to the switch.

Co-Authored-By: Claude Sonnet <noreply@anthropic.com>
2026-09-29 15:54:53 +02:00
Wolf a629eda8de Merge branch 'r2-web'
# Conflicts:
#	app/static/roles.js
#	app/web/api.py
#	tests/test_web.py
2026-09-29 15:31:35 +02:00
Wolf 562fa3ab09 Merge branch 'r2-backend'
# Conflicts:
#	app/storage/schema.py
2026-09-29 15:22:03 +02:00
WolfandClaude Sonnet 91596300e1 Serve a row projection from GET /api/roles instead of the whole role
The feed only ever shows a title, a few badges and a short excerpt,
but the list endpoint answered with every role's full row --
description, feed_text, raw and article_text included, about 5.5 KB
a role -- so a 1000-row restore was several megabytes of text a phone
never renders.

Store.roles_page selects only the fields a row draws (RoleRow), with
excerpt built server-side off a SUBSTR of summary or description, so
the big columns never cross into the response. The reader is
unaffected: it already fetched the whole role by uid when it opened
one; the reader pane's own reliance on the list row carrying the body
is removed too, so it no longer flashes a wrong "no description"
before that fetch lands.

Measured on a copy of the live database: a 60-row page went from
392 KiB to 39 KiB, and a 1000-row restore from 6.6 MB to 631 KiB.

Co-Authored-By: Claude Sonnet <noreply@anthropic.com>
2026-09-29 15:22:00 +02:00
WolfandClaude Opus b2c8c08f7f Judge an employer known only from a search; the Companies list says "from job boards"
Store.set_affinity creates a minimal company row (key, and the name its roles
give most often) for a key with roles and no row, so a Jobindex or Adzuna
employer can be hidden or liked; the reader draws the control for any role
with a company_key and reloads the company list after the first change.

/api/companies derives from_search: no ats subscription (detached included)
and no ats, careers_url or domain. companies.js labels it "from job boards"
and keeps it out of "Not readable yet".

Co-Authored-By: Claude Opus <noreply@anthropic.com>
2026-09-29 15:19:55 +02:00