The real run against the seeded 186 companies refused seven of the
largest boards outright, Anduril worst at 41 MB, because the cap and
requesting full descriptions pull against each other on exactly the
employers that post the most roles. Left as is for now; the fix is a
retry without content=true, tracked as an open decision.
Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
seed/companies.json: 179 companies from jobhunt-hq's seed.json (MIT),
reduced to key/name/board/careers_url, plus a hand-added DACH set.
`roledesk companies seed|add|check` import it, add one company from its
board with a live check first, and report dead boards.
roledesk/jobs/pull.py is now a pipeline task: ten boards per pull_batch job
on the http resource, upserting every role the ats plugin yields. Its final
job's settle closes every board this run answered in full and no longer
lists a role from, reading the plugin's own self.state stamps rather than
each batch job's return value, so one bad board in a batch does not cost the
other nine their closure. `roledesk job pull` runs it, and it registers
itself in pipeline.TASKS so <desk-jobs> can start it too.
Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
roledesk/storage/schema.py creates the tables at v1 with WAL and the
versioned-migration machinery from newsdesk; store.py adds upsert_role
(unpacks raw into gate columns, first_seen on insert, last_seen every
time), roles(), mark_closed, companies and subscriptions CRUD, and
save_application writing an append-only application_events row on every
status entered. Key helpers company_key, title_key, place_key live in
models.py. docs/decisions.md records the key decisions.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>