The seed was jobhunt-hq's 186 US boards, chosen because they could be read. It is now a hand-picked list of European tech employers, with `board` filled by the new `app.jobs.discover` from each company's own careers site and every board fetched once before it landed: 175 have one, and the rest keep the ATS host their site runs on (Teamtailor 32, Workday 12, SuccessFactors 9, ...) and a careers URL, as rows the app cannot read yet. Companies shows them as "not readable yet" with a link, behind a filter, so the next parser to write is the host that filter shows most. `app companies discover NAME DOMAIN [--add]` reads the home page, its careers links and the usual paths for a link into a known host, one level down on a careers page, and probes Greenhouse, Lever, Ashby, SmartRecruiters, Recruitee and Personio by slug when the pages link nothing. It is what the LinkedIn flow will call. Migration 7 adds companies.ats, country and city. The Workable parser now reads the v3 shape its list endpoint actually sends (location object, department list, shortcode and no URL or text); the first populated board showed it. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
41 lines
1.8 KiB
Python
41 lines
1.8 KiB
Python
"""The work roledesk queues. Importing this package registers every job, every
|
|
task in `pipeline.TASKS` and the default schedule in `pipeline.SCHEDULES`.
|
|
|
|
pull.py read every board and search and store the roles they yield
|
|
extract.py title and description into the gate columns, on Haiku
|
|
embed.py one vector per open role, for fit
|
|
score.py every open role scored for every enabled search agent
|
|
summarise.py about 60 words on each of the best roles, on Haiku
|
|
cascade.py pull → extract → embed → score → summarise, what `TASKS`
|
|
offers, the `pull` job a schedule fires, and that schedule
|
|
sources.py what a pull reads, changed by hand: boards and searches
|
|
added, switched on or off, pruned by region
|
|
discover.py which ATS a company's careers site runs on, from its pages
|
|
"""
|
|
|
|
from __future__ import annotations
|
|
|
|
from typing import Any
|
|
|
|
from app.jobs import cascade, discover, embed, extract, pull, score, sources, summarise
|
|
from app.jobs.pull import search_target, seed_searches
|
|
from app.jobs.score import seed_agents
|
|
|
|
#: What `JobQueue(bootstrap=...)` and `pipeline.worker --bootstrap` are given.
|
|
BOOTSTRAP = "app.jobs:bootstrap"
|
|
|
|
|
|
def bootstrap(config_path: str = "") -> tuple[Any, Any]:
|
|
"""`(config, store)` from the config file alone, for a job run in its own
|
|
process or by `python -m pipeline.worker`. Importing this module is what
|
|
fills `JOBS`, which is why the worker is handed a name rather than a queue."""
|
|
from app import config as config_mod
|
|
from app.storage import Store
|
|
|
|
config = config_mod.load(config_path or None)
|
|
return config, Store(config.database)
|
|
|
|
|
|
__all__ = ["BOOTSTRAP", "bootstrap", "cascade", "discover", "embed", "extract", "pull",
|
|
"score", "search_target", "seed_agents", "seed_searches", "sources", "summarise"]
|