A European seed of 362 employers, readable or not; discover finds a company's board from its site

The seed was jobhunt-hq's 186 US boards, chosen because they could be read. It is now a hand-picked list of European tech employers, with `board` filled by the new `app.jobs.discover` from each company's own careers site and every board fetched once before it landed: 175 have one, and the rest keep the ATS host their site runs on (Teamtailor 32, Workday 12, SuccessFactors 9, ...) and a careers URL, as rows the app cannot read yet. Companies shows them as "not readable yet" with a link, behind a filter, so the next parser to write is the host that filter shows most.

`app companies discover NAME DOMAIN [--add]` reads the home page, its careers links and the usual paths for a link into a known host, one level down on a careers page, and probes Greenhouse, Lever, Ashby, SmartRecruiters, Recruitee and Personio by slug when the pages link nothing. It is what the LinkedIn flow will call.

Migration 7 adds companies.ats, country and city. The Workable parser now reads the v3 shape its list endpoint actually sends (location object, department list, shortcode and no URL or text); the first populated board showed it.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
WolfandClaude Fable 5.1 committed 2026-09-28 15:27:14 +02:00
1 parent c4f2bcc0c9
commit 51d1e67ff9
19 files changed
+3362 -1394

No files matched your search

+25 -19
View File
@@ -11,7 +11,8 @@ The field map, the redirect allow-list and the 10 s timeout are ported from
`classify`'s nine functions and their keywords. Workable, SmartRecruiters,
Recruitee and Personio are new: jobhunt-hq only read Greenhouse, Lever and
Ashby, so those four are written from one real board of each host, fetched
while this file was written (2026-09-23), rather than from the Go source.
while this file was written (2026-09-23; Workable on 2026-09-28, when the
first board with roles was seen), rather than from the Go source.
The body cap is not a straight port — see `MAX_BYTES` below.
@@ -256,31 +257,36 @@ def _parse_ashby(body: bytes) -> list[Row]:
return rows
def _parse_workable(body: bytes) -> list[Row]:
"""https://apply.workable.com/api/v3/accounts/{slug}/jobs (POST, empty
JSON body) -> `{"total": int, "results": [...]}`. The shape is confirmed
live (2026-09-23); the fields are Workable's long-documented job object,
since every slug this session tried on it happened to list nothing at
the moment of fetching — see the plugin's docstring and the build report."""
def _parse_workable(body: bytes, slug: str) -> list[Row]:
"""POST https://apply.workable.com/api/v3/accounts/{slug}/jobs with `{}` ->
`{"total": int, "results": [...]}`, as Hugging Face's board answered on
2026-09-28. A result carries no URL and no text: the job page is
`https://apply.workable.com/{slug}/j/{shortcode}/`, and the description
is only on the per-job endpoint, one request per role, so `description`
stays empty here as it does for SmartRecruiters. `location` is an object
and `department` a list; `remote` is a flag beside `workplace`
(remote, hybrid, on_site)."""
data = json.loads(body)
rows = []
for j in data.get("results") or []:
title = (j.get("title") or "").strip()
url = (j.get("url") or j.get("shortlink") or j.get("application_url") or "").strip()
if not title or not _is_web_url(url):
shortcode = (j.get("shortcode") or "").strip()
if not title or not shortcode:
continue
location = ", ".join(p for p in (j.get("city"), j.get("region"), j.get("country")) if p)
description = " ".join(p for p in (
j.get("description"), j.get("requirements"), j.get("benefits")) if p)
loc = j.get("location") or {}
location = ", ".join(p for p in (loc.get("city"), loc.get("region"), loc.get("country")) if p)
dept = j.get("department") or ""
if isinstance(dept, list):
dept = ", ".join(d for d in dept if d)
rows.append({
"source_id": str(j.get("id") or j.get("shortcode") or ""),
"source_id": str(j.get("id") or shortcode),
"title": title,
"location": location,
"url": url,
"posted": _parse_dt(j.get("published_on") or j.get("created_at")),
"department": (j.get("department") or "").strip(),
"description": strip_html(description),
"remote": j.get("telecommute"),
"url": f"https://apply.workable.com/{slug}/j/{shortcode}/",
"posted": _parse_dt(j.get("published")),
"department": dept.strip(),
"description": "",
"remote": bool(j.get("remote")) or j.get("workplace") == "remote",
"salary": "",
})
return rows
@@ -375,7 +381,7 @@ _PARSERS: dict[str, Callable[..., list[Row]]] = {
"greenhouse": lambda body, slug: _parse_greenhouse(body),
"lever": lambda body, slug: _parse_lever(body),
"ashby": lambda body, slug: _parse_ashby(body),
"workable": lambda body, slug: _parse_workable(body),
"workable": _parse_workable,
"smartrecruiters": _parse_smartrecruiters,
"recruitee": lambda body, slug: _parse_recruitee(body),
"personio": _parse_personio,