A European seed of 362 employers, readable or not; discover finds a company's board from its site
The seed was jobhunt-hq's 186 US boards, chosen because they could be read. It is now a hand-picked list of European tech employers, with `board` filled by the new `app.jobs.discover` from each company's own careers site and every board fetched once before it landed: 175 have one, and the rest keep the ATS host their site runs on (Teamtailor 32, Workday 12, SuccessFactors 9, ...) and a careers URL, as rows the app cannot read yet. Companies shows them as "not readable yet" with a link, behind a filter, so the next parser to write is the host that filter shows most. `app companies discover NAME DOMAIN [--add]` reads the home page, its careers links and the usual paths for a link into a known host, one level down on a careers page, and probes Greenhouse, Lever, Ashby, SmartRecruiters, Recruitee and Personio by slug when the pages link nothing. It is what the LinkedIn flow will call. Migration 7 adds companies.ats, country and city. The Workable parser now reads the v3 shape its list endpoint actually sends (location object, department list, shortcode and no URL or text); the first populated board showed it. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
1 parent
c4f2bcc0c9
commit
51d1e67ff9
19 files changed
+3362
-1394
No files matched your search
+25
-19
@@ -11,7 +11,8 @@ The field map, the redirect allow-list and the 10 s timeout are ported from
|
||||
`classify`'s nine functions and their keywords. Workable, SmartRecruiters,
|
||||
Recruitee and Personio are new: jobhunt-hq only read Greenhouse, Lever and
|
||||
Ashby, so those four are written from one real board of each host, fetched
|
||||
while this file was written (2026-09-23), rather than from the Go source.
|
||||
while this file was written (2026-09-23; Workable on 2026-09-28, when the
|
||||
first board with roles was seen), rather than from the Go source.
|
||||
|
||||
The body cap is not a straight port — see `MAX_BYTES` below.
|
||||
|
||||
@@ -256,31 +257,36 @@ def _parse_ashby(body: bytes) -> list[Row]:
|
||||
return rows
|
||||
|
||||
|
||||
def _parse_workable(body: bytes) -> list[Row]:
|
||||
"""https://apply.workable.com/api/v3/accounts/{slug}/jobs (POST, empty
|
||||
JSON body) -> `{"total": int, "results": [...]}`. The shape is confirmed
|
||||
live (2026-09-23); the fields are Workable's long-documented job object,
|
||||
since every slug this session tried on it happened to list nothing at
|
||||
the moment of fetching — see the plugin's docstring and the build report."""
|
||||
def _parse_workable(body: bytes, slug: str) -> list[Row]:
|
||||
"""POST https://apply.workable.com/api/v3/accounts/{slug}/jobs with `{}` ->
|
||||
`{"total": int, "results": [...]}`, as Hugging Face's board answered on
|
||||
2026-09-28. A result carries no URL and no text: the job page is
|
||||
`https://apply.workable.com/{slug}/j/{shortcode}/`, and the description
|
||||
is only on the per-job endpoint, one request per role, so `description`
|
||||
stays empty here as it does for SmartRecruiters. `location` is an object
|
||||
and `department` a list; `remote` is a flag beside `workplace`
|
||||
(remote, hybrid, on_site)."""
|
||||
data = json.loads(body)
|
||||
rows = []
|
||||
for j in data.get("results") or []:
|
||||
title = (j.get("title") or "").strip()
|
||||
url = (j.get("url") or j.get("shortlink") or j.get("application_url") or "").strip()
|
||||
if not title or not _is_web_url(url):
|
||||
shortcode = (j.get("shortcode") or "").strip()
|
||||
if not title or not shortcode:
|
||||
continue
|
||||
location = ", ".join(p for p in (j.get("city"), j.get("region"), j.get("country")) if p)
|
||||
description = " ".join(p for p in (
|
||||
j.get("description"), j.get("requirements"), j.get("benefits")) if p)
|
||||
loc = j.get("location") or {}
|
||||
location = ", ".join(p for p in (loc.get("city"), loc.get("region"), loc.get("country")) if p)
|
||||
dept = j.get("department") or ""
|
||||
if isinstance(dept, list):
|
||||
dept = ", ".join(d for d in dept if d)
|
||||
rows.append({
|
||||
"source_id": str(j.get("id") or j.get("shortcode") or ""),
|
||||
"source_id": str(j.get("id") or shortcode),
|
||||
"title": title,
|
||||
"location": location,
|
||||
"url": url,
|
||||
"posted": _parse_dt(j.get("published_on") or j.get("created_at")),
|
||||
"department": (j.get("department") or "").strip(),
|
||||
"description": strip_html(description),
|
||||
"remote": j.get("telecommute"),
|
||||
"url": f"https://apply.workable.com/{slug}/j/{shortcode}/",
|
||||
"posted": _parse_dt(j.get("published")),
|
||||
"department": dept.strip(),
|
||||
"description": "",
|
||||
"remote": bool(j.get("remote")) or j.get("workplace") == "remote",
|
||||
"salary": "",
|
||||
})
|
||||
return rows
|
||||
@@ -375,7 +381,7 @@ _PARSERS: dict[str, Callable[..., list[Row]]] = {
|
||||
"greenhouse": lambda body, slug: _parse_greenhouse(body),
|
||||
"lever": lambda body, slug: _parse_lever(body),
|
||||
"ashby": lambda body, slug: _parse_ashby(body),
|
||||
"workable": lambda body, slug: _parse_workable(body),
|
||||
"workable": _parse_workable,
|
||||
"smartrecruiters": _parse_smartrecruiters,
|
||||
"recruitee": lambda body, slug: _parse_recruitee(body),
|
||||
"personio": _parse_personio,
|
||||
|
||||
Reference in new issue
Block a user