Runner: readers read from their declaration, ats and search thin over it

plugins/readers/_runner.py takes the guarded fetch, the listing (whole,
paged, one series per filter value unioned by id), completeness from READS,
the sweep of a board over the page cap across pulls, the 10% guard on a
filtered or empty="suspect" read, facets kept a day, the detail reads, the
raw an Item carries and the failure bookkeeping out of plugins/ats.py.
Ask comes from a subscription's params (ask_for, open for the reach), with
a declared key resolved into Ask.params["key"] and refused when missing.

The runtime robots.txt check goes (decided at build time, READS.robots).
plugins/search.py reads the providers of readers.PROVIDERS through the
runner and applies the saved pages param. A filtered board's close keeps
roles with a vote or an application. DETAIL_FIELDS gain places, teaser,
country and employment.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
WolfandClaude Opus 5.5 committed 2026-09-30 09:28:33 +02:00
1 parent 779b136757
commit 902089a5e2
14 files changed
+1608 -1492

No files matched your search

-13
View File
@@ -155,19 +155,6 @@ def test_an_empty_board_is_complete_and_a_401_is_a_failure(web: dict[str, Any])
ats._fetch_rows(client, "hibob:liquidia")
def test_the_robots_txt_that_is_the_apps_own_page_allows(web: dict[str, Any]) -> None:
"""The host answers /robots.txt with its single-page app's HTML, a 200
with no rules."""
web["answers"]["https://dixa.careers.hibob.com/robots.txt"] = \
b'<!DOCTYPE html><html><head><title>Careers</title></head><body></body></html>'
with httpx.Client() as client:
ats._check_robots(client, "hibob:dixa")
web["answers"]["https://dixa.careers.hibob.com/robots.txt"] = \
b"User-agent: *\nDisallow: /\n"
with pytest.raises(ats._Disallowed):
ats._check_robots(client, "hibob:dixa")
# ------------------------------------------------------- slugs and hosts
def test_the_module_is_registered_as_a_paged_host() -> None: