Runner: readers read from their declaration, ats and search thin over it
plugins/readers/_runner.py takes the guarded fetch, the listing (whole, paged, one series per filter value unioned by id), completeness from READS, the sweep of a board over the page cap across pulls, the 10% guard on a filtered or empty="suspect" read, facets kept a day, the detail reads, the raw an Item carries and the failure bookkeeping out of plugins/ats.py. Ask comes from a subscription's params (ask_for, open for the reach), with a declared key resolved into Ask.params["key"] and refused when missing. The runtime robots.txt check goes (decided at build time, READS.robots). plugins/search.py reads the providers of readers.PROVIDERS through the runner and applies the saved pages param. A filtered board's close keeps roles with a vote or an application. DETAIL_FIELDS gain places, teaser, country and employment. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
779b136757
commit
902089a5e2
14 files changed
+1608
-1492
No files matched your search
@@ -155,19 +155,6 @@ def test_an_empty_board_is_complete_and_a_401_is_a_failure(web: dict[str, Any])
|
||||
ats._fetch_rows(client, "hibob:liquidia")
|
||||
|
||||
|
||||
def test_the_robots_txt_that_is_the_apps_own_page_allows(web: dict[str, Any]) -> None:
|
||||
"""The host answers /robots.txt with its single-page app's HTML, a 200
|
||||
with no rules."""
|
||||
web["answers"]["https://dixa.careers.hibob.com/robots.txt"] = \
|
||||
b'<!DOCTYPE html><html><head><title>Careers</title></head><body></body></html>'
|
||||
with httpx.Client() as client:
|
||||
ats._check_robots(client, "hibob:dixa")
|
||||
web["answers"]["https://dixa.careers.hibob.com/robots.txt"] = \
|
||||
b"User-agent: *\nDisallow: /\n"
|
||||
with pytest.raises(ats._Disallowed):
|
||||
ats._check_robots(client, "hibob:dixa")
|
||||
|
||||
|
||||
# ------------------------------------------------------- slugs and hosts
|
||||
|
||||
def test_the_module_is_registered_as_a_paged_host() -> None:
|
||||
|
||||
Reference in new issue
Block a user