Require READS, search params and a dated robots record; record robots.txt per requested path
Every reader declares, so undeclared(), the scope() fallback, robots_page and ROBOTS_ANY_CASE go. A search provider needs PARAMS and clean_params, a row may carry company, places gains none. Each robots record names the paths the reader requests, from robots.txt read again on 2026-09-30. Platsbanken states remote, HR Manager states no place. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
1 parent
4e827665dd
commit
2349fc424b
46 files changed
+323
-100
No files matched your search
@@ -446,10 +446,10 @@ def test_the_case_of_the_site_is_kept() -> None:
|
||||
assert "workday" in ats.HOSTS and ats.HOSTS["workday"] == "Workday"
|
||||
|
||||
|
||||
def test_the_runtime_robots_check_has_left_the_module() -> None:
|
||||
"""Decided when the reader was built (`READS.robots`): nothing to ask now."""
|
||||
assert not hasattr(workday, "robots_page") and not hasattr(workday, "ROBOTS_ANY_CASE")
|
||||
assert "robots.txt allows /<Site>/" in workday.READS.robots
|
||||
def test_the_robots_record_names_the_api_path() -> None:
|
||||
"""Decided when the reader was built (`READS.robots`), for the paths it
|
||||
requests, not only the career site's."""
|
||||
assert "/wday/cxs/<tenant>/<site>/" in workday.READS.robots
|
||||
|
||||
|
||||
# -------------------------------------------------------------- discovery
|
||||
|
||||
Reference in new issue
Block a user