Require READS, search params and a dated robots record; record robots.txt per requested path
Every reader declares, so undeclared(), the scope() fallback, robots_page and ROBOTS_ANY_CASE go. A search provider needs PARAMS and clean_params, a row may carry company, places gains none. Each robots record names the paths the reader requests, from robots.txt read again on 2026-09-30. Platsbanken states remote, HR Manager states no place. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
1 parent
4e827665dd
commit
2349fc424b
46 files changed
+323
-100
No files matched your search
@@ -116,7 +116,6 @@ def test_the_board_is_read_through_the_app_and_is_complete() -> None:
|
||||
def test_the_slug_the_urls_and_the_allow_list() -> None:
|
||||
assert pinpoint.slug_ok("xeneta") and pinpoint.slug_ok("Xeneta") and pinpoint.slug_ok("a-b1")
|
||||
assert pinpoint.careers_url("xeneta") == "https://xeneta.pinpointhq.com/"
|
||||
assert not hasattr(pinpoint, "robots_page") # decided when built, see READS.robots
|
||||
assert pinpoint.feed_url("Xeneta") == "https://xeneta.pinpointhq.com/postings.json"
|
||||
allow = pinpoint.allowed("Xeneta")
|
||||
assert allow("xeneta.pinpointhq.com") and allow("XENETA.pinpointhq.com")
|
||||
|
||||
Reference in new issue
Block a user