Require READS, search params and a dated robots record; record robots.txt per requested path

Every reader declares, so undeclared(), the scope() fallback, robots_page and
ROBOTS_ANY_CASE go. A search provider needs PARAMS and clean_params, a row may
carry company, places gains none. Each robots record names the paths the
reader requests, from robots.txt read again on 2026-09-30. Platsbanken states
remote, HR Manager states no place.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
WolfandClaude Fable 5.1 committed 2026-09-30 15:51:13 +02:00
1 parent 4e827665dd
commit 2349fc424b
46 files changed
+323 -100

No files matched your search

+1 -2
View File
@@ -210,5 +210,4 @@ def test_it_declares_a_paged_read_of_ten_with_a_total_and_one_country_a_request(
"paged", 10, "detail", "stated", "many")
assert reads.filters.declared() == {"country": "one", "query": "one"}
assert reads.fields.posted == "listed"
assert reads.robots.startswith("read: robots.txt allows /careers")
assert not hasattr(eightfold, "robots_page")
assert "/api/pcsx/search" in reads.robots and "/api/pcsx/position_details" in reads.robots