From 078fb8ff8faf68208b1ff1d1c1532bbf4ea57cdb Mon Sep 17 00:00:00 2001 From: Wolf Date: Wed, 23 Sep 2026 11:31:08 +0200 Subject: [PATCH] Note the 8 MB cap vs content=true trade-off found in the real pull The real run against the seeded 186 companies refused seven of the largest boards outright, Anduril worst at 41 MB, because the cap and requesting full descriptions pull against each other on exactly the employers that post the most roles. Left as is for now; the fix is a retry without content=true, tracked as an open decision. Co-Authored-By: Claude Sonnet 5 --- docs/decisions.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/decisions.md b/docs/decisions.md index 0de6807..e1aa757 100644 --- a/docs/decisions.md +++ b/docs/decisions.md @@ -36,6 +36,8 @@ What was decided for roledesk and the one reason for each. The longer reasoning **SmartRecruiters' board list has no description.** Its `/postings` endpoint gives title, location and department but not the job text; that is only on the per-posting detail endpoint, and fetching one extra request per role would multiply a board's request count by however many roles it lists. `description` stays empty for this host; title, location, department and the derived `function` are still filled. +**The 8 MB cap and `?content=true` fight each other on the largest boards, and the cap won.** Both are named in the plan — the cap from openings.go, `content=true` so Greenhouse ships the description inline — but jobhunt-hq's own feeds never asked for content, so it never hit the size this combination produces. The real run (2026-09-23) refused seven boards outright for it: Anduril at 41 MB, and Anthropic, OpenAI, Databricks, Carvana, Axon and Airwallex between 9 and 19 MB, each because the biggest employers publish the most roles with the longest descriptions. Left as is, because raising the cap only moves the line and a company that big is exactly the case `openings.go`'s cap was written against; a real fix — retry without `content=true` when the capped response is refused, trading the description for at least the listing — is a follow-up, not a guess made here. + **Workable's shape is confirmed, not a populated example.** Every slug tried against `apply.workable.com/api/v3/accounts/{slug}/jobs` during this build returned the documented `{"total": 0, "results": []}` before Cloudflare rate-limited further requests from this session, so the parser is written from Workable's long-published job object rather than from a fetched row. Worth a fixture-level recheck against a live board with open roles the next time this plugin is touched. ## Ranking