9.5 KiB
9.5 KiB
Open
What is known and not yet fixed, checked against the code on 2026-09-30. What landed is in decisions.md; the unbuilt readers are planned in plan-hosts-wave-2.md.
Text
- A hand-fetched posting is not embedded or extracted. "Fetch the posting" stores
article_text, which onlysummarisereads.embedandextractreaddescription or teaser, so a Jobindex role keeps being ranked on its teaser. The fix is one text rule,article_text or description or teaser, in embed and extract, and queuing embed and score after a fetch. - An edited posting is never embedded again. The vector is dropped only when the text ranks better than before (a title-only role gaining a teaser, or a teaser replaced by a description). A hash of the embedded text on
vectorswould re-embed on any change. - Extract marks a title-only role done for good.
upsert_roledoes not resetextracted_atwhen text arrives. Extract is on, so this bites._EXTRACT_WAITINGre-reads roles whoseseniority_modelis empty, which covers level and not pay. - Lever keeps only the intro paragraph.
lever.pyreadsdescriptionand dropslists[]andadditional, about 80% of the text on Spotify's board. Recruitee dropsrequirementsthe same way. - Pay in the text is not in the fields. About 1,470 roles state a currency range in the text only, mostly Greenhouse and US. Pay figures are filled for 17.9% of open roles. Extract can return
salary_minandsalary_maxbut has read 554 roles so far. - A title-only role has no mark in the feed. 1,180 open roles have no description, teaser or fetched posting: 677 of them Workday, 256 SmartRecruiters, 150 Workable, 57 SuccessFactors and 26 Eightfold. A mark would show which fits are guesses.
Ranking
- The owner's agent has no rule on seniority. Fit compares subject, not level. The ladder and the rail's From/To/Track filter exist (
LADDERinapp/models.py), and the level is filled for about half of open roles. A gate still names words (principal,senior_manager,director,exec); a gate on "at least a rung" would read as the rail's filter does. - Votes train
tasteonly. The liked-minus-passed centroid weighs 0.2 on both agents. Feeding votes into the prompt vectors is worth doing once there are a few hundred. - A starred company's roles crowd the top of Best first. With the companies weight at 0.2 a favourite's roles gain about 0.13; after starring Databricks it held 33 of the top 60 rows. Lower the weight on the agent's card, or star fewer companies.
Sources
- The boilerplate moved on.
pipeline/equals boilerplatea1c6f0donce line endings are ignored: 87 files of the working tree have CRLF although the index has LF, so a plaindiff -rshows every file as different (use--strip-trailing-cr).auth/lacksc6a90ff, the phone commit (auth/README.md,auth/static/account.js,auth/templates/login.html).deploy/is at1679e88and lacks the WSL scripts ofe1b3746(wsl-setup.sh,wsl-setup.ps1), anddocs/release.mdlacks itswsl.mdsentence.desk/is newsa275c38less the prune and lags news by four commits (b0e1f6f,f01a6bd,3bb6775,7b9c8a2). The three languages of boilerplate7bb7da2are starter code inapp/, not part of the copies. Refresh withgit archive, and decide whetherapp/static/app.cssshould use the kit's classes (4573f6d) instead of its own copies. - The hosts added on 2026-09-29 were read from this machine only. Every Workday tenant is behind Cloudflare; read one Workday and one SuccessFactors board from the deployed server before relying on them.
- Six hosts' dates are not trusted. Eightfold, Jibe, Gem, Deel, HiBob and HR Manager declare
posted="listed", so their backlog counts as posted when first seen. Eightfold now mapscreationTs, Jibe'sposted_dateequals the page'sdatePosted, and HR Manager'spubDaterises with the id; each needs one check on a live board before it declaresposted="trusted". Platsbanken's local time is read as UTC. - A mistyped SmartRecruiters, Gem or Ashby slug attaches as an empty board. All three answer an empty listing for an unknown id and declare
empty="suspect". The 10% guard keeps a known board from closing its roles, butset_boardkeeps a new board that lists nothing, which is caught only when the person notices "0 roles". Crawl-delayis not honoured. Booking.com's robots.txt asks for 5 seconds; the runner waitsPAGE_DELAY, 0.5. A read of its board is two requests.- A SuccessFactors site on a company's own domain is not discovered. Its pages link only the back end and the image CDN. It needs the rule Teamtailor has in
discover.py: a page with the markers means the page's host is the board, checked by reading/search/. Until then such a board is set by hand. - HR Manager is attached although its robots.txt disallows reading.
hrmanager:teknologisk(the Danish Technological Institute) has 7 open roles, whileREADS.robotssays "disallowed by robots.txt; owner to decide". Seaborg stays unattached until the owner decides whether the feed counts as allowed. - Whether SmartRecruiters' identifier is case-sensitive is unsettled. The module docstring says it is (
BoschGroup),decisions.mdsays it is not, checked live; the live boards hold the identifiers with case. A live request with a lowercased identifier settles it. - The seed lags the live database. The seed has 286 boards and the database 310: it lacks Microsoft, Infineon, Novonesis, Darktrace, Criteo, NVIDIA, HR Manager and seventeen more, and names five of them as
unreadorrobots.app companies seednever replaces a board, so the seed is brought in line by hand. - Stripe's places carry a "Locations" suffix. 316 open roles (285 without copies) have place text like "Singapore Locations" or "Dublin; Ireland Locations".
The pages
- ★ means two things on the Roles tab. On a row it saves the role, in the company strip it marks the company a favourite.
- Place suggestions take about 110 ms, most of it splitting 5,600 place lines into towns on every request. Caching the towns per distinct line would cut it.
company_keykeepsø. Aliases make "Orsted" and "Ørsted" one company; folding the key itself would change the primary key ofcompanies.
From the review of 2026-09-30
- Remote roles are not read from hosts that cannot filter on remote. On SmartRecruiters, Phenom, SuccessFactors and Eightfold the reach "DK, SE, remote" is asked as "DK, SE"; since 2026-09-30 the filtered read keeps the remote roles it has and the line says "remote not asked", but new remote roles on those 21 boards are never fetched, and the 72 closed on 2026-09-29 and 30 (Philips 34, Bosch 25, Coolblue 10, Delivery Hero 3) reopen only if a read lists them. Reading such boards whole is the owner's call; Bosch is about 70 requests a pull.
- SmartRecruiters' API host disallows
/for every agent but LinkedInBot (read 2026-09-30), which covers the listing and the detail requests;READS.robotssays "owner to decide" and the eleven boards are read meanwhile. Jobylon allows*but disallows named job crawlers (JobrapidoBot, JoobleBot, AdzunaBot); ours is not one of them. HR Manager's record says the owner decided on 2026-09-29 to read the API host; confirm it. has_keyre-implementsresolve_key, and the form hard-codes the labels of Jobindex, Adzuna and Platsbanken; since 2026-10-03 the CLI, dupes,search_paramsand the other providers in the form come fromreaders.PROVIDERS.- A search role's detail places are not kept across pulls.
plugins/search.pyhas no_KEPT_FROM_DETAIL, so the next pull may overwrite the town Jobbank'sdetailadded; the text is kept. Per-role detail state of a search is never pruned, since a search never lists everything. - Jobbank's JSON-LD
addressLocalityis sometimes not a town ("Ørsted" on an Ørsted ad), and the feed's regions (Øresundsregionen,Udlandet (øvrige)) will show under Unmapped. - freehire states seniority and employment type, but the reader declares neither, since a stated word needs a table in
app/prep/hosts/. Jobnet keepsutm_*on employer links; dupes match on company, title and town, so it does not matter there. ats.pykeeps compatibility names that only tests reach for:_PARSERS,_parse_dt,_greenhouse_salary,_parse_teamtailor,_RefusedandDETAIL_FIELDS.title="provisional"cannot work whileDETAIL_FIELDShas notitle. Wave 2's WP9 must own_runner.py(plan-hosts-wave-2.md).- Some
posted="trusted"declarations rest on the detail read (Workday, BambooHR, Rippling) or on a fallback the host moves (Greenhouseupdated_at, PhenompostedDate). - Dupes fold same-host roles with the same title and town without comparing text. 99 open copies share under 30% of their words with the kept role.
- Enrich never reads a role below the bar. 349 roles without text are ranked on their title for good.
- A pull never re-measures a board's size. Recheck is the only way, so a board that grows past 300 roles stays read whole until someone rechecks it.
- Fetch terms are configured on no agent, so no board is read with terms today.
- A starred company on a big filtered board is scored on roles the fetch closes. All countries is the workaround.
SMALL(300),STALE_DAYS(21), the guard's 10% andDETAIL_CAP(200) are code constants, and the pages hard-code 300 in tooltips.The todo list.mdholds items the code has done (Jobindex robots, Eightfold cap, places, aliases, teaser, ladder, hybrid on Ashby); the owner prunes it.