7.9 KiB
7.9 KiB
Architecture
The target design of roledesk's ranking: how a role gets from a board to the Roles feed for one search agent, and the key decisions behind it. What gets built is tested against this document. The way from today's code to here is in plan-ranking-flow.md while that plan is open; the detailed reasoning is in decisions.md.
Terms
- Fetch gate: the agent's hard rules, a yes or no per role.
- Analysis score: what decides the cut, the roles that get fetch text and the model pass.
- Final score: the order of the feed.
- Fetch text: the second HTTP read of a role's own page, without a model.
- Extract, judge, summarise: the model calls (Haiku).
- Fetch terms: words a big board must match to send a role. They narrow the read at the host and are not part of the fetch gate.
- Affinity: an agent's setting for a company: hidden, neutral, liked or favourite.
- All roles: a company switch, the same for every agent, that passes the whole company through the fetch gate.
Flow
company boards (ATS) search providers
fetch gate at the host + fetch terms, their own saved query
boards ≥300 roles whose host filters
│ │
▼ ▼
1 Fetch ─ list pages: title, place, teaser or text
│
▼
2 Fetch gate ─ required countries, Where lines, titles to leave out
│
▼
3 Analysis score, no tokens ─ fit to the prompts, closeness to the CV, affinity → the cut
│
▼
4 Fetch text ─ the role's own page, for cut roles without text
│
▼
5 Model pass ─ extract the cut → fetch gate and cut again → judge the cut
│
▼
6 Feed ─ every role that passes the fetch gate, in two orders;
filters and saved filters narrow it
│
▼
7 After the ranking ─ summarise the top of the feed
1 Fetch
- On a company board with 300 or more roles, the host is asked for the fetch gate's location part (the required countries and the Where lines) and for the fetch terms, each where the host can filter on it. A smaller board, or a host that cannot filter, is read whole.
- A company set to All roles is fetched from every required country, without fetch terms.
- A search provider is read by its own saved query and takes neither filter.
- A read narrowed by fetch terms is not the whole board, so it closes no role. Roles on such boards close by age. This is accepted because ranking relies on recency, not on closing.
2 Fetch gate
- A role passes when it is in the required countries (Europe), matches at least one Where line (a country, a town or remote), and has no title to leave out in its title. With every Where line empty, a role can be anywhere in the required countries.
- A role of a company set to All roles passes on the required countries alone. This is for small companies worth a speculative approach, whatever their roles' location or title.
- The gate rejects on evidence only. A role with an unknown location passes until extract has read it.
- A hidden company is never scored, read by a model or shown.
- The same gate applies at every stage: at the host where it can filter, before the analysis score, again after extract with the real location and remote area, and in the feed.
3 Analysis score and the cut
- Free and local: each role is embedded once. Fit is its level against the best of the agent's prompts. CV closeness is its level against the closest part of the CV. Both are calibrated levels from 0 to 1, the same in every run.
- Affinity is a bonus on both levels, in the same proportion as in the final score: a liked company about 0.05 above neutral, a favourite about 0.1. It is a nudge, not a pass.
- The cut holds the roles that pass the fetch gate and are:
- among the best N by fit, each at least X (500 and 0.6 to start), or
- among the best M by CV closeness that the first list leaves out, each at least Y (150 and 0.6 to start), or
- liked or saved, whatever their levels.
- Newness and taste are not part of the analysis score. A role is read once and pulls run every few hours, and votes come after the read.
- The two lists are not merged into one number. They answer different questions (what I want, what I am), and a merged number lets the stronger side crowd the other out.
- For a broad agent the count stops each list; for a narrow agent the minimum stops it, so roles that do not fit are not read just to fill the count.
- The cut takes only roles that pass the fetch gate. Measured on 2026-10-04 for agent 2, without the Where lines only 118 of the 500 best by fit were roles the agent could take.
4 Fetch text
- Fetch text reads the role's own page for every role in the cut that came without text. The role is embedded again and its levels recomputed.
5 Model pass
- One depth: the cut is the only selection, and extract and judge both read all of it.
- Extract reads the cut first. It fills location, remote area, seniority, languages and deadline.
- The fetch gate and the cut are then applied again with what extract filled. A role can drop out, such as one that turns out to be outside the agent's places, or enter, such as one that turns out to be remote. A role that enters is extracted on the next pull.
- Judge reads the cut as recomputed. It reads each role against the agent's CV, languages, likes and dislikes, and gives skills, experience and career from 0 to 100, one to three strengths and gaps, and a verdict on each must-have. The CV match is the three numbers under the agent's weights (30/25/30 to start). Changing the weights asks the model for nothing.
- Extract and judge are two calls. Extract needs no CV, and its location and remote answers must reach the fetch gate before judge reads anything.
- Each role is extracted once. A judgement is redone only when its input changes. A change to the CV, a prompt, or the like or dislike text re-judges the whole cut (about an hour for 650 roles); a changed posting re-judges that role only.
6 Feed
- The feed shows every role that passes the agent's fetch gate, loaded as you scroll, in every order, newest first included. No order shows a role the fetch gate rejects.
- What I'm looking for orders by the final score:
(0.6 fit + 0.2 newness + 0.2 affinity + 0.2 taste) / sum of the weights. Newness halves every 14 days. Taste is the role's closeness to the roles the agent liked, away from those it passed. The weights are set per agent. - What fits me orders the judged roles by CV match, then the rest by CV closeness.
- Everything else (seniority, location, remote or hybrid, pay) is a filter, not a score term. Filters only narrow what the fetch gate passed.
- The Roles page says that the feed is already filtered by the agent's fetch gate, location included.
- Saved filters, per agent: the current filter settings are saved under a name, loaded with one click, and deleted. There is no editing; a change is a new saved filter.
- The company view says what is filtered: for an All roles company, every role in the required countries; for any other company, the roles the agent's fetch gate passes. Looking up a company never silently hides roles elsewhere.
7 After the ranking
- Summarise is not part of any score. It runs after the final score, on the top of the feed by the final score (50 to start, its own setting), and on every role liked or saved.
Settings
Per agent, on the form:
- name and prompts
- the fetch block: required countries, Where lines, titles to leave out, fetch terms
- CV, languages, likes and dislikes
- the cut: count and minimum by fit, count and minimum by CV closeness
- the final score weights, and the CV match weights
- summarise size
Per agent, per company: affinity (hidden, neutral, liked, favourite). Per company, for every agent: All roles.