Prep stage: host words stored raw, mapped centrally in app/prep after every pull
upsert_role stores the host's own words (roles.*_host), the place texts unresolved when they change, and the company key unresolved on insert, and marks the role prep_due. app.prep maps seniority, employment, remote and country through the host tables in app/prep/hosts, resolves places and company aliases, lists unknown words in `unmapped`, remaps every open role when the tables' fingerprint changes, and runs rebuild_dupes, which moves out of the pull's settle. Migration 22 adds the columns and the table and fills the host words from raw. Cascade: pull, prep, embed, score, enrich, prep, embed, score, extract, score, summarise. `app prep [unmapped] [--remap]`, /api/prep/unmapped and a fold on the Sources page. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
a66aac95cf
commit
d04ceae7e0
31 files changed
+1468
-330
No files matched your search
@@ -897,6 +897,23 @@ def list_readers() -> list[ReaderOut]:
|
||||
for m in sorted(found, key=lambda m: (m.READS.scope != "board", m.LABEL.lower()))]
|
||||
|
||||
|
||||
class UnmappedOut(BaseModel):
|
||||
"""A host word no table of `app/prep/hosts` maps (`Store.unmapped`)."""
|
||||
|
||||
field: str
|
||||
host: str
|
||||
word: str
|
||||
roles: int
|
||||
first_seen: str
|
||||
|
||||
|
||||
@router.get("/prep/unmapped")
|
||||
def list_unmapped(store: StoreDep) -> list[UnmappedOut]:
|
||||
"""The host words the last prep could not map, per field and host, most
|
||||
roles first: what a table in `app/prep/hosts` should learn."""
|
||||
return [UnmappedOut(**w) for w in store.unmapped()]
|
||||
|
||||
|
||||
class SearchBody(BaseModel):
|
||||
provider: str
|
||||
name: str = ""
|
||||
|
||||
Reference in new issue
Block a user