TL;DR
You build and run the pipelines behind […]'s company data: ingestion, scraping, enrichment, entity resolution, LLM extraction and signal detection – from first prototype to reliable production. You sit in the product team, report to our Product Owner and work closely with our engineers.
Our data has grown faster than our engineering around it. Feeds run, but nothing tells us when they stop. Most relationship records aren't classified yet, duplicates slip through, and some signals users ask for, like headcount changes, have no reliable live source. Making this robust, observable and fast is the job.
- Who uses your work
- People in vclOS: Search, lists, projects, PoC tracking, recommendations and weekly company updates.
- Our AI agents & search: Clean fields with provenance, confidence and freshness, measured on our search benchmark.
- API and MCP partners: Stable schemas and fields to build on.
- Marketing: Directory, rankings and reports through a quarterly data release.
When these conflict, the product wins.
- What we're looking for
- What you own
- Ingestion and pipelines: vendor feeds, APIs and scraping jobs – scheduled, idempotent, monitored, with backfills and alerts when a feed stops or drifts.
- Schema and data model: the Postgres schema and data dictionary as the source of truth, including migrations and the Hasura layer on top.
- Entity resolution: matching and deduplicating companies across sources, with measurable precision and recall.
- LLM extraction and classificati