Staff Software Engineer (Agentic Search) - Crawler
Nebius London
Builds and operates web-scale crawling and ingestion infrastructure for an agent-native search platform, handling billions of URLs with a focus on coverage, freshness and reliability. Involves crawl scheduling, URL discovery, deduplication, content extraction and observability, working closely with indexing and ML teams.