Backend Infrastructure Engineer, Anti-Bot

ABOUT THE ROLE

Join a team building web data-extraction infrastructure for AI applications. You will own production systems that keep high-volume extraction reliable when websites actively resist automated access.

WHAT YOU'LL DO

• Architect and manage proxy rotation, IP and session management, and isolated egress nodes at scale.
• Improve extraction success rates against websites with active anti-bot and anti-scraping defenses.
• Build and maintain browser and TLS fingerprinting, CAPTCHA handling, and challenge-solving infrastructure.
• Monitor the health and cost efficiency of the proxy layer.
• Diagnose intermittent failures across the stack and deliver lasting fixes.
• Own production systems end to end, including reliability and on-call responsibilities.

WHAT WE'RE LOOKING FOR

• More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, with recent hands-on work in production web extraction.
• Experience building proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction.
• Production experience evading aggressive anti-bot defenses, including platforms such as Akamai, DataDome, Cloudflare, or Kasada, and ownership of success-rate metrics.
• Experience with browser and TLS fingerprinting and CAPTCHA or challenge handling at production scale.
• Proficiency in Go and/or Python, with strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.
• Experience operating end-to-end production systems and implementing observability and on-call tooling such as Prometheus and Grafana.

COMPENSATION & BENEFITS

Base salary: $235,000 to $260,000 annually. Visa sponsorship is available.

LOCATION

Hybrid, San Francisco, California, United States.