Back to results

Backend Infrastructure Engineer, Anti-Bot

  • San Francisco, CA, United States

$235,000 to $260,000 USD / year

Applications open in a new tab.

Job details

Pay
$235,000 to $260,000 USD / year
Experience
More than 3 years of experience in adversarial web infrastructure, proxy-layer engineering, or web data extraction, with recent hands-on work in this area.
Posting language
English
Posted

Original job description

ABOUT THE ROLE

Join a team building the infrastructure behind a web data extraction platform for AI applications. You will own production systems that keep extraction fast and reliable against websites using sophisticated automated-access defenses.

WHAT YOU'LL DO

  • Architect and operate proxy rotation, IP and session management, and isolated egress infrastructure at scale.
  • Improve extraction success rates against websites that actively block automated access.
  • Build and maintain browser and TLS fingerprint management, CAPTCHA handling, and challenge-solving systems.
  • Monitor proxy-layer reliability and cost efficiency, and manage its operating economics.
  • Diagnose intermittent failures across the stack, implement durable fixes, and support systems in production.

WHAT WE'RE LOOKING FOR

  • More than 3 years of experience in adversarial web infrastructure, proxy-layer engineering, or web data extraction, with recent hands-on work in this area.
  • Production experience architecting proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction.
  • Experience bypassing major anti-bot defenses, such as Akamai, DataDome, Cloudflare, or Kasada, and owning extraction success-rate metrics.
  • Production experience with browser and TLS fingerprinting, CAPTCHA or challenge handling, and high-volume extraction against adversarial defenses.
  • Proficiency in Go and/or Python, plus strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.
  • Experience owning production systems end to end, including on-call, observability, and tools such as Prometheus and Grafana.

COMPENSATION & BENEFITS

Base salary: $235,000 to $260,000 USD annually. Visa sponsorship is available.

LOCATION

Hybrid role based in San Francisco, California, United States.

More about this job

Skills

  • Go
  • Python
  • Prometheus
  • Grafana

Report this job