Senior Collections Data Engineer (US-Remote)
- Remote, United States
$140,000 to $180,000 USD / year
Applications open in a new tab.
Job details
- Pay
- $140,000 to $180,000 USD / year
- Experience
- 5+ years of experience as a Software Engineer or Data Engineer, with a strong focus on large-scale data collection and processing.
- Posting language
- English
- Posted
Original job description
About iCOUNTER
iCOUNTER is redefining how enterprises defend against cyber threats originating across their extended business ecosystems.
Our AI-native Counter Threat Operating System (CTOS™) combines threat intelligence, risk determination, and operational response to help organizations identify and act on threats involving third parties, subsidiaries, portfolio companies, and interconnected business relationships.
We believe enterprises need to move beyond traditional risk assessments and static security scores toward intelligence-led, proactive defense.
We’re building a new category of cybersecurity, and we’re looking for exceptional talent to help us bring it to market.
THE OPPORTUNITY
We are looking for a Senior Software Engineer / Data Engineer to join our Threat Intelligence Collections team. You will design, build, and operate large-scale data collection systems that gather, enrich, and deliver high-fidelity threat intelligence from the open web, deep web, and dark web sources. This is a high-impact, technically challenging role at the intersection of cybersecurity, data engineering, and modern AI-driven automation.
You will own the full lifecycle of threat data pipelines - from raw source ingestion to clean, structured, and queryable intelligence that powers our detection, hunting, and response capabilities.
WHAT YOU'LL DO
- Design and scale high-volume data collection systems that ingest threat data from open-web, deep-web, and dark-web sources (including Tor, I2P, and other anonymity networks).
- Build and maintain robust, fault-tolerant data pipelines (batch + streaming) for ingestion, transformation, enrichment, and storage.
- Develop advanced data parsing and normalization logic for unstructured, semi-structured, and rapidly evolving threat data formats
- Design, build, and maintain agentic workflows - autonomous, LLM-powered agents that can reason, adapt, and execute multi-step collection and enrichment tasks.
- Architect and operate high-scale media pipelines for ingesting, processing, storing, and enriching large volumes of media content (images, videos, screenshots, documents, etc.) collected from threat intelligence sources.
- Design and build internal and external APIs that expose collected intelligence to downstream security teams and platforms.
- Write clean, production-grade Python code as the primary language for all data engineering and automation work.
- Collaborate closely with threat intelligence analysts, detection engineers, and security researchers to translate intel requirements into reliable, scalable data systems.
- Monitor, troubleshoot, and continuously optimize collection performance, data quality, and latency at scale.
- Stay current with emerging threat actor TTPs, data sources, and evasion techniques to proactively improve collection coverage.
WHAT YOU'LL NEED
- 5+ years of experience as a Software Engineer or Data Engineer, with a strong focus on large-scale data collection and processing.
- Deep experience collecting data at scale from open and dark web sources (scraping, crawling, API integration, Tor-based collection, anti-detection/anti-bot techniques).
- Strong expertise in building and operating data pipelines (Airflow, Dagster, Prefect, Spark, Kafka, Flink, or equivalent).
- Advanced data parsing skills - experience turning messy, unstructured web data into clean, structured intelligence.
- Expert-level Python proficiency (including async, concurrency, and performance optimization).
- Hands-on experience designing and implementing agentic workflows (LangChain, CrewAI, AutoGen, LlamaIndex, or similar frameworks) and integrating LLMs into production data systems.
- Track record of building and maintaining production APIs (FastAPI, Flask, or similar).
- Strong understanding of cybersecurity concepts and threat intelligence data types (IOCs, TTPs, malware samples, phishing kits, underground forums, etc.).
- Comfortable working in a fast-paced, ambiguous environment with high-stakes data quality requirements.
WHAT WE ARE LOOKING FOR
- Experience with cloud platforms.
- Knowledge of modern data stack tools (dbt, Snowflake, ClickHouse, DuckDB, etc.).
- Familiarity with containerization (Docker, Kubernetes) and infrastructure-as-code.
- Prior work in cybersecurity, threat intelligence, or intelligence collection organizations.
- Contributions to open-source tools or public research in the threat intel or data collection space.
Benefits & Perks:
- Full Health, Dental, & Vision Coverage, with 100% employee premiums covered and 90% dependent premiums covered on base plans
- 401(k), HSA, & FSA Plans
- Flexible PTO
- Meaningful equity ownership
- Company Holidays & Paid Sick Days
- Monthly home-office stipend for internet, equipment, or other technology needs
iCOUNTER is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or veteran status, or any other applicable state or federal protected class. iCOUNTER provides affirmative action in employment for qualified Individuals with a Disability and Protected Veterans in compliance with Section 503 of the Rehabilitation Act and the Vietnam Era Veterans’ Readjustment Assistance Act.
Accommodation: If you need accommodations, reach out to accommodations@icounter.com.
Completion of a Background Check is required for employment at iCOUNTER
More about this job
Skills
- Python
- Data engineering
- Troubleshoot
- Apache Airflow
- Apache Spark
- Apache Kafka
- LangChain
- Flask
- Cybersecurity
- dbt
- Snowflake
- Docker
- Kubernetes
- Infrastructure as code
- Research