Data engineer jobs in Pacifica, CA and nearby

Within 25 miles

Group jobs by employerEmail me new jobs Save this search

Added 20 days ago
DC
Senior Data Engineer & BI Developer (Hybrid)
Dawar Consulting, Inc.
San Mateo, CA
- $90 to $98 USD / hour
Our client, a world leader in biotechnology and life sciences, is looking for a "Senior Data Engineer & BI Developer” based in Foster City, CA.
Added 20 days ago
H
Senior Data Engineer
Headway
San Francisco, CA
- $180,000 to $225,000 USD / year
Headway is looking for a Senior Data Engineer to help bring us closer to our mission: creating access to affordable, quality mental healthcare across the United States.
Added 20 days ago
Senior Data Engineer
Anthro
Alameda, CA
We’re hiring a Data Engineer to help build and scale our data backbone. This will be a high impact position on the Anthro Data Team, with significant ownership across pipelines, modeling,…
Added 21 days ago
C
Senior Staff Data Engineer
Cohere
San Francisco, CA
- $300,000 to $350,000 USD / year
…and most curious people to help us do it. As the head of the Data Foundation pillar of our Analytics and Data Insights team, you’ll lead the team that makes Cohere’s data trustworthy,…
Added 21 days ago
Data Engineer, Marketing
SpaceXAI
San Francisco, CA
The Data team at SpaceXSI is a small team that works across the company to inform business and product decisions, and we're hiring the first member of our team to focus fully on marketing.…
Added 21 days ago
G
Senior Data Engineer (Data Platform)
Gallatin
San Francisco, CA
- $80,000 to $120,000 USD / year
We're hiring a Senior Data Engineer to build that platform. You'll design and ship containerized services that create and manage external data connections, run an open lakehouse, and power…
Added 22 days ago
Data Engineer III, Hiring Lab
Indeed
San Francisco, CA
Hiring Lab Data Engineers build and maintain the data pipelines, infrastructure, and production systems that transform Indeed’s proprietary data into reliable research-grade datasets and…
Added 23 days ago
Data Engineer 5 (Python, SQL, Databricks, Snowflake) (Enterprise Platforms Technology)
Capital One
San Francisco, CA
We are seeking a Data Engineer to develop the technical vision, architectural design, and implementation of our AI-enabling data ecosystem.
Added 23 days ago
WF
CIB Finance Markets Data Engineer - Executive Director
Wells Fargo
SAN FRANCISCO, CA
- $139,000 to $260,000 USD / year
The successful candidate will serve as a strategic leader responsible for data acquisition, engineering, governance, curation, analytics enablement, and AI adoption. This individual will…
Added 25 days ago
Data Engineer (Software Developer 2)
Stanford University
Stanford, CA
…teams work across experimental development, neurophysiology, data engineering, and machine learning to turn complex biological data into reliable, accessible scientific…
Added 25 days ago
Data Engineer, Meta Superintelligence Labs
Meta
Menlo Park, CA
…to real-world products at massive scale.We are looking for a Data Engineer to join our PAR organization where your technical skills and analytical mindset will be utilized designing and…
Added 25 days ago
C
Sr. Azure Databricks Data Engineer / Architect
Cognizant
San Francisco, CA
- $100,000 to $117,000 USD / year
As a Senior Azure Databricks Data Engineer / Architect , you will make an impact by designing and delivering scalable cloud-based data platform solutions that enable enterprise analytics,…
Added 25 days ago
R
Senior Data Engineer Consultant
RGP
San Francisco, CA
- $90 to $110 USD / hour
RGP is seeking a highly experienced Senior Data Engineer Consultant to design, build, and optimize scalable data platforms and pipelines supporting analytics, business intelligence, and AI…
Added 25 days ago
C
AI-Aware Data Engineer
Cognizant
San Francisco, CA
- $88,000 to $135,000 USD / year
Work as an AI aware data engineer with eight to twelve years of experience designing and optimizing data solutions across Oracle PostgreSQL and Azure based platforms while ensuring robust…
Added 26 days ago
Founding Data Engineer
Alldus
San Francisco, CA
Our client, a growing AI and Data organization, is hiring a Founding Data Engineer to join the team. The successful candidate will help transform enterprise data into actionable…
Added 26 days ago
M
Data Engineer
Monaco
San Francisco, CA
- $200,000 to $400,000 USD / year
…teams to turn what they need into reliable, cost-conscious data. This is a hands-on individual contributor role for a mid-level to senior engineer (roughly 2–6 years of…
Added 27 days ago
AWS Data Engineer (10737-1) San Francisco, CA
ESRhealthcare and EXEC STAFF RECRUITERS
San Francisco, CA
AWS Data Engineer, Python, Spark, AWS Services, ETL, Glue, EMR, S3, Redshift, Airflow, Data Quality, CI/CD
Added 27 days ago
M
Data Engineer - Fully Remote | Upto $80/hr
Mercor
San Francisco, CA
- $80 USD / hour
Position: Data Engineer (Coding Agent Experience)
Added 27 days ago
M
Clinical Data Engineer - TypeScript
Mercor
San Francisco, CA
- $75 to $87 USD / hour
Position: Software Engineer, Clinical Data (TypeScript, FHIR/HL7)
Added 27 days ago
Senior Data Engineer (Hybrid)
Yeah! Global
San Francisco, CA
Design, build, orchestrate, and maintain data pipelines to provide unique insights into the liquidity, adoption, and usage of the Stellar network.
Added 27 days ago
M
Data Engineer - AI Model Evaluation
Mercor
San Francisco, CA
- $80 USD / hour
Position: Data Engineer (Coding Agent Experience)
Added 27 days ago
Sr.Data Engineer with Redshift ED's Glue
RxCloud
Alameda, CA
Data Transformation and ETL - Experience of Qlik Compose, AWS Glue ideal
Added 27 days ago
DE
Principal Data Engineer
Disney Entertainment & Sports LLC
San Francisco, CA
- $179,700 to $252,000 USD / year
As Principal Data Engineer for Marketing and Consumer Data, you will serve as the senior technical leader for Identity and Device data products - including Identity360 and related consumer…
Added 27 days ago
DT
Data Engineer
DS Technologies Inc
San Francisco, CA
- $150,000 USD / year
DS Technologies Inc is looking for Data Engineer role for one of our premier clients.
Added 27 days ago
AWS Data Engineer
Globalchannelmanagement
San Francisco, CA
AWS Data Engineer needs 7+ years of experience in Amazon Web Services (AWS) Cloud Computing

Gallatin

Senior Data Engineer (Data Platform)

El Segundo, CA, United States
Washington, D.C., DC, United States
San Francisco, CA, United States
Austin, TX, United States

$80,000 to $120,000 USD / year

Apply on jobs.ashbyhq.com About employer

Applications open in a new tab.

Job details

Pay: $80,000 to $120,000 USD / year
Experience: 8+ years of professional data engineering experience, including hands-on design and operation of production data pipelines and ownership of a data platform or lakehouse
Posting language: English
Posted: Oct 21, 2026

Original job description

ABOUT GALLATIN

At Gallatin, we are rebuilding logistics infrastructure for the national security missions of the United States and allied partners. We build AI systems that determine how logistics decisions are made - not just how they're executed. From factory to foxhole, we operate at the layer where data becomes decisions, and decisions make the advantage.

We believe that you won't change the world by phoning it in and as such we work in-office in one of our core engineering locations: El Segundo, CA; Austin, TX; Washington, DC; San Francisco, CA.

ABOUT THE ROLE

Logistics decisions are only as good as the data underneath them, and in our world that data is fragmented across legacy systems of record, spreadsheets, slide decks, message traffic, and sensor feeds that were never designed to talk to each other. The Data Platform team connects those sources, cleans and models the data, and serves it to Navigator and our AI agents.

We're hiring a Senior Data Engineer to build that platform. You'll design and ship containerized services that create and manage external data connections, run an open lakehouse, and power the transformations that take raw source data to curated, semantically modeled entities. You'll also build the tools on top: fullstack applications that let logistics SMEs and analysts connect sources, map fields, and test pipeline changes on their own.

The platform runs everywhere Navigator runs: commercial and government cloud, single-tenant high-side enclaves, and air-gapped appliances at forward sites. That means open-source, Kubernetes-native components, hardened images, and data movement that tolerates intermittent and disconnected networks.

Success means a mission partner can point us at a new system of record and have validated, lineage-tracked, query-ready data flowing into Navigator within days.

ABOUT YOU

You start with the catalog: where data came from, what it means, and how much to trust it. You've integrated data from systems that disagree with each other and built the models and mappings that reconcile them.

You're a data engineer with strong software engineering skills, comfortable building a React or Vue front end for the pipeline tools you design. You bias toward action, ship working integrations early and improve them in production, and pull in teammates when the problem crosses into expertise you don't have.

WHAT YOU'LL DO

BUILD THE DATA PLATFORM

Design, build, and operate containerized services that create, configure, and manage external data connections: databases, REST/SOAP APIs, file drops, message buses, and legacy systems of record
Own our open lakehouse: object storage, Apache Iceberg tables, a REST catalog with data versioning
Build batch and streaming ingestion with change data capture where it fits, and design it to run on disconnected, degraded, intermittent, and limited (DDIL) networks
Run the platform on Kubernetes across commercial cloud, government cloud, and air-gapped edge appliances using hardened, FIPS-validated images

TURN RAW DATA INTO TRUSTED ENTITIES

Build transformation pipelines that take source data through raw, cleaned, and curated layers into the semantic entity model Navigator and our AI agents run on
Implement entity resolution and data fusion so each ship, part, unit, or supply request resolves to one record across sources
Structure unstructured inputs (documents, slides, spreadsheets) into typed, relational records
Build lineage, provenance, data quality checks, and confidence labeling into every pipeline so downstream answers show their sources and confidence

BUILD TOOLS THAT PUT DATA IN SME HANDS

Build fullstack applications (TypeScript, Vue, Python services) that let SMEs connect sources, map fields, and compose pipelines with low-code workflows
Give users sandboxes to branch the data, test a pipeline change, compare results, and promote it to production
Build documented APIs that Navigator features and AI agents consume

COLLABORATE AND RAISE THE BAR

Partner with Product, AI/ML, Frontend, and Infrastructure teams on RFCs, data models, and production code
Work with mission partners and field teams to map how data moves across their systems and translate operational constraints into platform requirements
Contribute to code reviews, documentation, and CI/CD practices, and mentor engineers as the data team grows

WHAT WE'RE LOOKING FOR

DATA ENGINEERING DEPTH

8+ years of professional data engineering experience, including hands-on design and operation of production data pipelines and ownership of a data platform or lakehouse
Hands-on production experience with an open table format (Apache Iceberg preferred; Delta or Hudi fine) and a distributed query engine (Trino, Presto, or Spark SQL), including partitioning, compaction, and schema evolution
Demonstrated experience with streaming and batch data pipeline technologies (Kafka, NiFi, Debezium, Spark, or similar)
Strong proficiency in Python and SQL, with experience integrating and validating data from multiple heterogeneous sources (relational and NoSQL databases, APIs, files, and streams)
Strong data modeling skills for both analytical and operational workloads; experience designing entity models for complex real-world domains
Production orchestration experience (Airflow, Dagster, Argo Workflows, or similar)
Production experience writing services in Python and/or TypeScript, plus enough front-end skill (Vue, React, or similar) to ship a usable internal tool end to end
Comfortable designing and documenting RESTful APIs that other teams build on

CONTAINERS AND PLATFORM

Strong Kubernetes and Docker experience: you've packaged, deployed, and operated stateful data services on Kubernetes and can debug networking, storage, and namespace issues
Comfortable building on open-source tooling for self-hosted and air-gapped deployments
Experience with AWS data services (e.g., S3, Glue, Aurora) or Azure equivalents and containerized environments (Kubernetes), delivered through DevSecOps/CI-CD pipelines

COMMUNICATION AND GROWTH MINDSET

Demonstrated ability to work independently against well-defined tasking with minimal oversight, and to communicate effectively with both technical and non-technical stakeholders, including data providers and consumers
Clear communicator across disciplines, whether writing an RFC, explaining a data model to an SME, or recording a weekly demo of recent work (a Gallatin tradition)
Always seeking to learn and stay current with industry trends and tools

BONUS POINTS

Active SECRET or TOP SECRET clearance
Data catalog, lineage, and governance experience (Iceberg REST catalogs, Nessie, Polaris, OpenLineage, DataHub, or similar)
Data versioning and branching (Nessie, lakeFS) for sandboxed pipeline testing
Apache NiFi or other low-code/no-code pipeline tools, including custom processors
Entity resolution, semantic data fusion, knowledge graphs, or ontology modeling
Shipping data workloads into air-gapped or classified environments
Palantir Foundry or ontology experience
Data infrastructure for AI: metadata and retrieval that make agents more accurate and explainable
Operations research, optimization, or constraint-solver background
Background in defense logistics, sustainment, or supply chain systems
Contributions to open-source data projects

WHY GALLATIN?

Join a mission-driven, high-impact, and fast-moving startup where your work directly improves defense logistics readiness for the warfighters of the United States and allied forces.

Work alongside a team of passionate engineers, designers, and industry experts.

Competitive compensation incl. generous options grant, 100% employer-paid health insurance premiums, 401k, opportunities for rapid career growth, unlimited PTO, free lunches and snacks in the office.

This position requires the ability to obtain and maintain relevant security clearances. The successful candidate must be able to work in a classified environment when necessary.

If you're not excited about working hard, and solving the hard problems of building AI decision-support systems that enhance our warfighters, don't apply.

The following ranges are based on the cost of labor across US geographic areas. The base ranges from our lowest geographic market to our highest geographic market.

Apply on jobs.ashbyhq.com About employer

More about this job

Skills

Logistics
Full-stack development
Kubernetes
React
Vue.js
Statistical quality control
TypeScript
Python
ML
Data models
Documentation
CI/CD
Data engineering
Apache Spark
SQL
Apache Kafka
NoSQL
Data modelling
Apache Airflow
API development
Docker
AWS
Microsoft Azure
Communication skills
Work independently
Research
Supply chain management
Geographic areas

Report this job

Hiring at a glance

Advertised starting pay

Where work happens

Data engineer jobs in Pacifica, CA and nearby

Senior Data Engineer & BI Developer (Hybrid)