Jobs in the United States

25+ jobs

Save this search

Added 6 mins ago
Sr Manager Payroll
CONA Services
Charlotte, NC
Lead process improvement roadmap, standard work maturity, documentation improvements, automation opportunities, control enhancements, and operating model improvements across the payroll…
Added 6 mins ago
Network Site Reliability Engineer
NVIDIA USA
CA
…by being hands-on with troubleshooting, focused on network automation, observability, documentation, and excellence in operations. This Network SRE will be dedicated to enhancing network…
Added 7 mins ago
SO
THS Information Technology Instructor (Professional)
State of Connecticut
Milford, CT
- $69,810 to $110,898 USD / year
Added 7 mins ago
SO
Salesforce Developer
State of Connecticut
Hartford, CT
- $113,728 to $141,685 USD / year
…Information Technology Solutions (BITS), is seeking a Salesforce Developer (Information Technology Analyst 2) to lead the maintenance of legacy applications and development efforts in…
Added 7 mins ago
SO
Information Technology Analyst 1 (40 Hour)
State of Connecticut
Rocky Hill, CT
- $89,760 to $112,553 USD / year
Added 7 mins ago
SO
Information Technology Analyst 1 (40 Hour)
State of Connecticut
Hartford, CT
- $89,760 to $112,553 USD / year
Added 8 mins ago
Senior Product Manager, Product Systems
Rocket Travel, Inc.
Chicago, IL
Added 12 mins ago
SCADA Engineer I
Panasonic
Sparks, NV
Basic Experience with Python scripting for SCADA application logic, data processing, automation, and system integration within Ignition SCADA.
Added 12 mins ago
MTS II, Software (SDET)
Panasonic
Irvine, CA
Define automation strategies, automation cases for functional, regression, and system testing of complex software and hardware systems.
Added 12 mins ago
Manufacturing Engineer I
Panasonic
Sparks, NV
Implementing and supporting manufacturing industrial automation.
Added 13 mins ago
Assistant Manager, Financial Accounting
California Academy of Sciences
San Francisco, CA
…reconciliations, and reporting processes; support Workday enhancements, automation, and other accounting projects as…
Added 13 mins ago
IT Capital Project Delivery Center of Excellence (CoE) [Estimator & Financial Analyst]
Kaiser Permanente
Greensboro, NC
…Power BI dashboards, and improving processes through SharePoint automation, advanced Excel formulas and Boolean logic, VBA support, and advancing the practice through practical AI…
Added 17 mins ago
Senior Engineering Manager, Enterprise CI for Games
Electronic Arts
United States
You will report to a Senior Technical Director within the Game Developer Experience (GDX) team. We build and scale the continuous integration (CI) ecosystem that powers builds and preflight…
Added 20 mins ago
Senior Program Manager, Corporate Accounting Enterprise Program Office (CAEPO)
Amazon.com Services LLC
Boston, MA · Austin, TX · Culver City, CA · Nashville, TN · Seattle, WA · Arlington, VA · Portland, OR
…Office (CAEPO) responsible for contributing to the launch of automation initiatives across the Accounting organization. With the rapid growth of the company, it is essential to make…
Added 25 mins ago
M
Software Engineer 2 - CoreAI
Microsoft
WA · Redmond, WA · Redmond
- $102,100 to $219,200 USD / year
Use logs, metrics, traces, telemetry, testing, and automation to proactively identify issues and improve production health.
Added 26 mins ago
J
Senior Software Development Engineer in Test (SDET)
Jobgether
Remote, United States
- $70,000 to $80,000 USD / year
…with hands-on testing to design, build, and maintain scalable automation frameworks. You will work across native mobile applications, web platforms, APIs, databases, and cloud…
Added 26 mins ago
J
Fundraising Data & Operations Coordinator
Jobgether
Remote, United States
- $70,000 to $80,000 USD / year
Recommend and support practical process improvements, including automation, quality checks, and better workflows.
Added 26 mins ago
DIRECTOR, SALES
Jobgether
Remote, United States
…portfolio of technical products serving the HVAC and building automation industries. You will define and execute sales strategies, expand market share, and strengthen relationships with…
Added 29 mins ago
Cemetery Administration Specialist
Veterans Affairs, National Cemetery Administration
Honolulu, HI
Added 29 mins ago
ZT Engineer, Lead
BOOZ, ALLEN & HAMILTON, INC.
Honolulu, HI
Knowledge of automation, orchestration, and policy-as-code security enforcement
Added 32 mins ago
M
Sr. Software Engineer
Microsoft
WA · VA · GA · Redmond, WA · Reston, VA · Atlanta, GA · Redmond · Reston · Atlanta
- $119,800 to $261,000 USD / year
Enhance developer productivity: Improve developer tools and automation to streamline workflows and boost team efficiency.
Added 32 mins ago
M
Solution Engineer - Microsoft Innovation Hub
Microsoft
MA · Boston, MA · Boston
- $130,900 to $272,300 USD / year
Added 33 mins ago
M
Software Engineering IC2
Microsoft
WA · Redmond, WA · Redmond
- $85,400 to $183,700 USD / year
We are looking for a Software Engineer to build automation and validation tools for the Readiness Assessment Lab. You will contribute to a packaged test suite that Microsoft labs and…
Added 34 mins ago
M
Senior Software Engineer - Minecraft
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $261,000 USD / year
Build systems that augment operational workflows through automation, intelligent decision support, and scalable service design.
Added 34 mins ago
M
Digital Community Support Manager
Microsoft
United States
- $142,800 to $304,200 USD / year

Shield AI

Senior Staff Data Engineer, Databricks (R6508)

United States

$145,000 to $220,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $145,000 to $220,000 USD / year
Experience: 12+ years of data engineering experience, including hands-on ownership of production data pipelines.
Posting language: English
Posted: Nov 3, 2026

Original job description

Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit www.shield.ai. Follow Shield AI on LinkedIn, X, Instagram, and YouTube.

Role Summary

The Senior Staff Data Engineer will help build and operate the enterprise lakehouse on Databricks, creating the governed data foundation that supports multiple business domains and downstream analytics. This is a hands-on role, responsible for scalable ingestion, reliable data processing, and strong technical controls across the Bronze and Silver layers of the medallion architecture.

This role is not limited to moving data from point A to point B. The Data Engineer is expected to understand the meaning, sensitivity, classification, and intended use of the data flowing through the pipelines they build, and to apply that understanding when designing controls, access patterns, data quality checks, and segregation boundaries appropriate for a highly regulated environment.

What You'll Do:

Design and build ingestion pipelines, batch and streaming where appropriate, from enterprise source systems into the Databricks lakehouse using Delta Lake.
Own Bronze-layer ingestion, including raw landing patterns, metadata capture, load traceability, and recoverable ingestion design.
Build Silver-layer pipelines for cleansing, standardization, deduplication, conformance, and quality enforcement without embedding unauthorized or undocumented KPI logic.
Define and evolve reusable ingestion and transformation patterns, templates, and engineering standards that other domains can adopt as they onboard to the platform.
Implement and maintain Databricks platform constructs needed for secure delivery, including catalogs, schemas, service principals, job orchestration, and environment-aware deployment patterns.
Build and maintain CI/CD pipelines for data platform assets, including ingestion code, transformation logic, workflow definitions, tests, and environment promotion across dev, test, and prod.
Apply data classification, segregation, and handling requirements within the pipeline design, ensuring sensitive and regulated data is processed in accordance with enterprise controls and access policies.
Build data quality controls that do more than detect technical failures, including checks that reflect actual business meaning, record integrity, completeness, and expected domain behavior.
Quarantine, flag, and route problematic records or datasets according to defined quality and compliance rules rather than silently dropping or obscuring issues.
Maintain documentation for source objects, ingestion logic, applied transformations, data quality rules, and known limitations so downstream teams can trust and use the data correctly.
Partner with the Analytics Engineer and domain teams to ensure Silver-layer data is reliable, well-governed, and suitable for trusted Gold-layer modeling.
Collaborate with domain engineering teams to align on ownership boundaries, onboarding patterns, data contracts, and support expectations as new domains are enabled onto the platform.

Preferred Qualifications:

Databricks certification such as Data Engineer Associate or Professional.
Experience standing up or maturing Unity Catalog structures and access models in an enterprise setting.
Experience with CI/CD, infrastructure-as-code, and deployment automation for data platforms.
Experience in defense, aerospace, financial services, healthcare, or another highly regulated environment.
Experience enabling multiple business domains on a shared data platform while maintaining strong governance and ownership boundaries.

Required Qualifications:

12+ years of data engineering experience, including hands-on ownership of production data pipelines.
Strong Databricks experience, including Delta Lake, Databricks Workflows or Jobs, and Spark with PySpark and/or Spark SQL.
Working knowledge of Unity Catalog, including catalogs, schemas, tables, lineage, and access control concepts.
Experience with batch, CDC, and/or streaming ingestion patterns and the operational trade-offs associated with each.
Experience with CI/CD and deployment automation for data pipelines and platform assets, including version control, testing, and controlled promotion across environments.
Strong SQL skills and solid grounding in data modeling fundamentals, even if dimensional modeling is not the primary responsibility of this role.
Demonstrated ability to understand the business and regulatory context of the data being processed, not just the mechanics of pipeline development.
Experience applying data classification, segregation, security, retention, or compliance requirements in data engineering workflows within a regulated or security-sensitive environment.
Ability to design pipelines with awareness of the actual data domains involved, including sensitivity, ownership, permitted use, and downstream impact.
Comfort operating in a fast-moving platform build where patterns are still being established and engineers are expected to shape standards, not just follow them.

#LE

Full-time regular employee offer package:

Pay within range listed + Bonus + Benefits + Equity

Temporary employee offer package:

Pay within range listed above + temporary benefits package (applicable after 60 days of employment)

Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.

###

Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.

Apply About employer

Report this job