Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added 2 mins ago
Sr. Mechanical Design Engineer
Actalent
Bingen, WA
This engineer supports the design and development of advanced aerospace systems, with a focus on new composite components such as radomes and ground support equipment. Youll take designs…
Added 2 mins ago
EFIN Electrical Engineer
Energy Northwest
Richland, WA
…the application of engineering fundamentals in support of the design modification, operating, and independent assessment of Energy Northwest facilities. Serve as an advisor to…
Added 2 mins ago
Software Developer (SAP ABAP, BTP & AWS), Multiple Positions
Avista Utilities
Spokane, WA
…from the Track Leads and technical direction from the Software Engineer Lead, and present designs for Design Authority Board review where…
Added 2 mins ago
Sr. Robotics Engineer - Perception and AI
Fresh Consulting
Bellevue, WA
We are Fresh. Together let’s build the future. With partners and clients, we practice strategy, design, development, and engineering to harness the power of technology and create what's…
Added 2 mins ago
Machine Learning Engineer, EXR OPS Tech Team
Amazon
Bellevue, WA
…directly impacts millions of customers? As a Machine Learning Engineer at Amazon, In this role, you will help design, build, and deploy machine learning models and systems that power…
Added 2 mins ago
Lab and Build Engineer II, Battery Design, Amazon Leo
Amazon
Redmond, WA
…careful, hands-on work in the lab. We are looking for a Lab Engineer to own that work: set up and maintain the equipment, prepare builds and work orders, and move tests through the lab's…
Added 2 mins ago
HA
Sr Advanced Systems Engineer
Honeywell Aerospace
Redmond, WA
- $133,000 to $167,000 USD / year
YOU MUST HAVE
Added 2 mins ago
Software Engineer, Android
Meta
Bellevue, WA · Redmond, WA · Olympia, WA
Collaborate with cross-functional teams (product, design, operations, infrastructure) to build innovative application experiences
Added 2 mins ago
O
Federal Oracle Health Automation Engineer - Eggplant
Oracle
Olympia, WA
- $23.8 to $56.83 USD / hour
The Federal Test Automation team is seeking a Staff Automation Engineer to support the Federal VA project. This role is responsible for designing, developing, and executing automated…
Added 2 mins ago
Software Dev Engineer, AWS WAF Bot Control and Fraud Prevention
Amazon
Seattle, WA
AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all…
Added 2 mins ago
Network Engineer III
Deloitte
Seattle, WA
…Our practitioners lead and support technical teams to assess, design, and deploy enterprise network solutions across campus, data center, and hybrid cloud environments, owning delivery…
Added 2 mins ago
Software Dev Engineer II, Technical Content Experience (TCX) Engineering
Amazon
Seattle, WA
In this role, you will own solutions from design and execution through deployment and support, using the best of available tools, including Lambda, DynamoDB, and AI/ML services. You will be…
Added 2 mins ago
Software Dev Engineer II, ASBX
Amazon
Seattle, WA
We are seeking a Software Development Engineer to help us build the next iteration in CI/CD by continuing to develop and expand our smart orchestration layer, Dynamic Releases. As part of…
Added 2 mins ago
Software Development Engineer II, AWS Proactive Security / AWS Piezo, AWS Proactive Security - AWS Piezo
Amazon
Seattle, WA
You're a software engineer with experience in distributed systems, security, and large-scale design. You deliver high-quality work independently, make sound technical decisions, and mentor…
Added 2 mins ago
Software Development Engineer II, AWS Proactive Security / AWS Piezo, AWS Piezo - Customer Experiences
Amazon
Seattle, WA
You’re a software engineer with experience in distributed systems, security, and large-scale design. You deliver high-quality work independently, make sound technical decisions, and mentor…
Added 3 mins ago
Healthcare Engineer - Project Engineer
Veterans Affairs, Veterans Health Administration
Seattle, WA
Selective Service Registration is required for males born after 12/31/1959
Added 3 mins ago
Security Engineer, Trust & Safety - Applied AI
Meta
Seattle, WA · Bellevue, WA
Security Engineer, Trust & Safety - Applied AI Responsibilities:
Added 3 mins ago
Healthcare Engineer - Project Engineer
Veterans Affairs, Veterans Health Administration
Seattle, WA
Selective Service Registration is required for males born after 12/31/1959
Added 3 mins ago
Staff Software Engineer, AI/ML, Google Cloud
Google
Seattle, WA
…information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile;…
Added 3 mins ago
Software Development Engineer II, AWS Proactive Security / AWS Piezo, AWS Proactive Security - AWS Piezo
Amazon
Seattle, WA
You're a software engineer with experience in distributed systems, security, and large-scale design. You deliver high-quality work independently, make sound technical decisions, and mentor…
Added 3 mins ago
Plant Engineer 1 – Melter and Offgas Systems
Amentum
Richland, WA
The Plant Engineer is responsible for technical activities relating to operations and maintenance of plant equipment during Engineering, Commissioning, and Operations. The Melter and Offgas…
Added 3 mins ago
Mechanical Design Engineer (Welding and Manufacturing)
Amentum
Huntsville, AL
Developing fixture design concepts to position and hold components during friction stir weld and/or fusion weld manufacturing operations including:
Added 7 mins ago
Systems Development Engineer 2
Round Rock, TX · Austin, TX
…solutions, and data management our customers need most. Our teams design and develop the hardware and software that connect infrastructure, accelerate computational workloads, integrate…
Added 8 mins ago
AS
Applied Scientist III - AMZ10037670
Amazon.com Services LLC
Seattle, WA
- $167,100 to $226,100 USD / year
Participate in the design, development, evaluation, deployment and updating of data-driven models and analytical solutions for machine learning (ML) and/or natural language (NL)…
Added 8 mins ago
Electrical Project Engineer
Rehlko
Sheboygan, WI
The Electrical Project Engineer – Custom Power Systems is responsible for providing technical leadership and design direction in the development of customized generator set solutions. This…

i4DM

Databricks Data Engineer

Remote, United States

Apply on comeet.com About employer

Applications open in a new tab.

Job details

Posting language: English

Original job description

Description

About the Role:

We are seeking a hands-on Databricks Data Engineer to support ATLAS, the VA’s open-architected, multi-cloud enterprise data management and analytics platform. You will design, build, and operate scalable lakehouse solutions that ingest, condition, curate, and transform multi-source data into reliable, reusable enterprise data products. Using Databricks, Apache Spark, Delta Lake, Unity Catalog, structured streaming, and medallion architecture patterns, you will strengthen interoperability across ATLAS and its connected data platforms while ensuring consistent, secure access to governed data. You will collaborate with data scientists, analysts, product teams, and enterprise stakeholders to enable advanced analytics and machine-learning use cases that support evidence-based decisions and improve outcomes for Veterans and their families.

Key Responsibilities

Design, develop, and maintain scalable batch and streaming data pipelines using Databricks, Apache Spark, PySpark, and Spark SQL.
Build and manage Delta Lake tables using the medallion (bronze/silver/gold) architecture to deliver reliable, analytics-ready data.
Develop real-time and near-real-time data ingestion solutions using Spark Structured Streaming and messaging platforms such as Kafka.
Configure and manage Databricks clusters, jobs, and workflows in production environments.
Implement data governance, access controls, and security best practices using Unity Catalog.
Integrate data from a variety of source systems and destinations, supporting ETL/ELT and pipeline orchestration activities.
Optimize existing data workflows and Spark jobs for performance, reliability, and cost efficiency.
Integrate Databricks development with CI/CD pipelines and enterprise SDLC tooling, including Git-based version control.
Collaborate with data scientists and analysts to define data models and support machine learning and AI use cases, including model lifecycle management with MLflow.
Support advanced analytics use cases such as anomaly detection, risk scoring, and fraud analytics.
Monitor and troubleshoot data processing jobs, implementing data quality checks and observability to ensure high availability.
Document data processes, frameworks, pipelines, and data mappings for technical and non-technical audiences.
Work closely with scrum teams, product owners, and client stakeholders to deliver end-to-end data solutions.
Stay current on Databricks platform capabilities and industry trends to recommend best-fit tools and technologies.

Requirements

Minimum Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent experience).
4+ years of experience in data engineering, analytics engineering, or big data development.
2+ years of hands-on experience with the Databricks platform.
Proficiency in Apache Spark, PySpark, and Spark SQL.
Experience with Databricks clusters, jobs/workflows, Delta Lake, and Unity Catalog in production environments.
Experience with medallion architecture and Spark Structured Streaming.
Strong Python and SQL skills for data engineering and data analysis.
Experience with ETL/ELT processes and data pipeline orchestration.
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud and their native data services.
Experience integrating data solutions with CI/CD pipelines and Git-based version control workflows.
Understanding of data governance, security, and access control best practices.
Experience working in Agile development environments.
Ability to obtain and maintain a Public Trust determination.
Excellent analytical, problem-solving, and communication skills, with the ability to work with both technical and non-technical stakeholders.
Experience with Synapse Pipelines, Azure Data Factory, Starburst, Azure Data Lake Service, Collibra for data cataloging, Azure ML/AI services, and Pyramid Analytics/Power BI for visualization.

Preferred Qualifications

Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional) or cloud platform certification.
Experience implementing ML or AI solutions in Databricks, including MLflow-based model lifecycle management.
Knowledge of machine learning, AI, or Natural Language Processing (NLP) techniques, including text mining.
Experience supporting fraud analytics, risk scoring, or anomaly detection.
Experience with distributed data and streaming tools such as Kafka, Hadoop, Hive, or Amazon EMR.
Experience with data quality frameworks and observability/monitoring tooling.
Experience with NoSQL databases.
Experience with visualization packages such as Plotly, Seaborn, or ggplot2.
Experience supporting federal government or regulated-industry programs, especially the Department of Veterans Affairs.

Apply on comeet.com About employer

More about this job

Skills

Databricks
Data management
Apache Spark
Unity
Machine learning
PySpark
SQL
Apache Kafka
Data engineering
CI/CD
Git
Data models
Mlflow
Troubleshoot
Process data
Statistical quality control
Computer science
Computer technology
Python
Data analysis
AWS
Microsoft Azure
Google Cloud
Agile development
Problem solving
Communication skills
Microsoft Azure Data Factory
Cataloging
ML
Google Analytics
Microsoft Power BI
Natural language processing
Apache Hadoop
Apache Hive
EMR
NoSQL

Report this job

Work requirements

Jobs in the United States