Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
Client Reporting Analyst
IMG Voya Investment Management LLC
Atlanta, GA
The analyst will work across Client Service, Operations, Data, and Technology to turn business requirements into clear, professional client reports. The role requires hands-on report…
Added just now
A
Analyst, Applied Plan Services
Aboon
Remote, United States
- $100,000 to $125,000 USD / year
- Support for professional development and career growth
Added just now
Manager, Supplier Engineer
Applied Materials, Inc
Santa Clara, CA
…providing programs and support that encourage personal and professional growth and care for you at work, at home, or wherever you may go. Learn more about our…
Added just now
Technical Program Manager IV – (E4)
Applied Materials, Inc
Austin, TX
…providing programs and support that encourage personal and professional growth and care for you at work, at home, or wherever you may go. Learn more about our…
Added just now
Test Engineer II
Applied Materials, Inc
Austin, TX
…providing programs and support that encourage personal and professional growth and care for you at work, at home, or wherever you may go. Learn more about our…
Added 1 min ago
Engineering Lead, Growth
Clover Health
Remote, United States
Professional Development: Developing internal talent is a priority for Clover. We offer learning programs, mentorship, professional development funding, and regular performance feedback and…
Added 1 min ago
Engineering Lead, Clinical Operations
Clover Health
Remote, United States
Professional Development: Developing internal talent is a priority for Clover. We offer learning programs, mentorship, professional development funding, and regular performance feedback and…
Added 1 min ago
SO
Quantitative Analyst Intern (Contractual)
State of Maryland
MD
- $25 to $35 USD / hour
Added 2 mins ago
PC
Senior Program Manager, Financial Sustainability (Remote)
PRIMARY CARE DEVELOPMENT CORPORATION
New York, NY
- $110,000 to $125,000 USD / year
Bachelor's degree or equivalent professional experience.
Added 2 mins ago
Software Developer (SAP ABAP, BTP & AWS), Multiple Positions
Avista Utilities
Spokane, WA
Professional Scrum Developer (PSD) or Certified Scrum Developer (CSD)
Added 2 mins ago
KD
Account Sales Manager
Keurig Dr Pepper
Spokane, WA
- $40,500 to $75,000 USD / year
…We also provide employee programs designed to enhance your professional growth and development, while ensuring you feel valued, inspired and appreciated at…
Added 2 mins ago
Sr. Robotics Engineer - Perception and AI
Fresh Consulting
Bellevue, WA
3+ years of professional experience in robotics or CV/ML
Added 2 mins ago
Senior Applied Scientist, Leo Security
Amazon
Bellevue, WA
…career-advancing resources here to help you develop into a better-rounded…
Added 2 mins ago
Senior Data Scientist (Remote)
GovCIO
Olympia, WA
…a range of perks and benefits to support their personal and professional well-being, beyond the standard company offered health benefits,…
Added 2 mins ago
Lead Information Security Engineer - Red Team
Lumen
Olympia, WA
Professional certifications in penetration testing such as GPEN, GWAPT, GMOB, OSCP, OSWE, or equivalent.
Added 2 mins ago
Senior Director Software Engineering
Capital One
Olympia, WA
Mentor and guide the professional and technical development of engineers on your team.
Added 2 mins ago
Core Senior .NET Software Engineer
Evolent
Olympia, WA
5+ years of professional software development experience, with a proven track record of delivering complex, scalable applications.
Added 2 mins ago
Global Supply Chain Manager, ODM Network Switches Infrastructure Supply Chain
Meta
Olympia, WA
Meta is seeking a professional experienced in driving strategic operations for large-scale supply chain organizations to execute on projects critical to Meta's Infrastructure Supply Chain &…
Added 2 mins ago
Design Project Lead, Data Center Design and Construction
Meta
Olympia, WA
Added 2 mins ago
Analytics Program Manager
Meta
Olympia, WA
…overcomes barriers. This person will also work with external professional services, data tool vendors, central product teams, and various apps within Meta, and is responsible for providing…
Added 2 mins ago
Associate Value Consultant
Everpure
Chicago, IL · Raleigh, NC · NC
…key value levers such as power/cooling reduction, increased developer productivity, and mitigated downtime…
Added 2 mins ago
Forward Deployed Engineering Manager, AWS Forward Deployed Engineering, US Government
Amazon
Seattle, WA
…career-advancing resources here to help you develop into a better-rounded…
Added 2 mins ago
Senior Games Partner Solutions Architect, Partner & Industry Specialists
Amazon
Seattle, WA
…career-advancing resources here to help you develop into a better-rounded…
Added 2 mins ago
Senior AI Transformation Specialist - Amazon Quick, Customer Success Center of Excellence
Amazon
Bellevue, WA · Seattle, WA
…career-advancing resources here to help you develop into a better-rounded…
Added 2 mins ago
Software Dev Engineer II, Technical Content Experience (TCX) Engineering
Amazon
Seattle, WA
3+ years of non-internship professional software development experience

i4DM

Databricks Data Engineer

Remote, United States

Apply on comeet.com About employer

Applications open in a new tab.

Job details

Posting language: English

Original job description

Description

About the Role:

We are seeking a hands-on Databricks Data Engineer to support ATLAS, the VA’s open-architected, multi-cloud enterprise data management and analytics platform. You will design, build, and operate scalable lakehouse solutions that ingest, condition, curate, and transform multi-source data into reliable, reusable enterprise data products. Using Databricks, Apache Spark, Delta Lake, Unity Catalog, structured streaming, and medallion architecture patterns, you will strengthen interoperability across ATLAS and its connected data platforms while ensuring consistent, secure access to governed data. You will collaborate with data scientists, analysts, product teams, and enterprise stakeholders to enable advanced analytics and machine-learning use cases that support evidence-based decisions and improve outcomes for Veterans and their families.

Key Responsibilities

Design, develop, and maintain scalable batch and streaming data pipelines using Databricks, Apache Spark, PySpark, and Spark SQL.
Build and manage Delta Lake tables using the medallion (bronze/silver/gold) architecture to deliver reliable, analytics-ready data.
Develop real-time and near-real-time data ingestion solutions using Spark Structured Streaming and messaging platforms such as Kafka.
Configure and manage Databricks clusters, jobs, and workflows in production environments.
Implement data governance, access controls, and security best practices using Unity Catalog.
Integrate data from a variety of source systems and destinations, supporting ETL/ELT and pipeline orchestration activities.
Optimize existing data workflows and Spark jobs for performance, reliability, and cost efficiency.
Integrate Databricks development with CI/CD pipelines and enterprise SDLC tooling, including Git-based version control.
Collaborate with data scientists and analysts to define data models and support machine learning and AI use cases, including model lifecycle management with MLflow.
Support advanced analytics use cases such as anomaly detection, risk scoring, and fraud analytics.
Monitor and troubleshoot data processing jobs, implementing data quality checks and observability to ensure high availability.
Document data processes, frameworks, pipelines, and data mappings for technical and non-technical audiences.
Work closely with scrum teams, product owners, and client stakeholders to deliver end-to-end data solutions.
Stay current on Databricks platform capabilities and industry trends to recommend best-fit tools and technologies.

Requirements

Minimum Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent experience).
4+ years of experience in data engineering, analytics engineering, or big data development.
2+ years of hands-on experience with the Databricks platform.
Proficiency in Apache Spark, PySpark, and Spark SQL.
Experience with Databricks clusters, jobs/workflows, Delta Lake, and Unity Catalog in production environments.
Experience with medallion architecture and Spark Structured Streaming.
Strong Python and SQL skills for data engineering and data analysis.
Experience with ETL/ELT processes and data pipeline orchestration.
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud and their native data services.
Experience integrating data solutions with CI/CD pipelines and Git-based version control workflows.
Understanding of data governance, security, and access control best practices.
Experience working in Agile development environments.
Ability to obtain and maintain a Public Trust determination.
Excellent analytical, problem-solving, and communication skills, with the ability to work with both technical and non-technical stakeholders.
Experience with Synapse Pipelines, Azure Data Factory, Starburst, Azure Data Lake Service, Collibra for data cataloging, Azure ML/AI services, and Pyramid Analytics/Power BI for visualization.

Preferred Qualifications

Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional) or cloud platform certification.
Experience implementing ML or AI solutions in Databricks, including MLflow-based model lifecycle management.
Knowledge of machine learning, AI, or Natural Language Processing (NLP) techniques, including text mining.
Experience supporting fraud analytics, risk scoring, or anomaly detection.
Experience with distributed data and streaming tools such as Kafka, Hadoop, Hive, or Amazon EMR.
Experience with data quality frameworks and observability/monitoring tooling.
Experience with NoSQL databases.
Experience with visualization packages such as Plotly, Seaborn, or ggplot2.
Experience supporting federal government or regulated-industry programs, especially the Department of Veterans Affairs.

Apply on comeet.com About employer

More about this job

Skills

Databricks
Data management
Apache Spark
Unity
Machine learning
PySpark
SQL
Apache Kafka
Data engineering
CI/CD
Git
Data models
Mlflow
Troubleshoot
Process data
Statistical quality control
Computer science
Computer technology
Python
Data analysis
AWS
Microsoft Azure
Google Cloud
Agile development
Problem solving
Communication skills
Microsoft Azure Data Factory
Cataloging
ML
Google Analytics
Microsoft Power BI
Natural language processing
Apache Hadoop
Apache Hive
EMR
NoSQL

Report this job

Work requirements

Jobs in the United States