Data engineer jobs in West New York, NJ and nearby

Within 25 miles

Group jobs by employerEmail me new jobs Save this search

Added 4 hours ago
Sr. Data Engineer - Freewheel
Comcast
New York, NY
Freewheel is currently looking to recruit a Senior Data Engineer to join our Audience & AI group as part of the Revenue Science engineering team. This role will be responsible for…
Added 9 hours ago
Senior Data Engineer
natgridProd
Brooklyn, NY
You must have the ability to work without a need for current or future visa sponsorship
Added 10 hours ago
Payer Healthcare Data Engineer, Senior Manager
PricewaterhouseCoopers Advisory Services LLC
Florham Park, NJ
What You Must Have
Added 11 hours ago
Senior Azure Data Engineer – Python/PySpark & Databricks
Axiom Path
Jersey City, NJ
Join a leading global financial services organization investing in the modernization of its enterprise data infrastructure. The technology team supports sophisticated capital markets…
Added 11 hours ago
Senior Azure Data Engineer (Databricks & Compliance Technology)
Axiom Path
Jersey City, NJ
…enterprise risk management. This team develops and maintains data-driven applications that strengthen financial crime detection, transaction surveillance, and operational…
Added 11 hours ago
RU
Full Stack DATA Engineer - Hybrid NYC
Randstad USA
New York, NY
- $70 to $75 USD / hour
We are looking for a versatile Full Stack Data Engineer to spearhead the modernization and integration of our core platforms. In this role, you won't just be building web interfaces; you…
Added 1 day ago
Senior Data Engineer, Telemetry & Analytics Tooling
Interactive Brokers
New York, NY
We are looking for a Senior Data Engineer to build and extend the framework and tooling that our telemetry and analytics run on: collection, transformation, aggregation, access and…
Added 1 day ago
Sr. Managing Consultant/Managing Consultant Data Engineer Financial Institution Operations & Technology
Berkeley Research Group, LLC
NEW YORK, NY
Added 1 day ago
Senior Data Engineer, Marketing & GTM
Amplitude
New York City, NY
We’re looking for a hands-on engineer who enjoys understanding how the business works and owning complex data projects from discovery through production support. You’ll combine strong data…
Added 1 day ago
R
Data Engineer
Rain
New York, NY
- $128,393 to $167,498 USD / year
We’re looking for a Data Engineer with batch and streaming experience to bring this data into our warehouse and keep it correct. You’ll build scalable, idempotent pipelines that handle late…
Added 2 days ago
Sr Databricks Data Engineer
Deloitte US
Morristown, NJ
Join Deloitte’s AI & Engineering practice and help organizations transform enterprise technology platforms, modernize data environments, and unlock value through innovation. As a Databricks…
Added 2 days ago
Principal Data Engineer
Octus
NEW YORK, NY
Added 2 days ago
Senior Data Engineer
Intercontinental Exchange Holdings, Inc.
New York, NY
The New York Stock Exchange is seeking a senior developer to join the team responsible for data analytics workflows for trading data. The successful candidate will be responsible for…
Added 2 days ago
Data Engineer II
Verisk | Verisk
Jersey City, NJ
The Data/DataOps Engineer II is a junior-to-mid level position that will provide data pipeline, orchestration, and platform operations expertise to guide the development, deployment, and…
Added 2 days ago
Senior Snowflake Data Engineer
ManpowerGroup
New Providence, NJ
Our client, Data & Analytics is seeking a Senior Snowflake Data Engineer to join their team. As a Senior Snowflake Data Engineer, you will be part of the Engineering organization supporting…
Added 2 days ago
Data Engineer – ClickHouse, SQLMesh & TypeScript (Fintech)
MaxIT Consulting - Max Corporate Group
New York, NY
MaxIT Consulting is looking for a Software Engineer, Data Platform to join the data infrastructure team of a fast-growing, venture-backed financial data and accounting automation platform.
Added 3 days ago
CW
Data Engineer
Citizen Watch Company of America, Inc.
New York, NY
- $90,000 to $95,000 USD / year
The Data Engineer works closely with Data Scientists, Data Analysts, and Business stakeholders to develop reliable data solutions and operationalize machine learning and AI applications.
Added 3 days ago
Senior Data Engineer, Business Intelligence
Coaction Specialty Management Company, Inc.
Morristown, NJ
We are seeking a Senior Business Intelligence Developer to join the Data Analytics Engineering team and help build the next generation of enterprise analytics solutions. This is a hands-on…
Added 3 days ago
AID&E - Databricks Data Engineer - Manager - Tech Cons - Open Location
EY
Iselin, NJ · New York, NY · Jericho, NY · Secaucus, NJ · Hoboken, NJ
To qualify for the role, you must have:
Added 3 days ago
Senior Data Engineer Remote
Genesis10
NEW YORK, NY
Genesis10 is currently seeking a Senior Data Engineer for a remote position with an investment management firm located in New York, NY. This is a 6+ month contract opportunity.We are…
Added 4 days ago
Sr. Data Engineer (Hybrid)
Selective Insurance Company of America
Short Hills, NJ
Selective Insurance is seeking an energetic and collaborative Sr. Data Engineer to work on data and analytics projects supporting the Customer Analytics team within the Information…
Added 4 days ago
Lead Data Engineer - Snowflake/Python/AWS
JPMC page
Jersey City, NJ
As a Lead Data Engineer at JPMorgan Chase, you are an integral part of an agile team that works to enhance, build, and deliver data collection, storage, access, and analytics solutions in a…
Added 4 days ago
Senior Snowflake Data Engineer
Experis USA
New Providence, NJ
Our client, Data & Analytics is seeking a Senior Snowflake Data Engineer to join their team. As a Senior Snowflake Data Engineer, you will be part of the Engineering organization supporting…
Added 4 days ago
Data Engineer and Agentic AI Lead
Garan, Incorporated
New York, NY
We are seeking a Microsoft Fabric Data Engineer with Agentic AI experience to design, build, and maintain scalable data solutions within the Microsoft Fabric ecosystem. This role is…
Added 4 days ago
L
Data Engineer (Contract to Perm)
LOCALITY
New York, NY
- $60 to $80 USD / hour
Locality is seeking a Senior Data Engineer whom will serve as the primary internal owner of our Audience Engine, spanning data ingestion, identity resolution, automation, and AI enablement.…

Closed listing

Persistent Systems

Data Engineer

New York, NY, United States

This opening has closed.

The original listing is kept below for reference.

Find open jobs More jobs with this employer

About employer

Job details

Closing date: Oct 29, 2027
Experience: 3–5 years of professional experience in data engineering, ETL/ELT development, or data warehousing, including building and supporting production data pipelines
Posting language: English
Posted: Oct 29, 2026

Similar jobs hiring now

Added 1 hour ago
Data Engineer
Robert Half · Remote
$45 to $55 USD / hour
Added 1 hour ago
Data Engineer - Remote
Mindex · Remote
$90,000 to $140,000 USD / year
Added 4 hours ago
Sr. Data Engineer - Freewheel
Comcast · New York, NY, United States
Added 4 hours ago
Data Engineer II
Ocient Inc. · Remote

Search current openings

Original job description

Archived listing. The details below describe a past opening.

Job Description & Responsibilities

Persistent Systems is seeking a Data Engineer to join our team in our New York City headquarters. The Data Engineer will design, build, and operate the pipelines, lakehouses, and data models that deliver trusted, well-governed data for analytics, reporting, and AI solutions, with a primary focus on Microsoft Fabric and the Azure data platform.

This role sits between source systems and the people and applications that depend on them: ingesting operational, file, API, and streaming data; transforming it through medallion layers in OneLake; and publishing curated, secure datasets for Power BI, data science, and retrieval-augmented generation (RAG) workloads, while integrating tools from other providers where solutions require them.

The ideal candidate is a pragmatic builder who treats data pipelines as production software. They write clean, testable SQL and PySpark, care about data quality and lineage as much as throughput, and can explain tradeoffs among cost, latency, data freshness, and complexity to both technical and nontechnical stakeholders.

Position Responsibilities

Own data engineering work from source-system discovery and requirements through design, build, testing, deployment, monitoring, and ongoing support
Partner with analysts, BI developers, AI engineers, architects, security, and business stakeholders to define data requirements, freshness targets, and acceptance criteria
Build reusable ingestion patterns, transformation frameworks, and data contracts so that pipelines, definitions, and lineage are consistent and maintainable across teams
Evaluate Microsoft Fabric, Azure, and complementary tools against requirements for scale, performance, security, and total cost of ownership, and track platform changes and new features
Document designs, data flows, and operating procedures clearly, review peers’ work, and contribute to a culture of engineering discipline
Design and implement medallion (bronze, silver, gold) architectures in Microsoft Fabric Lakehouse and Warehouse on OneLake using Delta Lake tables, OneLake shortcuts, and appropriate partitioning and table optimization strategies
Build batch and incremental ingestion with Fabric Data Factory pipelines, Copy job, Dataflow Gen2, and Azure Data Factory, and replicate operational databases into OneLake using mirroring and change data capture (CDC)
Develop transformation logic in Spark notebooks (PySpark and Spark SQL), T-SQL, and KQL; handle duplicate, missing, and late-arriving data; and implement slowly changing dimensions and incremental merge patterns
Build and maintain pipelines in Azure Databricks using Lakeflow Jobs, Lakeflow Spark Declarative Pipelines, Auto Loader, and Unity Catalog, and integrate them with OneLake and Azure Data Lake Storage Gen2
Ingest and process streaming data with Fabric Real-Time Intelligence (Eventstreams, Eventhouse, and Activator), Azure Event Hubs, and Spark Structured Streaming
Design star-schema fact and dimension models and collaborate with BI developers on Power BI semantic models, including Direct Lake, to deliver performant and consistent reporting
Implement validation rules, schema enforcement, reconciliations, and automated data quality tests; monitor pipelines with the Fabric Monitoring hub, Azure Monitor, and Log Analytics; and resolve failures through root-cause analysis
Apply OneLake security, row- and column-level security, dynamic data masking, sensitivity labels, and Microsoft Purview cataloging and lineage; secure access with Microsoft Entra ID, managed identities, and Azure Key Vault
Manage notebooks, pipelines, and SQL database projects in Git-based version control (for example, Azure Repos); promote changes through Fabric deployment pipelines and Azure Pipelines with automated tests and approvals; and provision Azure resources with Bicep or Terraform
Prepare curated datasets and document-processing pipelines that feed Azure AI Search, Microsoft Foundry, and Copilot solutions, including chunking, metadata enrichment, and freshness monitoring for RAG
Tune Spark jobs, Delta tables (OPTIMIZE, V-Order, and liquid clustering or Z-ordering), warehouse queries, and pipeline schedules, and monitor Fabric capacity consumption and Azure spend

Tools and Systems You’ll Use

Microsoft Fabric

OneLake, Lakehouse, Warehouse, Data Factory (pipelines, Copy job, Dataflow Gen2), mirroring, shortcuts, Spark notebooks, Real-Time Intelligence (Eventstream, Eventhouse, Activator), Direct Lake

Azure data services

Azure Data Factory, Azure Databricks (Unity Catalog, Lakeflow), Azure Data Lake Storage Gen2, Azure SQL Database, SQL Server, Azure Event Hubs, Azure Functions, Azure Cosmos DB

Languages and processing

SQL and T-SQL, Python, PySpark, Spark SQL, KQL, Delta Lake, Parquet, JSON, REST APIs, PowerShell

DataOps and automation

Git-based version control (for example, Azure Repos, GitLab, or Bitbucket), Azure Pipelines, Azure Boards, Fabric deployment pipelines, SQL database projects, Bicep, Terraform, Azure CLI, automated data testing

Governance and operations

Microsoft Purview, Microsoft Entra ID, managed identities, Azure Key Vault, OneLake security, Fabric Monitoring hub, Fabric Capacity Metrics app, Azure Monitor, Log Analytics

Valuable adjacent skills

Power BI semantic models, Power Platform (Power Apps, Power Automate, Dataverse), Azure AI Search, Microsoft Foundry, Copilot in Fabric, dbt, Apache Airflow, Apache Kafka, Snowflake, Claude Code or Codex for development

Job Qualifications & Experience

Minimum Qualifications

3–5 years of professional experience in data engineering, ETL/ELT development, or data warehousing, including building and supporting production data pipelines
Bachelor’s degree in computer science, information systems, engineering, mathematics, or a related field, or an equivalent combination of education and relevant professional experience
Advanced SQL proficiency, including complex joins, common table expressions, window functions, MERGE and upsert logic, query tuning, and validation against source systems
Strong Python skills for data engineering, including PySpark or Spark SQL for distributed data processing
Hands-on experience building pipelines with Fabric Data Factory, Azure Data Factory, or Azure Databricks, including parameterization, scheduling, error handling, and incremental loads
Experience designing lakehouse or data warehouse solutions using Delta Lake or comparable table formats, medallion architecture, and dimensional modeling
Working knowledge of Azure storage, identity, networking, and RBAC, including secure data access with Microsoft Entra ID
Experience with Git-based version control and CI/CD practices for data workloads, including branching, code review, and environment promotion
Demonstrated ability to troubleshoot pipeline failures and data quality issues, communicate clearly, and document data flows and lineage

Preferred Qualifications

Production experience with Microsoft Fabric, including OneLake, Lakehouse, Warehouse, mirroring, shortcuts, and Fabric deployment pipelines
Experience with real-time data using Fabric Real-Time Intelligence, Eventstreams, Eventhouse and KQL, Azure Event Hubs, or Spark Structured Streaming
Experience with Azure Databricks, Unity Catalog, and Lakeflow, including integration with Microsoft Fabric
Experience building release pipelines in Azure DevOps (Azure Repos and Azure Pipelines) and provisioning data infrastructure with Bicep or Terraform
Experience with Microsoft Purview data governance, including data cataloging, lineage, sensitivity labels, and data quality
Experience preparing data for AI workloads, including Azure AI Search indexing, Microsoft Foundry solutions, or RAG pipelines
Experience with complementary non-Microsoft tools such as dbt, Apache Airflow, Apache Kafka, or Snowflake
Experience with Microsoft Power Platform, including Power Apps, Power Automate, and Dataverse, and integrating low-code solutions with governed enterprise data
Experience using AI coding agents such as Claude Code or Codex to accelerate pipeline development safely
Relevant certifications or credentials, such as:
Microsoft Certified: Fabric Data Engineer Associate (DP-700)
Microsoft Certified: Azure Databricks Data Engineer Associate (DP-750)
Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
Microsoft Certified: Power Platform Fundamentals (PL-900)
Databricks Certified Data Engineer Associate or Professional
Experience operating in a regulated, security-sensitive, government, or defense-adjacent environment

The total compensation for this role can vary from $133,000 to $166,000 a year based on individual qualifications. Eligibility for yearly discretionary bonus. Persistent Systems, LLC offers a comprehensive benefits package including medical, dental, vision, life, and disability insurance; paid time off (sick time and vacation time); flexible spending accounts; 401(k) plan with company match; fitness membership reimbursement; tuition assistance; mental health benefits; and pet discounts.

Company Overview

Persistent Systems, LLC, a leader in defense technology, has been engineering secure Mobile Ad Hoc Networking (MANET) solutions since 2007, enabling joint forces and multinational coalitions to communicate, collaborate, and achieve mission success. Persistent created the Wave Relay® Ecosystem, a unified data network for unmanned systems, sensors, and software, empowering warfighters to accomplish tactical objectives across the operational area. Built on the company’s Wave Relay MANET and Cloud Relay™ technologies, this ecosystem delivers a global data fabric for military, first responders, and commercial users. Persistent has offices in New York City, Colorado, North Carolina, Montana, North Dakota, and Wyoming.

About employer

More about this job

Skills

Data models
Reporting
Microsoft Power BI
SQL
PySpark
Data engineering
Microsoft Azure Data Factory
Operational databases
Apache Spark
Microsoft Azure
Databricks
Unity
Account reconciliation
Root cause analysis
Cataloging
Git
IBM Terraform
Microsoft SQL Server
Python
API development
Microsoft PowerShell
GitLab
Atlassian Bitbucket
Google Analytics
Microsoft Power Platform
Power Apps
Microsoft Power Automate
dbt
Apache Airflow
Apache Kafka
Snowflake
Data warehousing
Computer science
Process data
Scheduling
Data warehouse
CI/CD
Troubleshoot
DevOps
DP

Report this job

Hiring at a glance

Advertised starting pay

Where work happens

Data engineer jobs in West New York, NJ and nearby

Sr. Data Engineer - Freewheel

Senior Data Engineer

Payer Healthcare Data Engineer, Senior Manager

Senior Azure Data Engineer – Python/PySpark & Databricks

Senior Azure Data Engineer (Databricks & Compliance Technology)

Full Stack DATA Engineer - Hybrid NYC

Senior Data Engineer, Telemetry & Analytics Tooling

Sr. Managing Consultant/Managing Consultant Data Engineer Financial Institution Operations & Technology

Senior Data Engineer, Marketing & GTM

Data Engineer

Sr Databricks Data Engineer

Principal Data Engineer

Senior Data Engineer

Data Engineer II

Senior Snowflake Data Engineer

Data Engineer – ClickHouse, SQLMesh & TypeScript (Fintech)

Data Engineer

Senior Data Engineer, Business Intelligence

AID&E - Databricks Data Engineer - Manager - Tech Cons - Open Location

Senior Data Engineer Remote

Sr. Data Engineer (Hybrid)

Lead Data Engineer - Snowflake/Python/AWS

Senior Snowflake Data Engineer

Data Engineer and Agentic AI Lead

Data Engineer (Contract to Perm)

Contact us

Advertised starting pay

Where work happens

Work requirements

Data engineer jobs in West New York, NJ and nearby