About Rockefeller Capital Management
Rockefeller Capital Management was established in 2018 as a leading independent financial advisory services firm. Originally founded in 1882 as the family office of John D. Rockefeller, the Firm has evolved to offer strategic advice to ultra- and high-net-worth individuals and families, institutions, and corporations from offices in 37 markets throughout the United States, as well as an office in London. The Firm oversees $236 billion in client assets as of September 30, 2026.
Position
As a member of the Technology team, the Cloud Databricks Engineer will lead the engineering, modernization, and operational reliability of Rockefeller Capital Management’s enterprise data platform, with Azure Databricks at its core. The position combines hands-on data engineering with technical leadership to build secure, governed, observable, and cost-effective data products for analytics, reporting, operational processing, and AI-enabled use cases. The successful candidate will design and implement, support batch and streaming pipelines, establish reusable engineering patterns, improve delivery through automation and CI/CD, and partner with platform, security, architecture, data governance, and business teams. This is a hands-on role requiring the ability to move from architecture and standards to production code, deployment of pipelines, monitoring, troubleshooting, and continuous optimization.
Responsibilities
- Design, develop, deploy, and support production-grade batch and streaming pipelines using Azure Databricks, Apache Spark, Python, SQL, Delta Lake, and Databricks Workflows.
- Implement scalable Lakehouse architecture, including bronze, silver, and gold data layers, reusable transformations, clear data contracts, and fit-for-purpose data models.
- Establish data governance through Unity Catalog, including access controls, lineage, ownership, auditability, and controlled data sharing.
- Integrate Databricks with Azure Data Factory, Azure Data Lake Storage, Azure SQL, Key Vault, Microsoft Entra ID, and enterprise monitoring services.
- Automate testing, deployment, and environment promotion through Git, CI/CD, Databricks Asset Bundles, Terraform, and related engineering practices.
- Improve platform reliability through monitoring, alerting, data-quality controls, reconciliation, runbooks, and root-cause remediation.
- Optimize Spark workloads, compute policies, storage design, and job schedules to improve performance, resilience, and cost efficiency.
- Modernize legacy pipelines and manual recovery processes into repeatable, maintainable, and well-documented solutions.
- Partner with engineering, cybersecurity, architecture, governance, analytics, operations, and business stakeholders to translate requirements into secure solutions.
- Provide technical leadership through design reviews, code reviews, engineering standards, documentation, and mentoring.
Qualifications
- Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Engineering, or a related discipline, or equivalent practical experience.
- 5+ years of data engineering or data-platform experience, including 3+ years of hands-on work with Azure Databricks or a comparable Spark-based Lakehouse platform.
- Advanced proficiency in Python, SQL, Apache Spark, Delta Lake, distributed data processing, and production-grade pipeline development.
- Hands-on experience with Azure Data Factory, Azure Data Lake Storage, Azure SQL, Key Vault, Microsoft Entra ID, and Azure monitoring tools.
- Experience with Unity Catalog, data access controls, lineage, auditability, and governed data sharing.
- Experience with Git-based development, automated testing, CI/CD, and infrastructure-as-code using Terraform or a similar tool.
- Strong knowledge of data modeling, metadata-driven processing, schema evolution, observability, recovery patterns, and production support.
- Ability to communicate technical decisions, risks, and trade-offs clearly to engineering, business, and senior stakeholders.
- Experience working with sensitive or regulated data; financial-services experience is preferred.
Skills
- Strong technical leadership, problem-solving, and cross-functional collaboration skills.
- Experience with Databricks Asset Bundles, Auto Loader, Lakeflow, Databricks SQL, serverless compute, or similar Databricks capabilities is preferred.
- Knowledge of Azure networking, compute governance, cost optimization, event-driven integration, and Microsoft Purview is valued.
- Databricks or Microsoft Azure data-engineering certification is preferred.
- Excellent written and verbal communication skills, with strong judgment, organization, and attention to detail.
Compensation Range
The anticipated base salary range for this role is $125,000 to $150,000. Base salary for the role will depend on several factors, including a candidate’s qualifications, skills, competencies, and experience, and may fall outside of the range shown. In addition, this role may be eligible for a discretionary bonus. Rockefeller Capital Management offers a comprehensive benefit package including health coverage, vacation time, paid leave, retirement plan, and more. Visit careers.rockco.com to learn more about additional opportunities and benefits offerings.
Disclosure
Rockefeller & Co. LLC, Rockefeller Financial LLC, Rockefeller Trust Company, N.A., The Rockefeller Trust Company (Delaware), Rockefeller Financial Services, Inc. and all other subsidiaries of Rockefeller Capital Management L.P. (individually and collectively, “Rockefeller”) is an equal opportunity employer and does not discriminate on the basis of race, religion, sex, gender, sexual orientation, gender identity or expression, national origin, citizenship, age, military or veteran status, marital or partnership status, caregiver status, legally recognized disability, or any other basis protected by applicable federal, state or local law (“protected characteristics”).
Rockefeller Capital Management participates in the E-Verify program in certain locations, as required by law.