Senior Data Engineer
- NY, United States
$160,000 to $180,000 USD / year
Applications open in a new tab.
Job details
- Pay
- $160,000 to $180,000 USD / year
- Posting language
- English
- Posted
Original job description
Location
Brookfield Place New York - 225 Liberty Street, 8th Floor Business - Real Estate
Brookfield Real Estate Group is one of Brookfield’s primary operating groups. The Real Estate Group is one of the world's largest investors in real estate, with a global portfolio that includes office, retail, multifamily, logistics, hospitality and alternative real estate assets on five continents. The Group owns and operates approximately $268 billion of assets representing the most iconic properties in the world’s most dynamic markets. We seek to generate value by leveraging our operating expertise and focusing on our core real estate capabilities of leasing, financing, development, design and construction as well as property and facilities management. For more information, visit https://www.brookfield.com/our-businesses/real-estate.
Brookfield Culture
Brookfield has a unique and dynamic culture. We seek team members who have a long-term focus and whose values align with our Attributes of a Brookfield Leader: Entrepreneurial, Collaborative and Disciplined. Brookfield is committed to the development of our people through challenging work assignments and exposure to diverse businesses.
Job Description
We are seeking a Senior Data Engineer to join Brookfield in New York, NY. In this role, you will play a key role in inspiring change and continual improvement. If you are committed to excellence and ready to contribute to a dynamic culture, we would love to meet you.
The Senior Data Engineer will sit within the Data Intelligence team and help modernize, scale, and operate the enterprise data platform. This role will design and deliver reliable data pipelines and reusable data products using Snowflake, dbt, Airflow and Astronomer, AWS, SQL, and Python.
The role spans the full data engineering lifecycle, from integrating structured, semi-structured, and unstructured data through transformation, deployment, data quality, governance, observability, and production support.
The ideal candidate will combine strong application and data engineering skills with a practical understanding of the cloud infrastructure, compute environments, security controls, and operational practices that support modern data platforms.
This is a senior individual-contributor position suited to someone who can lead defined technical workstreams, make sound architecture decisions, mentor other engineers, and take ownership of reliable outcomes from design through ongoing operation.
Role & Responsibilities:
- Design, build, test, deploy, and support scalable data pipelines using Airflow and Astronomer, dbt, Snowflake, SQL, and Python
- Design Snowflake architecture, including databases, schemas, warehouses, security roles, workload isolation, performance optimization, and cost management
- Apply medallion architecture principles across raw or bronze, validated or silver, and curated or gold data layers
- Lead the migration of legacy workflows to Airflow and Astronomer using reusable patterns for dependencies, retries, backfills, alerting, recovery, and idempotent processing
- Troubleshoot the complete Airflow runtime, including schedulers, workers, executors, metadata databases, queues, containers, logging, and autoscaling
- Develop and operate AWS-based data solutions using services such as S3, IAM, EKS, ECS, Fargate, EC2, Lambda, Secrets Manager, KMS, and CloudWatch
- Build secure and resilient integrations across APIs, SFTP, databases, cloud storage, vendor platforms, flat files, Excel workbooks, and event-based systems
- Develop ingestion and processing solutions for structured, semi-structured, and unstructured data, including OCR and document extraction from PDFs and images
- Embed automated data-quality testing, reconciliation, lineage, monitoring, and observability throughout data pipelines
- Partner with Data Governance, Security, Risk, and business teams to implement data ownership, metadata, classification, access, retention, auditability, and data-contract requirements
- Build and maintain CI/CD pipelines for Airflow, dbt, Python, and infrastructure code, including automated testing, environment promotion, deployment, and rollback
- Participate in production support and incident management, including triage, escalation, stakeholder communication, service restoration, root-cause analysis, post-incident reviews, and corrective actions
- Create reusable frameworks and engineering standards that improve platform reliability, delivery speed, and consistency
- Lead defined technical workstreams and mentor engineers through architecture reviews, code reviews, documentation, and troubleshooting
Your Qualifications:
- Five or more years of progressive data engineering or related software engineering experience
- Strong production experience with Airflow or Astronomer, dbt, Snowflake, SQL, and Python
- Experience designing Snowflake architecture and implementing dimensional, analytical, or medallion data models
- Experience migrating and operating production workflows in Airflow or Astronomer
- Understanding of Airflow compute and runtime architecture, including Kubernetes, containers, schedulers, workers, executors, queues, networking, and autoscaling
- Hands-on AWS experience spanning storage, compute, IAM, networking, security, secrets management, monitoring, and container orchestration
- Experience integrating APIs, SFTP, databases, cloud storage, vendor platforms, flat files, and complex Excel sources
- Experience processing semi-structured and unstructured data, including OCR or document-extraction use cases
- Experience implementing data-quality controls, automated testing, reconciliation, observability, metadata, and lineage
- Experience with data governance, access controls, data ownership, classification, retention, and audit requirements
- Experience building CI/CD pipelines using Git-based development and automated deployment practices
- Experience supporting critical production platforms through structured on-call and incident-management processes
- Strong troubleshooting, written communication, and stakeholder-management skills
- Ability to lead technical workstreams and mentor engineers without formal people-management responsibility
Preferred Qualifications
- Data engineering experience in asset management, investment management, private markets, or a related financial-services organization
- Understanding of fund, portfolio, transaction, performance, risk, valuation, reference-data, and investor-reporting workflows
- Experience working with investment-data providers, fund administrators, custodians, or portfolio-management platforms
- Experience operating Airflow on Astronomer, Amazon MWAA, Kubernetes, Amazon EKS, or another container-based AWS environment
- Familiarity with Terraform, AWS CloudFormation, or comparable infrastructure-as-code tooling
- Experience with data mesh, data products, data contracts, data-quality platforms, data catalogs, or metadata-management solutions
- Experience with incident-management and observability tools such as ServiceNow, PagerDuty, Datadog, or CloudWatch
- Experience building governed data foundations for advanced analytics, machine learning, or generative AI
Your Career @ Brookfield:
At Brookfield, your career progression is important to us. As a successful employee, you will have the opportunity to grow within your team, department, and across the Brookfield organization. Our leadership teams are dedicated to the accomplishments of their employees. We also invest time into training and developing our people.
End your job search and find your career today, at Brookfield.
Why Brookfield? We imagine, create, and operate on a foundation of values to build a better world, together. Brookfield strives to create spaces where going to work never feels routine. As a Brookfield employee, you will enjoy many benefits such as 401K matching, tuition reimbursement, summer Fridays, paid maternity leave and more. There is also a generous employee referral program because we want our existing team members to help us build a more diverse workplace through their networks.
Compensation & Benefits:
Salary Type: Exempt Pay Frequency: Bi-weekly Annual Base Salary Range: $160,000 - $180,000 Medical & Pharmacy Coverage: Yes, under Brookfield Medical Plan Dental Coverage: Yes, under Brookfield Medical Plan Vision Coverage: Yes, under Brookfield Medical Plan Retirement: 401(k)
Our compensation structure is comprised of a base salary and a short-term incentive program (cash bonus). Cash compensation tends to vary based on geography to account for local market conditions and is set to be market competitive. Compensation decisions are based on a number of factors including relative experience, overall years of experience, industry experience, education and designations.
Brookfield is committed to maintaining a Positive Work Environment that is safe and respectful; our shared success depends on it. We do not tolerate workplace discrimination, violence or harassment. We are proud to be an Equal Opportunity Employer and make employment decisions based on qualifications, merit and business needs, without regard to any characteristic protected by applicable law. Applicant information is collected and handled in accordance with our Applicant Privacy Notice.