Summary We are seeking exceptional software engineers to work on Apache DataFusion Comet, Apache Spark, and related open-source technologies. Comet, the native accelerator for Apache Spark, was created at Apple and donated to the Apache Software Foundation. If you love pushing distributed query engines to their performance limits without compromising correctness or stability, this role is for you. We are looking for engineers with deep expertise in Spark internals and in related data formats and query engines, such as Apache Iceberg, Parquet, Arrow, and DataFusion. In this role, you'll collaborate with teams across Apple operating Spark at massive scale and actively contribute upstream to these open-source communities.
Description As an engineer on our team, you will advance Apache Spark to meet Apple's scale while driving significant efficiency gains through Apache DataFusion Comet. You will design and implement native operators and expressions using Apache DataFusion and Apache Arrow, extend Comet's integration across Spark versions, and accelerate Apache Iceberg and Parquet reads and writes, all while guaranteeing strict behavioral and numerical compatibility with vanilla Spark. Working alongside a team of open-source experts, including Apache Spark, DataFusion, and Iceberg committers, you will actively contribute that work back upstream. You will also profile and benchmark production workloads, optimizing memory, shuffle, and I/O to deploy Spark and Comet reliably across on-premises data centers and cloud environments. Your contributions will directly enhance the efficiency, resilience, and scale of systems powering services used by millions of people worldwide.
Responsibilities
What you will do and contribute to:
Design, test, and ship high-performance engine features and platform components that power Apple's big data workloads. Translate Apple-scale challenges into robust designs and contribute them upstream to projects such as Apache Spark and Apache DataFusion Comet. Actively participate in these open-source communities through upstream code contributions, code reviews, and architectural discussions. Partner across teams to build automation and monitoring that streamline deployment and triage. Optimize runtime efficiency, memory usage, and I/O so services scale reliably across data centers and cloud environments under growing load. Build clean, well-defined interfaces and abstractions that integrate native query execution seamlessly into broader data workflows and platform services.
You will join a collaborative team where your code directly shapes the efficiency, speed, and architectural future of Apple's data ecosystem
Minimum Qualifications 3+ years of professional software engineering experience. A proven track record of building distributed systems. Contributor or committer to Apache Spark and/or Apache DataFusion, Comet. BS, MS, or PhD in Computer Science or a related field, or equivalent practical experience.
Preferred Qualifications Experience with columnar or vectorized query execution, or with performance profiling and optimization of query engines. Good knowledge of Apache Iceberg and Apache Parquet internals. Experience working on or building Spark connectors to external data sources. Knowledge of Kubernetes, or other compute platforms.
Pay & Benefits At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $184,700 and $324,800, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
EEO Statement Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant
Accessibility At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here - in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.
Learn about accessibility in Apple’s workplace
Learn about reasonable accommodations for job applicants
Application Deadline Apple accepts applications to this posting on an ongoing basis.