OCI (Oracle Cloud Infrastructure) AI Infrastructure is at the forefront of building a cutting-edge, ultra-high-performance GPU platforms designed to support AI/ML/HPC workloads. This is your chance to be part of the AI revolution, creating systems that allow customers to scale from tens to thousands of GPUs without compromising performance.
Our team is responsible for designing and developing fundamental architectural changes for GPU delivery, health monitoring, testing, triage automation, and diagnostic services. These are essential for running distributed AI/ML/HPC workloads across thousands of GPUs, leveraging technologies like RoCE and Infiniband.
As a Lead Principal Core Infrastructure Engineer, you will own the software design and development for major components of Oracle's Cloud Infrastructure. You should be both a rock-solid lead developer, curious problem solver, a distributed systems generalist and/or skilled Linux engineer with Systems triage experience able to dive deep into any part of the stack and low-level systems to design broad distributed system interactions. You should value simplicity and scale, work comfortably in a collaborative, agile environment, and be excited to learn.
This role resides within the Compute AI Infrastructure In-Band Engineering team, which owns the critical infrastructure responsible for automated testing of new platform shapes (AMD/Intel/Arm/Nvidia), hardware bring-up, configuration, benchmarking, and debugging. The services operate at the intersection of bare metal hardware and full-stack orchestration frameworks, a unique combination where both distributed systems engineers and engineers with background in Linux and firmware are highly valued. The team interfaces directly with multiple components like OCI APIs and services, NICs, SmartNICs, ILOMs, and GPUs. The team builds high performance, scalable services and tooling that launch, configure, test, and validate server platforms across OCI’s massive fleet of Compute and GPU Infrastructure. You will partner closely across other teams in Compute, Networking, Security, Data Center Engineering, and Hardware Development to ensure OCI can launch, scale, and maintain new server platforms with minimal operational overhead and high reliability. You will work directly with cutting edge GPU hardware and see the direct impact of your work on the business.
We strive for equity, inclusion, and respect for all. We are committed to the greater good in our products and our actions. We are constantly learning and taking opportunities to grow our careers and ourselves. We challenge each other to stretch beyond our past to build our future. You are the builder here. You will be part of a team of really smart, motivated, and diverse people and given the autonomy and support to do your best work. It is a dynamic and flexible workplace where you’ll belong and be encouraged. If you are interested in building large-scale distributed infrastructure for the cloud, want to work on cutting edge GPU infrastructure and the latest Compute systems, have a knack for distributed systems and/or Linux development with Systems experience then this is your team! Oracle is aggressively investing in the Oracle Cloud to provide the broadest, most comprehensive cloud in the industry. Minimum Qualifications
- BS or MS degree in Computer Science or relevant technical field involving coding or equivalent practical experience
- Deep understanding of operating systems, computer networks, and high-performance applications
- 6 plus years’ experience delivering and operating large-scale production systems (1000's server instances)
- Proficient in multiple programming languages (java/python/c/c+/goLang/shell scripting)
- Systematic problem-solving approach, strong communication skills, a sense of ownership, and drive
- Proven ability to deliver products and experience with the full software development lifecycle
Preferred Qualifications
- Strong background in Linux systems
- Familiarity with system-level architecture, data synchronization, fault tolerance, and state management
- General enterprise storage, networking, or computing experience
- Experience with Server/GPU hardware architecture and system management
- Experience with Infiniband or RoCE networking technologies
- Hands-on experience designing, developing, and operating public cloud service data planes
Key Responsibilities
System Design & Architecture - System Scalability:
–Mentor the team in the architecture and design of highly scalable, interdependent distributed systems, ensuring horizontal and vertical scalability and overall performance, including leveraging distributed state management tools. –Lead the identification of performance and scalability bottlenecks and recommend solutions to optimize code and/or systems for large-scale data processing and high-throughput requirements to improve performance for hyper-scale systems. –Lead collaboration with stakeholders to define system scalability requirements, ensuring the defined requirements meet customer expectations. –Leverage deep expertise to design high-impact, interdependent systems to scale with elasticity (e.g., effectively scaling both up and down). –Drive innovation in the use of data plane platforms. –Evaluate whether systems are meeting nonfunctional scalability requirements, and proactively anticipate growing business needs within the business unit.
System Design & Architecture - System Reliability Design:
–Design and oversee the implementation of fault-tolerant, interdependent systems capable of withstanding in-service updates by implementing sophisticated redundancy, replication, and automatic failover capabilities. –Lead the design and implementation of systems that effectively handle service disruptions (e.g., network partitions) by prioritizing consistency, availability, or partition tolerance. –Guide the optimization of advanced mechanisms to handle network unreliability, including load-shedding, throttling, and rate-limiting. –Design interdependent systems that are durable and adhere to service level objectives (SLOs), driving standards for availability and durability of other computing services within the organization
System Design & Architecture - System Reliability Performance:
–Define key performance indicators (KPIs) and telemetry to identify risks, gaps, or cyclical dependencies in running, interdependent systems. –Drive the creation and customization of highly complex dashboards, telemetry systems, and alerting mechanisms, proactively ensuring system health and reliability.
System Design & Architecture - Correctness / Availability:
–Maintain expertise in industry standards for verifying correctness and apply existing techniques to interdependent systems. –Formally verify complex features (e.g., via TLA+) to ensure system design correctness for various interdependent systems. –Develop advanced strategies for data replication and synchronization, ensuring robust data integrity and availability
Operational Troubleshooting & Incident Management:
–Advise on efforts to diagnose, debug, and resolve complex issues in active, interdependent systems to support ongoing operation. –Develop and implement comprehensive strategies to prevent interruptions, ensuring no maintenance windows are required for customers and users when resolving issues. –Maintain expertise in dependencies, dependents, and owned systems to drive effective troubleshooting and performance. –Set standards for operational readiness and standard operating procedures within the department, and hold third-party partners accountable for meeting those standards. –Oversee operational support rotations, providing expert guidance in incident response and leading root cause investigations to prevent future occurrences.
Compliance & Security:
–Architect advanced security measures to protect data and applications in multi-tenant environments, and lead initiatives to enhance data and application protection. –Guide the execution of comprehensive remediation plans to address identified security vulnerabilities. –Ensure cloud infrastructure is in compliance with industry standards and regulations, and guide documentation efforts across projects.
Automation & Change Management:
–Develop enterprise-level automation tools and strategies (e.g., Infrastructure as Code (IaC)) and oversee their implementation. –Drive alignment of change management plans and organizational initiatives for patching, updating, and rolling back applications, and design interdependent systems to allow for automation of these processes. Core Responsibilities
Planning & Execution:
–Manages and provides direction on timelines, deliverables, and budgets when applicable for critical high-impact projects or initiatives that impact the line of business, ensuring timely completion and adherence to requirements. Anticipates and plans for shifts in resources or timelines based on changing business priorities, ensuring optimal outcomes.
Collaboration & Partnership:
–Influences cross-functional leaders and external stakeholders to gain alignment on strategic objectives. Fosters partnerships with key business leaders, stakeholders, and/or customers, identifying opportunities for expanding partnerships and promoting long-term organizational success. Champions transparency and inclusivity by actively seeking, listening to, and incorporating diverse perspectives.
Problem Solving:
–Leads specialized, advanced problem-solving efforts, serving as an escalation point for complex issues. Guides others to leverage innovative data-driven techniques to address ambiguous or novel issues, identify root causes, and drives the implementation of solutions that prevent future issues.
Continuous Learning:
–Leverages deep industry knowledge and expertise to serve as a thought leader within the organization. Contributes to the advancement of the field or industry through thought leadership (e.g., conference presentations, white papers, research contributions). Maintains and evolves expertise in relevant areas by proactively monitoring emerging trends, technologies, and industry standards, ensuring the organization remains current with best practices. Champions continuous learning and knowledge sharing, promoting professional development across teams. Applies new knowledge to drive advancement and mentors others to do the same.
Continuous Improvement:
–Develops innovative solutions and drives the implementation of ideas that increase the efficiency and effectiveness of processes, protocols, and workflows across the organization. Evaluates effectiveness of updated approaches and methods for continued improvement to enhance efficiencies and ensure changes align with organizational goals. Designs and develops metrics to measure success of improvement initiatives.
Performance and Development:
–Serves as a subject matter expert regarding talent needs and organizational talent strategy. Imparts leadership and expert knowledge throughout the talent development pipeline including candidate interviews, candidate assessment, and hiring decisions, ensuring alignment with organizational talent strategy. Minimum Job Qualifications
Education and/or Experience:
15 years of experience in software development OR Bachelor's of Technology (B.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 11 years of experience in software development OR Bachelor's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 11 years of experience in software development OR Master's of Technology (M.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 9 years of experience in software development OR Master's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 9 years of experience in software development OR Doctorate in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 7 year of experience in software development.
Job Skills:
Same skills as prior level plus; Data Management: Demonstrated ability in or knowledge of data management, including designing, operationalizing, securing, and monitoring data pipelines. Data Integration: Demonstrated ability in or knowledge of data integration, including specifying and using services to load and manage data from various sources.
Cloud - Cloud Platforms Experience:
5 year of academic or professional experience with cloud platforms (e.g., AWS, Azure, Google, Oracle Cloud).
Testing and Automation Experience:
10 years of experience working in testing and automation at the system level.
Distributed Systems Experience:
4 year of experience working with delivering and operating large-scale distributed systems. Preferred Job Qualifications
Education and/or Experience:
16 years of experience in software development OR Bachelor's of Technology (B.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 12 years of experience in software development OR Bachelor's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 12 years of experience in software development OR Master's of Technology (M.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 10 years of experience in software development OR Master's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 10 years of experience in software development OR Doctorate in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 8 years of experience in software development.
People Leadership / Management Experience:
5 year of experience with cloud platforms (e.g., AWS, Azure, Google, Oracle Cloud).
Disclaimer:
Certain U.S. based or U.S. customer or client-facing roles may be required to comply with applicable requirements, such as immunization/occupational health mandates, and/or drug testing requirements.
Range and benefit information provided in this posting are specific to the stated locations only
US: Hiring Range in USD from: $146,300 to $306,400 per annum. May be eligible for bonus, equity, and compensation deferral.
Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle's differing products, industries and lines of business. Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.
Oracle US offers a comprehensive benefits package which includes the following:
- Medical, dental, and vision insurance, including expert medical opinion
- Short term disability and long term disability
- Life insurance and AD&D
- Supplemental life insurance (Employee/Spouse/Child)
- Health care and dependent care Flexible Spending Accounts
- Pre-tax commuter and parking benefits
- 401(k) Savings and Investment Plan with company match
- Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
- 11 paid holidays
- Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
- Paid parental leave
- Adoption assistance
- Employee Stock Purchase Plan
- Financial planning and group legal
- Voluntary benefits including auto, homeowner and pet insurance
The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted. As part of Oracle's onboarding process and consistent with applicable law, US-based employees are required to complete identity verification, which involves the collection and processing of their biometric information. Accommodations to this requirement may be granted following an individualized assessment.
Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives.
True innovation starts when everyone is empowered to contribute. That’s why we’re committed to growing a workforce that promotes opportunities for all with competitive benefits that support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.
We’re committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing accommodation-request_mb@oracle.com or by calling 1-888-404-2494 in the United States.
Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.