General Information
Job Name
Senior staff AI/HPC Infrastructure Engineer
Country/Region
United States of America
State
California
City
Milpitas
Work Location
Milpitas Office
Work Mode
Employees work on-site
Salary Range
$179,700.00 - $305,500.00
Exemption Status
Exempt
Business Function
Software Engineering
Employment Type
Full-time
Sandisk understands how people and businesses consume data and we relentlessly innovate to deliver solutions that enable today’s needs and tomorrow’s next big ideas. With a rich history of groundbreaking innovations in Flash and advanced memory technologies, our solutions have become the beating heart of the digital world we’re living in and that we have the power to shape.
Sandisk meets people and businesses at the intersection of their aspirations and the moment, enabling them to keep moving and pushing possibility forward. We do this through the balance of our powerhouse manufacturing capabilities and our industry-leading portfolio of products that are recognized globally for innovation, performance and quality.
Sandisk has two facilities recognized by the World Economic Forum as part of the Global Lighthouse Network for advanced 4IR innovations. These facilities were also recognized as Sustainability Lighthouses for breakthroughs in efficient operations. With our global reach, we ensure the global supply chain has access to the Flash memory it needs to keep our world moving forward.
Description
The AI/HPC Infrastructure Engineer will modify and operate advanced GPU computing platforms for AI training, inference, and memory-system research. The engineer will work at the intersection of AI infrastructure, LLM serving, memory architecture, storage systems, and AI workload characterization. The role supports development of next-generation HBF, SSD, and memory-centric AI systems through hardware/software co-design and real-world AI workload analysis.
Essential Duties and Responsibilities:
Build and Modify AI/HPC Research Infrastructure
- Build AI testbeds supporting 8-100+ GPU environments
- Manage server, networking, storage, and software infrastructure
- Support cloud-scale and edge-AI deployment models
- Develop benchmarking and validation environments for emerging AI workloads
Deploy and Optimize LLM Serving Platforms
- Install and optimize:
- vLLM
- NVIDIA Dynamo
- TensorRT-LLM
- Triton Inference Server
- SGLang
- Support distributed inference and agentic AI workloads
- Optimize latency, throughput, and GPU utilization
- Evaluate inference cost and scalability across different architectures
AI Workload Characterization
- Capture workload traces from training and inference platforms
- Analyze:
- Memory bandwidth
- KV-cache growth
- Storage access patterns
- Network traffic
- Develop forecasting models for future memory such as HBF and storage requirements
- Generate insights that guide next-generation memory product development
AI Memory and Storage Architecture Evaluation
- Evaluate system bottlenecks across:
- SSD
- Networking
- GPU interconnects
- Prototype new memory-system architectures
- Study disaggregated memory and storage approaches
- Validate AI infrastructure benefits of future SANDISK technologies
Digital Twin and Simulation
- Build simulation environments for AI systems
- Develop digital-twin platforms based on real workload traces
- Model future AI infrastructure configurations
- Evaluate performance of future HBM, SSD, and memory products before silicon availability
Research and Ecosystem Collaboration
- Collaborate with:
- Universities
- Startup companies
- National laboratories
- Cloud service providers
- System OEMs
- Jointly evaluate emerging AI infrastructure architectures
- Publish technical papers and contribute to industry standards
Required:
AI Infrastructure
- Linux
- Kubernetes
- Docker
- Slurm
- Python
- GPU cluster administration
- Distributed systems engineering
AI Serving
- vLLM
- NVIDIA Dynamo
- TensorRT-LLM
- Triton
- SGLang
- Agentic AI frameworks
- RAG systems
Networking and Scale-Out Systems
- InfiniBand
- RoCE
- RDMA
- NCCL
- Multi-node inference
- Distributed AI clusters
(These are not explicitly listed in all openings but are highly relevant to the AI/HPC infrastructure responsibilities described in the positions.)
AI System Architecture
- AI accelerator architecture
- Memory hierarchy optimization
- SSD architecture
- Storage-memory co-design
- AI performance modeling
- Hardware/software co-design
What SANDISK Would Likely Expect
The AI/HPC engineer is expected to do three things simultaneously:
- Operate advanced AI infrastructure.
- Understand AI workloads deeply enough to identify memory and storage bottlenecks.
- Translate those findings into future SSD, HBF, and AI-memory product requirements.
For the AI lab, the ideal candidate would be someone who has hands-on experience with vLLM, Dynamo, Ray, RDMA, KV-cache optimization, GPU clusters, and AI performance characterization , because that person can both run the infrastructure and provide direct feedback for future memory-system innovation.
Compensation & Benefits
- An employee’s pay position within the salary range may be based on several factors including but not limited to (1) relevant education; qualifications; certifications; and experience; (2) skills, ability, knowledge of the job; (3) performance, contribution and results; (4) geographic location; (5) shift; (6) internal and external equity; and (7) business and organizational needs.
- The salary range is what we believe to be the range of possible compensation for this role at the time of this posting. We may ultimately pay more or less than the posted range and this range is only applicable for jobs to be performed in California, Colorado, New York or remote jobs that can be performed in California, Colorado and New York. This range may be modified in the future.
- You will be eligible to participate in Sandisk's Short-Term Incentive (STI) Plan, which provides incentive awards based on Company and individual performance. Depending on your role and your performance, you may be eligible to participate in our annual Long-Term Incentive (LTI) program, which consists of restricted stock units (RSUs) or cash equivalents, pursuant to the terms of the LTI plan. Please note that not all roles are eligible to participate in the LTI program, and not all roles are eligible for equity under the LTI plan. RSU awards are also available to eligible new hires, subject to Sandisk's Standard Terms and Conditions for Restricted Stock Unit Awards.
- We offer a comprehensive package of benefits including paid vacation time; paid sick leave; medical/dental/vision insurance; life, accident and disability insurance; tax-advantaged flexible spending and health savings accounts; employee assistance program; other voluntary benefit programs such as supplemental life and AD&D, legal plan, pet insurance, critical illness, accident and hospital indemnity; tuition reimbursement; transit; the Applause Program, employee stock purchase plan, and the Sandisk's Savings 401(k) Plan.
- Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, benefits, or any other form of compensation and benefits that are allocable to a particular employee remains in the Company's sole discretion unless and until paid and may be modified at the Company’s sole discretion, consistent with the law.
Additional Information
Sandisk is committed to providing equal opportunities to all applicants and employees and will not discriminate based on their race, color, ancestry, religion (including religious dress and grooming standards), sex (including pregnancy, childbirth or related medical conditions, breastfeeding or related medical conditions), gender (including a person’s gender identity, gender expression, and gender-related appearance and behavior, whether or not stereotypically associated with the person’s assigned sex at birth), age, national origin, sexual orientation, medical condition, marital status (including domestic partnership status), physical disability, mental disability, medical condition, genetic information, protected medical and family care leave, Civil Air Patrol status, military and veteran status, or other legally protected characteristics. We also prohibit harassment of any individual on any of the characteristics listed above. Our non-discrimination policy applies to all aspects of employment. We comply with the laws and regulations set forth in the Equal Employment Opportunity is the Law (https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12.pdf) poster.
Sandisk thrives on the power and potential of diversity. As a global company, we believe the most effective way to embrace the diversity of our customers and communities is to mirror it from within. We believe the fusion of various perspectives results in the best outcomes for our employees, our company, our customers, and the world around us. We are committed to an inclusive environment where every individual can thrive through a sense of belonging, respect and contribution.
Sandisk is committed to offering opportunities to applicants with disabilities and ensuring all candidates can successfully navigate our careers website and our hiring process. Please contact us at jobs.accommodations@sandisk.com to advise us of your accommodation request. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.