Research Scientist Intern, TPU(PhD)

Summary:

The PyTorch TPU team focuses on enabling efficient and accurate inference of 1P models directly on TPU. The work spans performance modeling, sharding and parallelism design, kernel authoring and automating with agents.Our internships are twelve (12) to twenty four (24) weeks long, and we have various start dates throughout the year.

Required Skills:

Research Scientist Intern, TPU(PhD) Responsibilities:

• Develop, evaluate methodologies and systems for running LLM/Multi-modality models cost-effectively on TPU systems.
• Analyze and extract insights from traffic pattern to derive computational intrinsics that can be leveraged into actions in system and kernel optimization.

Minimum Qualifications:

Minimum Qualifications:

• Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment
• Proficient in Python
• Experience with system and kernel optimization

Preferred Qualifications:

Preferred Qualifications:

• Experience with GPU/TPU/ASICs
• Experience with Triton, Cuda, Cutedsl, Pallas
• Familiarity with performance modeling

Public Compensation:

$7,650/month to $12,667/month + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.