Senior Software Engineer

HeyMilo is building the next-generation AI interviewing platform, enabling companies to conduct thousands of interviews in parallel while ensuring high-quality insights helping drive hiring decisions. We're looking for a Senior Software Engineer (Core Platform & AI Insights) to optimize the quality of our insights and analysis, ensuring that our AI generates accurate, high-value hiring recommendations. This role is not focused on UX or frontend, but rather on data quality, inference accuracy, and AI-driven insights at scale.

Who You Are

• Hold a Computer Science/Engineering degree from a top university in the U.S. or Canada
• 3+ years of software engineering experience including internships with at least 1+ years of experience with LLMs.
• AI & Data Expert – You understand how to extract meaningful insights from AI-generated data.
• Scalability & Observability Focused – You design systems that scale, ensuring fast response times and deep observability.
• API & Backend Architect – You know how to design and optimize APIs, ensuring clean handoffs to front-end teams.
• Strategic & Hands-On – You can delegate frontend work while also having the ability to jump in and build when needed.
• Eager and Hungry: You thrive in a fast-paced environment at a high-growth company that’s looking to lead in the conversational ai recruiting vertical.

What You’ll Do

• Optimize AI-generated insights to ensure high accuracy and relevance for hiring decisions.
• Build scalable AI pipelines that process thousands of interviews efficiently.
• Implement robust observability to track the performance and reliability of AI-driven insights.
• Architect high-performance APIs that integrate with AI workflows and hiring systems.
• Ensure seamless handoff of features to front-end engineers while maintaining flexibility to build UI components when necessary.
• Experiment with AI techniques, data embeddings, and ML-driven hiring models to improve platform intelligence.

Technical Expertise

• Backend: Python, FastAPI, Redis, ClickHouse, Airflow
• AI & ML: Prompt chaining, inference pipelines, vector databases (Pinecone)
• Scalability & Observability: High-throughput ML inference, OpenTelemetry, InfluxDB, PostHog
• Cloud & APIs: AWS, OpenAI, Gemini, Anthropic, ElevenLabs, Twilio

What’s In It for You

• Work on cutting-edge AI inference and prompt engineering challenges.
• Help shape how AI-powered hiring decisions are made at scale.
• Competitive salary, equity, and opportunities for growth in an AI-first company.