Senior Software Engineer

About the role Join our small and nimble engineering team! We’re looking for an experienced engineer who enjoys working on a variety of different projects and large(ish) data pipelines (100M+ data points collected every month).

• Work in our downtown San Francisco office a few times per week
• Provide mentorship to your teammates via code and architecture review
• Help to improve, maintain and expand our end to end data pipeline
• Create and manage data collection/crawling scripts that utilize everything from basic HTTP requests to browser and mobile app automation (deep experience in this area is a huge plus)
• Build and maintain automation/scheduling tooling to ensure data is collected on a timely and consistent basis (we’re currently using self hosted Dagster for scheduling)
• Create data cleaning and normalization scripts (with some opportunity to integrate ML/LLMs for labeling/cleaning)
• Help with miscellaneous DevOps tasks to help manage the infrastructure running all the above
• Our codebase is mostly Python with Typescript and Golang used when they make sense. We almost entirely rely on self hosted open source/core services on bare VMs via docker compose.

About you

• Proficient (intermediate or higher) in:
• Python (e.g. can write a decorator, understand async/await, MRO, contextmanagers)
• SQL (e.g. familiar with complex joins, efficiently bulk update 10k+ rows, schema migrations)
• Basic understanding of Linux and Docker
• Excited to work on a variety of different projects, sometimes many at the same time
• Able to execute with minimal supervision
• Bonus skills: Web Crawling, Kubernetes, LLM Pipelines, DB Administration, HomeLab/Server Administration, Background in Statistics, Full Stack Web Development, Mobile App Development

Benefits

• Lunch provided when in office
• Unlimited PTO
• 401k
• Company paid Platinum PPO health and comparable dental & vision insurance
• $160K - $220K salary, 0.5% - 3% equity

About the interview

• 15 minute call with CTO about the position, your experience, and career goals
• 1st 30 minute technical screening call (coding interview)
• 2nd 30 minute technical screening call (coding interview)
• Onsite at our office to further review your skills, learn more about us, and to get a feel for how we’d work together
• Offer extended