This role is for one of our clients Compensation: $80 - $120 per hour
Employment Type: W-2 Employment Work Commitment: Minimum 20 hours per week. Availability: Consistent availability during weekdays. Work Focus: AI model training, software engineering task development, code evaluation, reference solution creation, and technical feedback.
We are seeking experienced Software Engineers to contribute to the development, training, and evaluation of next-generation Generative AI models. This role offers an opportunity to leverage strong software engineering expertise to improve the accuracy, reliability, and problem-solving capabilities of advanced AI systems. The ideal candidate should have extensive hands-on experience in production software development, with strong proficiency in Python and at least one additional programming language such as Java, C++, Go, or Rust. A solid understanding of algorithms, data structures, backend engineering, systems design, and software development best practices is essential. The role involves creating complex programming challenges, developing reference solutions, evaluating AI-generated code, and providing expert technical feedback to improve AI model performance across real-world software engineering scenarios. This is a W-2 employment opportunity with the possibility of working as part of the extended workforce of a leading AI research organisation.
Requirements
Key Responsibilities
A. AI Model Training & Technical Expertise
- Collaborate with AI research and engineering teams to identify technical knowledge gaps and improve AI model performance across software engineering, programming, algorithms, and systems design.
- Apply practical software development experience to assess the accuracy, efficiency, and reliability of AI-generated code.
- Provide expert guidance on programming concepts, backend development, system architecture, and engineering best practices.
- Help improve AI models' ability to solve complex software engineering problems through structured training and evaluation.
B. Technical Task Development & Solution Design
- Design challenging, domain-specific programming tasks covering software engineering, algorithms, data structures, and backend development.
- Develop accurate, efficient, and well-documented reference solutions for complex coding problems.
- Create realistic multi-file coding assignments that reflect production-level software development scenarios.
- Write, review, and debug code across Python and other programming languages, including Java, C++, Go, and Rust.
- Develop unit tests and validation frameworks to ensure solutions execute correctly and meet defined requirements.
C. Code Review & Technical Evaluation
- Evaluate AI-generated code for correctness, efficiency, readability, maintainability, and adherence to software engineering standards.
- Review and debug complex coding solutions, identifying logical errors, performance issues, and architectural weaknesses.
- Assess code quality, test coverage, error handling, and implementation approaches.
- Provide clear, detailed, and actionable technical feedback to improve AI-generated programming outputs.
- Evaluate different approaches to solving engineering problems and assess their practical trade-offs.
D. Evaluation Framework & Benchmark Development
- Develop structured evaluation rubrics to assess programming accuracy, code quality, design decisions, and test coverage.
- Establish benchmarks for algorithms, data structures, backend systems, and production software engineering tasks.
- Create comprehensive test cases to evaluate the reliability and robustness of AI-generated solutions.
- Collaborate with other software engineering experts to ensure consistency, accuracy, and quality across AI training datasets.
E. Engineering Collaboration
- Work closely with AI researchers, software engineers, and other subject matter experts.
- Participate in technical discussions, code reviews, and solution validation exercises.
- Ensure that technical tasks and reference solutions reflect industry-standard software development practices.
- Contribute domain expertise to improve the overall quality of AI training and evaluation processes.
Must-Have Skills & Qualifications
- 4+ years of professional experience in Software Engineering or Software Development.
- Strong production-level proficiency in Python.
- Hands-on expertise in at least one additional programming language: Java, C++, Go, or Rust.
- Strong understanding of Data Structures and Algorithms (DSA).
- Experience in backend development, systems programming, and software architecture.
- Hands-on experience with Git, version control workflows, code reviews, and collaborative development.
- Strong understanding of automated testing, unit testing, debugging, and Continuous Integration (CI).
- Experience developing, reviewing, and maintaining production-grade software applications.
- Demonstrated professional growth and increasing ownership of software engineering responsibilities.
- Excellent written communication skills and the ability to explain complex technical concepts clearly.
Good-to-Have Skills
- Experience designing scalable backend systems and distributed architectures.
- Knowledge of microservices, APIs, and system design principles.
- Experience with performance optimisation and debugging complex applications.
- Familiarity with test automation frameworks and CI/CD pipelines.
- Exposure to AI/ML development, generative AI, or large language model evaluation.
- Experience in technical mentoring, documentation, code reviews, or engineering assessments.
- Previous experience creating coding challenges, technical benchmarks, or reference implementations.
Preferred Candidate Profile The ideal candidate is a technically strong Software Engineer with substantial production development experience and expertise in Python alongside Java, C++, Go, or Rust.