Tech Lead, Large Language Model (LLM) Evaluation and Training Datasets

About The Company

Turing is a leading technology company dedicated to advancing the field of artificial intelligence and machine learning. Renowned for its innovative approach to AI research and development, Turing specializes in creating powerful AI systems that are transforming industries worldwide. The company prides itself on fostering a dynamic and inclusive work environment that encourages creativity, collaboration, and continuous learning. With a global footprint and a commitment to excellence, Turing is at the forefront of developing cutting-edge solutions that push the boundaries of what AI can achieve.

About The Role

We are seeking highly skilled and experienced software engineers at the tech lead level to join our team working on large language model (LLM) evaluation and training datasets. This role involves direct hands-on contributions to building datasets that enable LLMs to effectively handle realistic software engineering tasks. The ideal candidate will have a strong background in working with high-quality public GitHub repositories and possess the ability to automate development environments, triage issues, and evaluate code coverage and quality. This position offers a unique opportunity to influence the future of AI-assisted software development by working on projects that bridge practical software engineering with innovative AI research.

Qualifications

The ideal candidate will have a minimum of three years of professional experience in software engineering, with proficiency in at least one of the following programming languages: C++. Candidates should be well-versed in version control systems like Git, containerization tools such as Docker, and familiar with setting up and managing software pipelines. Experience navigating complex codebases and modifying codebases locally is essential. Additionally, prior experience contributing to or evaluating open-source projects is considered a strong plus. Candidates should demonstrate excellent problem-solving skills, attention to detail, and the ability to work independently and collaboratively in a remote setting.

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries to identify challenging tasks for LLMs.
• Set up and configure code repositories, including Dockerization and environment setup, to facilitate testing and evaluation.
• Assess unit test coverage and quality, providing insights to improve dataset robustness.
• Modify and run codebases locally to evaluate LLM performance in bug-fixing and code understanding scenarios.
• Collaborate closely with research teams to design and select repositories and issues that effectively test LLM capabilities.
• Lead and mentor junior engineers, fostering a collaborative environment and ensuring high-quality deliverables.
  
  

  Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Benefits

Joining Turing offers the opportunity to work remotely from anywhere in the world, providing flexibility and work-life balance. You will be part of a pioneering team working on some of the most exciting AI projects, gaining exposure to state-of-the-art technologies and methodologies. Turing values professional growth and provides a stimulating environment where engineers can enhance their skills through collaboration with top-tier researchers and developers. Additionally, you will have access to a network of innovative AI companies and projects, opening avenues for future career advancement and specialization.

Equal Opportunity

Turing is committed to creating an inclusive environment where all employees and applicants are treated with respect and fairness. We are proud to be an equal opportunity employer and do not discriminate based on race, gender, religion, age, sexual orientation, gender identity, disability, or any other protected characteristic. Our hiring practices are designed to promote diversity and ensure that every individual has the opportunity to contribute and succeed within our organization.