Tech Lead, LLM Evaluation & Training Datasets

About The Company

Turing is a leading technology company dedicated to advancing artificial intelligence and software engineering. Renowned for its innovative approach, Turing specializes in building cutting-edge AI systems and providing top-tier remote engineering talent to organizations worldwide. The company's mission is to accelerate the deployment of powerful AI solutions that transform industries and improve lives. With a global network of highly skilled software engineers and researchers, Turing fosters a collaborative environment focused on innovation, excellence, and impactful technological advancements.

About The Role

We are seeking experienced software engineers at the tech lead level to join our dynamic team working on a pioneering project aimed at enhancing Large Language Model (LLM) evaluation and training datasets. This role involves working closely with our research and engineering teams to develop verifiable software engineering tasks based on public repository histories. The ideal candidate will have a strong background in software development, particularly with high-quality open-source projects, and will contribute directly to building datasets that enable LLMs to solve realistic software engineering problems. Responsibilities include automating development environments, triaging issues, assessing test coverage, and evaluating model performance in practical coding scenarios. This position offers an excellent opportunity to influence the future of AI-assisted software development while leading technical initiatives within the project.

Qualifications

• A minimum of 3+ years of professional experience in software engineering.
• Proficiency in JavaScript and TypeScript, with a solid understanding of their ecosystems.
• Hands-on experience with Git, Docker, and setting up software pipelines.
• Ability to comprehend and navigate complex codebases efficiently.
• Experience running, modifying, and testing real-world projects locally.

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• Experience contributing to or evaluating open-source projects is advantageous.
• Strong problem-solving skills and attention to detail.
• Excellent communication skills and ability to work collaboratively in a remote environment.
  
  

Responsibilities

• Analyze and triage issues reported on GitHub across popular open-source libraries.
• Set up and configure code repositories, including environment setup and Dockerization.
• Assess and improve unit test coverage and code quality.

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

• Modify and run codebases locally to evaluate the performance of LLMs in bug-fixing and code understanding tasks.
• Collaborate with research teams to identify repositories and issues that challenge LLM capabilities.
• Lead and mentor junior engineers working on related tasks and projects.
• Document processes, findings, and recommendations to facilitate ongoing project development.
  
  

Benefits

Joining Turing offers the flexibility of a fully remote work environment, enabling you to work from anywhere in the world. You will have the opportunity to engage with cutting-edge AI projects and collaborate with industry-leading LLM companies. This role provides a platform to enhance your skills in AI evaluation, software engineering, and open-source contributions. Additionally, Turing offers a supportive and innovative work culture that encourages professional growth and development. As part of our team, you will be at the forefront of shaping the future of AI-driven software development, gaining valuable experience and recognition in the tech industry.

Equal Opportunity

Turing is committed to creating an inclusive environment for all employees and applicants. We are an equal opportunity employer and do not discriminate based on race, gender, religion, age, sexual orientation, disability, or any other protected characteristic. We believe that diversity and inclusion foster innovation and excellence, and we welcome candidates from all backgrounds to apply and contribute to our mission of advancing AI technology for a better future.