Tech Lead, LLM Evaluation & Training Datasets

About The Company

Turing is a leading technology company dedicated to advancing artificial intelligence and machine learning capabilities. Renowned for its innovative approach, Turing specializes in developing cutting-edge AI solutions that transform industries and empower organizations worldwide. The company boasts a dynamic and diverse team of experts committed to pushing the boundaries of what AI can achieve. With a focus on research, development, and real-world application, Turing aims to create impactful technologies that improve productivity, efficiency, and decision-making across various sectors.

About The Role

We are seeking experienced software engineers at the tech lead level to join our strategic project focused on building large language model (LLM) evaluation and training datasets. This role is pivotal in supporting the development of verifiable software engineering tasks derived from public repositories, with a synthetic approach that incorporates human-in-the-loop methodologies. The ideal candidate will have a strong background in working with high-quality open-source projects, particularly from GitHub, and will play a hands-on role in automating development environments, triaging issues, and assessing test coverage and code quality. This position offers a unique opportunity to contribute directly to the future of AI-assisted software development while working on challenging real-world problems.

Qualifications

The successful candidate will possess a minimum of three years of professional experience in software engineering, with a proven track record in managing complex codebases and contributing to open-source projects. Proficiency in JavaScript and TypeScript is essential, along with a solid understanding of Git, Docker, and software pipeline setup. Candidates should demonstrate the ability to understand, modify, and test real-world code locally, as well as experience in environment automation. Previous involvement in LLM research, evaluation projects, or the development of developer tools is considered a plus. Strong problem-solving skills, attention to detail, and the ability to work collaboratively in a remote setting are also required.

Responsibilities

• Analyze and triage issues reported on GitHub across trending open-source libraries, identifying challenges for LLMs.
• Set up and configure code repositories, including Dockerization and environment management, to facilitate testing and evaluation.
• Evaluate unit test coverage and code quality, providing insights to improve robustness and reliability.
• Modify and run codebases locally to assess the performance of LLMs in bug-fixing and code understanding tasks.
• Collaborate with research teams to design, identify, and prioritize repositories and issues that are suitable for LLM evaluation.
• Lead or mentor junior engineers, fostering a collaborative and innovative team environment.
  
  

  Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Benefits

Joining Turing provides the opportunity to work remotely with a globally distributed team on pioneering AI projects. You will have access to a flexible work schedule, enabling a healthy work-life balance. The role offers exposure to cutting-edge developments in AI and software engineering, providing valuable experience and professional growth. You will also be part of a forward-thinking organization that values innovation, diversity, and inclusion. Additionally, Turing supports your career development through continuous learning opportunities and engagement with industry-leading experts in AI and machine learning.

Equal Opportunity

Turing is committed to fostering an inclusive and diverse work environment. We believe in equal employment opportunities regardless of race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or any other protected status. We encourage candidates from all backgrounds to apply and join our mission to shape the future of AI technology.