Senior Software Engineer - Large Language Model Evaluation and Training

About The Company

Turing is one of the world's fastest-growing artificial intelligence companies, dedicated to accelerating the development and deployment of advanced AI systems. Renowned for its innovative approach, Turing focuses on creating cutting-edge solutions that push the boundaries of AI capabilities. The company fosters a dynamic and collaborative environment, bringing together top talent from around the globe to work on transformative projects in artificial intelligence and software engineering. With a commitment to excellence and innovation, Turing aims to shape the future of AI-assisted technology across various industries.

About The Role

We are seeking experienced software engineers at the tech lead level to join our groundbreaking project focused on building large language model (LLM) evaluation and training datasets tailored for realistic software engineering problems. The ideal candidate will possess a deep understanding of high-quality public GitHub repositories and have a proven track record in software development and project management. This role involves direct hands-on work, including automating development environments, triaging issues, and assessing test coverage and code quality. The primary goal is to contribute to the creation of verifiable software engineering tasks based on public repository histories, utilizing a synthetic, human-in-the-loop approach. You will have the opportunity to influence how LLMs interact with real code, impacting the future of AI-driven software development.

Qualifications

Candidates should possess a minimum of three years of professional experience in software engineering, with a strong emphasis on JavaScript and TypeScript. Proficiency in version control systems like Git and containerization tools such as Docker is essential, along with experience setting up and automating software pipelines. The ability to navigate and understand complex codebases, modify code, and run projects locally is crucial. Prior experience contributing to or evaluating open-source projects is highly valued. Additionally, familiarity with AI research, LLM evaluation, or developer tools will be considered advantageous.

Responsibilities

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• Analyze and triage GitHub issues across trending open-source libraries to identify challenging problems for LLMs.
• Set up and configure development environments, including Dockerization and environment automation.
• Evaluate unit test coverage and code quality to ensure dataset robustness.
• Modify and run codebases locally to assess the performance of LLMs in bug-fixing and code understanding scenarios.
• Collaborate with research teams to design and select repositories and issues that provide meaningful evaluation challenges.
• Lead and mentor junior engineers, fostering a collaborative team environment.

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

• Contribute to the continuous improvement of dataset quality and project workflows.
  
  

Benefits

Joining Turing offers the flexibility of working in a fully remote environment, enabling you to balance your professional and personal life effectively. You will have the opportunity to work on cutting-edge AI projects alongside leading LLM companies, gaining invaluable experience in the rapidly evolving field of artificial intelligence. Turing provides a platform to develop your skills further, collaborate with a global team of experts, and contribute to innovative solutions that shape the future of AI-assisted software engineering. While this role is a contractor position without medical or paid leave, it offers substantial professional growth and exposure to high-impact projects.

Equal Opportunity

Turing is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees and contractors. We do not discriminate based on race, religion, gender, sexual orientation, age, disability, or any other characteristic protected by law. We believe that diverse teams drive innovation and excellence, and we welcome applicants from all backgrounds to apply and contribute to our mission of advancing AI technology.