Senior Software Engineer - Large Language Model Evaluation and Training Datasets

About The Company

Founded on the principles of innovation and technological excellence, Turing is one of the world's fastest-growing AI companies dedicated to advancing the capabilities and deployment of powerful artificial intelligence systems. With a focus on cutting-edge research and practical applications, Turing aims to shape the future of AI-driven solutions across various industries. The company fosters a collaborative environment that encourages creativity, continuous learning, and impactful contributions to the AI community. By working at Turing, employees have the opportunity to be part of transformative projects that push the boundaries of what artificial intelligence can achieve.

About The Role

We are seeking experienced software engineers at the tech lead level to join our innovative team working on large language model (LLM) evaluation and training datasets. This role involves hands-on development work focused on building datasets to improve LLM performance on realistic software engineering tasks. The ideal candidate will have a strong background in analyzing and working with high-quality public GitHub repositories, automating development environments, and assessing code quality and test coverage. You will play a pivotal role in designing and executing tasks that enable LLMs to better understand and interact with real-world codebases, thereby contributing to the advancement of AI-assisted software development. This position offers an exciting opportunity to lead technical efforts, collaborate with researchers, and influence the future of AI and software engineering integration.

Qualifications

The ideal candidate should possess a minimum of three years of professional experience in software engineering, with demonstrated expertise in at least one of the following programming languages: Rust. Proficiency with version control systems such as Git, containerization tools like Docker, and experience setting up and automating software development pipelines are essential. Candidates must be comfortable navigating complex codebases, running, modifying, and testing real-world projects locally, and contributing to open-source initiatives. Experience with public repositories on GitHub, issue triaging, and evaluating code quality will be highly valued. Additional experience in LLM research, automation tools, or developer tools development is considered a plus.

Responsibilities

• Analyze and triage issues across trending open-source repositories on GitHub to identify challenging tasks for LLM evaluation.
• Set up and configure development environments, including Dockerization and environment automation, to facilitate efficient testing and evaluation.
• Assess unit test coverage and quality, providing insights to improve dataset robustness and model performance.
• Modify, run, and debug codebases locally to simulate bug-fixing scenarios and evaluate LLM effectiveness.
• Collaborate with research teams to identify repositories and issues that pose challenges for LLMs, contributing to dataset expansion and refinement.
• Lead and mentor junior engineers, fostering a collaborative team environment focused on innovative solutions.
  
  

  Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Benefits

Joining Turing offers the flexibility of working in a fully remote environment, enabling you to balance your professional and personal life effectively. You will have the opportunity to work on cutting-edge AI projects with leading LLM companies, gaining valuable experience at the forefront of AI research and development. Turing provides a dynamic work environment that encourages continuous learning and professional growth. As part of our team, you will be involved in impactful projects that influence the future of AI-assisted software engineering, while enjoying a flexible schedule tailored to your availability. Additionally, freelancers benefit from the ability to choose their preferred workload, with options for 20, 30, or 40 hours per week.

Equal Opportunity

Turing is committed to fostering an inclusive and diverse workplace. We provide equal employment opportunities to all applicants and employees regardless of race, color, religion, gender, sexual orientation, national origin, age, disability, or any other protected status. We believe that a diverse team enhances innovation and creativity, and we are dedicated to creating a work environment where everyone feels valued and empowered to contribute their best.