Tech Lead, LLM Dataset Engineering (Remote)

agilegrid solutions • India
Remote
Apply
AI Summary

Seeking experienced Tech Lead Software Engineers for a remote role focused on building LLM evaluation and training datasets for software engineering problems. Responsibilities include analyzing GitHub repos, automating development environments, and assessing test case quality. Requires 3+ years of experience, proficiency in JavaScript/TypeScript, Git, and Docker.

Key Highlights
Build LLM evaluation and training datasets for realistic software engineering problems.
Analyze and triage GitHub issues, automate development environments, and assess test quality.
Opportunity to lead junior engineers and work at the forefront of AI and software engineering integration.
Key Responsibilities
Analyze and triage GitHub issues across trending open-source libraries to identify relevant challenges for LLM evaluation.
Set up and configure code repositories, including Dockerization and environment setup to facilitate testing and development.
Evaluate unit test coverage and quality to ensure datasets are comprehensive and representative of real-world scenarios.
Modify and run codebases locally to assess LLM performance in bug-fixing and code understanding tasks.
Collaborate with research teams to design datasets, identify repositories, and select issues that are challenging for LLMs.
Lead and mentor junior engineers, fostering a collaborative environment to meet project milestones.
Contribute to the continuous improvement of automation pipelines and development workflows.
Technical Skills Required
JavaScript TypeScript Git Docker
Benefits & Perks
Fully remote environment
Flexible time commitments (20, 30, or 40 hours per week)
Opportunity to contribute to cutting-edge AI projects
Nice to Have
LLM research
Developer tools
Automation agents

Job Description


About The Company

Turing is one of the world's fastest-growing artificial intelligence companies dedicated to accelerating the development and deployment of advanced AI systems. Renowned for its innovative approach, Turing leverages cutting-edge technology to solve complex problems across various industries. The company's mission is to build intelligent solutions that enhance productivity, foster innovation, and transform the way organizations operate. With a global presence and a diverse team of experts, Turing is committed to pushing the boundaries of AI research and practical application, making it a leader in the AI ecosystem.

About The Role

We are seeking experienced software engineers at the tech lead level to join our groundbreaking project focused on building large language model (LLM) evaluation and training datasets tailored for realistic software engineering problems. This role involves engaging directly with high-quality public GitHub repositories, contributing to the automation of development environments, and assessing the quality and coverage of test cases. The ideal candidate will have a strong background in software engineering, particularly with open-source projects, and will play a pivotal role in advancing our dataset creation efforts. You will collaborate closely with researchers to identify challenging repositories and issues, and may also lead a team of junior engineers to achieve project goals. This position offers a unique opportunity to be at the forefront of AI and software engineering integration, impacting how LLMs understand and interact with real-world codebases.

Qualifications

The ideal candidate should possess a minimum of 3+ years of professional experience in software engineering. Proficiency in JavaScript and TypeScript is essential, along with a solid understanding of Git, Docker, and basic software pipeline setup. Candidates should be comfortable navigating complex codebases, running, modifying, and testing projects locally, and have experience contributing to or evaluating open-source projects. Additional experience in LLM research, developer tools, or automation agents is a plus. Strong problem-solving skills, attention to detail, and the ability to work independently in a remote environment are also important.

Responsibilities

  • Analyze and triage GitHub issues across trending open-source libraries to identify relevant challenges for LLM evaluation.
  • Set up and configure code repositories, including Dockerization and environment setup to facilitate testing and development.
  • Evaluate unit test coverage and quality to ensure datasets are comprehensive and representative of real-world scenarios.
  • Modify and run codebases locally to assess LLM performance in bug-fixing and code understanding tasks.
  • Collaborate with research teams to design datasets, identify repositories, and select issues that are challenging for LLMs.
  • Lead and mentor junior engineers, fostering a collaborative environment to meet project milestones.
  • Contribute to the continuous improvement of automation pipelines and development workflows.

Benefits

Joining Turing means working in a fully remote environment, providing flexibility and work-life balance. You will have the opportunity to contribute to cutting-edge AI projects with leading LLM companies, gaining valuable experience at the forefront of AI research and software engineering. The role offers flexible time commitments, with options for 20, 30, or 40 hours per week, allowing you to tailor your work schedule. As part of our team, you will be part of a dynamic and innovative community dedicated to pushing the boundaries of AI technology. Additionally, you will have access to a global network of talented professionals, ongoing learning opportunities, and the chance to make a meaningful impact on the future of AI-assisted software development.

Equal Opportunity

Turing is committed to fostering an inclusive environment and is proud to be an equal opportunity employer. We celebrate diversity and are dedicated to creating a workplace where all employees are valued, respected, and empowered to succeed. We do not discriminate based on race, color, religion, gender, gender identity or expression, sexual orientation, national origin, age, disability, or any other protected status. We believe that diverse perspectives and backgrounds drive innovation and excellence, and we welcome applicants from all walks of life to join our team.


Similar Jobs

Explore other opportunities that match your interests

Full Stack Developer Intern

Programming
•
31m ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Internship

infrabyte consulting

India
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Mid-Senior level

sapphire software solutions in...

India
Visa Sponsorship Relocation Remote
Job Type Part-time
Experience Level Not Applicable

deccan ai experts

India

Subscribe our newsletter

New Things Will Always Update Regularly