Botify Tech is seeking a Senior Machine Learning Engineer with expertise in LLMs to lead the evaluation strategy for Agentic AI and RAG systems. The ideal candidate will have hands-on experience developing and training transformer-based LLMs from scratch. The role involves designing and leading the evaluation strategy, participating in code reviews, and contributing to expanding and improving the infrastructure to support all stages of the ML model lifecycle.
Key Highlights
Technical Skills Required
Benefits & Perks
Job Description
Senior Machine Learning Engineer - LLMs (Contract)
HYBRID - Barcelona (RELOCATION IS MANDATORY)
€55,000 - €80,000 + Signing Bonus
Botify Tech has partnered with one of the TOP AI businesses Globally, they are on the lookout for a Senior Machine Learning Engineer with a strong background within LLM's.
Key Skills & Experience Required
- Proven use of model compression or optimization techniques
- Hands-on deployment, production, and operation of Machine Learning models and pipelines at scale, including both batch and real-time use cases.
- Design and lead the evaluation strategy for our Agentic AI and RAG systems, turning customer workflows and business needs into measurable metrics and clear success criteria.
- Hands-on experience developing or training transformer-based LLMs from scratch
- Participate in code reviews, offering thoughtful, constructive feedback to maintain code quality, readability, and consistency.
- Deep familiarity with transformer architecture, training pipelines, and experimentation
- Define and monitor operational metrics (latency, cost, reliability) to ensure evaluations align with production and customer expectations.
- Work with the analytics team & stakeholders to understand their objectives in support of formulating, optimizing, and productionising ML models
- Contribute to expanding and improving the infrastructure to support all stages of the ML model lifecycle and deployment in a production environment.
- 3 years of commercial experience delivering projects end-to-end
Must-haves:
- Hands-on experience developing or training transformer-based LLMs from scratch
- Deep familiarity with transformer architecture, training pipelines, and experimentation
- Proven use of model compression or optimization techniques such as – QloRA, LoRA, Pruning, distillation
For more info
Email me at pinto@botifytech.com