AI Platform Engineer

Akvelon, Inc. Kazakhstan
Remote Relocation
Apply
AI Summary

Build and operate an internal AI platform for developers to ship AI-powered services efficiently. Improve DevEx and reduce time-to-market for AI features. Manage infrastructure as code with Terraform and Kubernetes.

Key Highlights
Build and operate AI platform infrastructure
Implement and maintain Kubernetes-based runtime environments
Manage infrastructure as code with Terraform
Key Responsibilities
Build and operate AI platform infrastructure
Implement and maintain Kubernetes-based runtime environments
Manage infrastructure as code with Terraform
Support LLM workflows
Integrate and operate tooling
Orchestrate pipelines
Improve platform reliability and observability
Technical Skills Required
Kubernetes Terraform Python Azure AI Foundry LiteLLM Langfuse MLflow Kubeflow Pipelines Argo Workflows
Benefits & Perks
Relocation support available
Remote work from Croatia, Poland, Portugal, and Serbia
Nice to Have
Experience building internal developer platforms
Familiarity with LLM evaluation frameworks
Exposure to RAG architectures
Experience with Kubeflow, Argo, and ML lifecycle tooling

Job Description


This engagement is focused on building an internal AI platform that enables developers to ship AI-powered services efficiently. Scope includes model connectivity, prompt testing and evaluation, monitoring/observability, and the underlying AI infrastructure layer.


The objective is to improve DevEx and reduce time-to-market for AI features.


Location: Serbia (relocation support available), Croatia, Poland, Portugal


Tasks

  • Build and operate the AI platform infrastructure enabling developers to ship LLM-based services faster.

  • Implement and maintain Kubernetes-based runtime environments (incl. AKS) for AI workloads.

  • Manage infrastructure as code with Terraform (modules, environments, CI/CD automation).

  • Support LLM workflows: RAG, agents, prompt experimentation, evaluations, and deployment patterns.

  • Integrate and operate tooling such as Azure AI Foundry, LiteLLM, Langfuse, MLflow.

  • Orchestrate pipelines using Kubeflow Pipelines and/or Argo Workflows (build, deploy, evaluate).

  • Improve platform reliability and observability (monitoring, logging, tracing, cost/perf signals).

  • Collaborate closely with developers to streamline DX (APIs, templates, docs, golden paths, automation).


Requirements

  • Strong hands-on experience with Kubernetes in production (preferably AKS).

  • Solid Terraform expertise (IaC best practices, multi-env setups).

  • Practical experience supporting ML/LLM workloads in a platform or DevOps/MLOps context.

  • Proficiency in Python for automation, scripting, and supporting APIs/evaluation tooling.

  • Understanding of CI/CD, release processes, and production-grade operations.

  • Ability to work under tight timelines and deliver pragmatically.


Nice to Have



  • Experience building internal developer platforms or “paved roads” for engineering teams.

  • Familiarity with LLM evaluation frameworks, prompt testing workflows, and LLM observability.

  • Exposure to RAG architectures, vector databases, and agentic patterns.

  • Experience with Kubeflow, Argo, and ML lifecycle tooling.


Engagement Type



  • Long-term B2B contract.


Team



  • You will join a team of 5, with 3 AI Platform Engineers being added.


Location / Timezone



  • Remote work from Croatia, Poland, Portugal, and Serbia.

  • European working hours.

  • Occasionally available for meetings up to 10:00 AM PST (US overlap).

Similar Jobs

Explore other opportunities that match your interests

Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

zachary piper solutions

United State

Senior Research Computing Infrastructure Engineer

Devops
7m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

sygaldry technologies

United State
Visa Sponsorship Relocation Remote
Job Type Part-time
Experience Level Mid-Senior level

Mindrift

United Kingdom

Subscribe our newsletter

New Things Will Always Update Regularly