We are seeking a Big Data Operations Engineer to manage k8s cluster environments, implement and operate Data Lake, and deploy and maintain Spark on k8s. The ideal candidate will have experience in deployment and maintaining Hadoop Ecosystem, including Spark framework, and a deep understanding of Hadoop and Spark cluster security.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Nice to Have
Job Description
Why this role matters
We are looking for a Big Data Ops in the Research and AI department - Big Data Team in Limassol, Cyprus.
We are seeking a Big Data Ops with a balance of skills in design, physical implementation and performance tuning to create, operate and support Big Data Data and AI Infrastructure and environments running on-premise or on external cloud services providers.
We offer ambitious projects and tasks on developing our Data Lake. In addition to that, you will be a part of our friendly and professional team.
What You'll Actually Do
- Manage k8s cluster environments on bare-metal and container infrastructure, including service allocation and configuration for the cluster, capacity planning, performance tuning, and ongoing monitoring;
- Implement and operate Data Lake (S3 + Trino);
- Operate and Develop on-premise AI infrastructure
- Deploy and maintain Spark on k8s;
- Data protection according to company security policies;
- Provide monitoring and alerting of the services;
- Participate in Data Platform architecture development.
- Relevant experience in deployment and maintaining Hadoop Ecosystem including Spark framework;
- Deep understanding of Hadoop and Spark cluster security, networking connectivity and IO throughput along with other factors that affect distributed system performance;
- Working knowledge of containers (e.g., docker, containerd) and major orchestrators (e.g., Kubernetes, rancher);
- Understanding object storage solutions based on S3;
- Excellent knowledge of Linux;
- Working knowledge of automation tools (e.g., Puppet, Chef, Ansible)
- General knowledge of Java/Python/GO, SQL;
- Understanding of base principles CI/CD in the data processing area;
- Experience with Big Data Processing & Data Lake building;
- Strong working knowledge of disaster recovery, incident management, and security best practices.
Looking to advance your Devops career with relocation support? Explore Devops Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.
- Competitive salary and annual performance bonus
- Full relocation support for you and your family — flights, housing, visas, and legal assistance included
- Top-tier health insurance with full family coverage — medical, dental, vision, mental health — plus life insurance for peace of mind
- Unlimited learning opportunities: external courses, English lessons, career and leadership development
- Education allowance covering school and kindergarten fees
- 21 working days of annual leave, plus public holidays and fully paid sick, maternity, and paternity leave
- Employee appreciation program: branded gifts, birthday day-offs, celebration budgets for weddings, newborns, and milestones
- “Get to know Team” trips — meet colleagues across our global hubs, along with company-wide offsites that raise the bar
- Employee share scheme — grow with us
- Branded MINI Cooper Countryman company car and private parking
- Free in-house sports clubs, Sanctum Club gym access, and jet skis
- Access to a Corporate doctor
- Exclusive discount program with cafes, gyms, and local services
- Expat tax perks: up to 50% income tax exemption
- Support with the naturalisation process for relocated employees
Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.
- Intro call with Recruiter (30 minutes)
- English check (if needed)
- Tech interview (90 minutes)
- Behavioural interview (60 minutes
We share the real Exness experience - our people, ideas, moments, and everything in between.
Sounds like you? Apply.
Please note: We occasionally amend or withdraw Exness jobs and reserve the right to do so at any time, including prior to the advertised closing date. Before applying, you are advised to read our data protection policy. This policy describes the processing that may be associated with your personal data and informs you that your personal data may be transferred to Exness/Exness Group companies around the world. Exness Group and its approved recruitment consultants will never ask you for a fee to process or consider your application for a career with Exness. Anyone who demands such a fee is not an authorized Exness representative and you are strongly advised to refuse any such demand.
At Exness, we're an equal opportunity employer where every individual is valued. No matter your race, color, religion, sex, national origin, sexual orientation, gender identity or disability, we welcome you. As an international fintech company, we embrace the richness of our diverse team, respecting each individual and promoting gender equality for all genders in our workforce.
Similar Jobs
Explore other opportunities that match your interests
nexters ($gdev)
trafficstars
Senior Partner AI Deployment Engineer (AWS)