Senior Data Engineer - Databricks and Cloud Data Platforms

ultra tendency • Spain
Remote
Apply
AI Summary

Ultra Tendency is seeking a Senior Data Engineer to design and optimize scalable data pipelines using Databricks Lakehouse on a global team based in Spain. The role involves developing batch and streaming workflows, ensuring data quality, and collaborating with cross-functional teams. The company offers flexible work arrangements, professional development opportunities, and a supportive, international environment.

Key Highlights
Design, implement, and maintain scalable data pipelines on Databricks Lakehouse Platform
Collaborate with data scientists, engineers, and stakeholders to develop production data solutions
Mentor junior engineers and optimize performance and cost-efficiency of data workflows
Technical Skills Required
Apache Spark Delta Lake Python Scala PySpark MLflow Terraform GitHub Actions Azure DevOps Airflow
Benefits & Perks
Flexible remote or hybrid work options
Professional development resources (certifications, Udemy)
Annual performance reviews and global team events

Job Description


Our Engineering department is growing, and we're now looking for aSenior Data Engineer - Databricks (m/f/*)to join our team in Spain, supporting our global growth.AsSenior Data Engineer (m/f/*), you design and optimize data processing algorithms on a talented, cross-functional team.

You are familiar with the Apache open-source suite of technologies and want to contribute to the advancement of data engineering.WHAT WE OFFER

Flexible work options, including fully remote or hybrid arrangements (candidates must be located in Spain)

A chance to accelerate your career and work with outstanding colleagues in a supportive learning community split across 3 continents

Contribute your ideas to our unique projects and make an impact by turning them into reality

Balance your work and personal life through our workflow organization and decide yourself if you work at home, in the office, or on a hybrid setup

Annual performance review, and regular feedback cycles, generating distinct value by connecting colleagues through networks rather than hierarchies

Individual development plan, professional development opportunities

Educational resources such as paid certifications, unlimited access to Udemy Business, etc.

Local, virtual, and global team events, in which UT colleagues become acquainted with one anotherWHAT YOU'LL DO

Design, implement, and maintain scalable data pipelines usingDatabricks Lakehouse Platform,with a strong focus onApache Spark, Delta Lake,andUnity Catalog.

Lead the development of batch and streaming data workflows that power analytics, machine learning, and business intelligence use cases.

Collaborate with data scientists, architects, and business stakeholders to translate complex data requirements into robust, production-grade solutions.

Optimize performance and cost-efficiency of Databricks clusters and jobs, leveraging tools likePhoton, Auto Loader,andJob Workflows.

Establish and enforce best practices for data quality, governance, and security within the Databricks environment.

Mentor junior engineers and contribute to the evolution of the team's Databricks expertise.WHAT YOU'LL BRING

Deep hands-on experience withDatabricksonAzure,AWS, orGCP, including Spark (PySpark/Scala), Delta Lake, and MLflow.

Strong programming skills inPythonorScala, and experience with CI/CD pipelines (e.g., GitHub Actions, Azure DevOps).

Solid understanding of distributed computing, data modeling, and performance tuning in cloud-native environments.

Familiarity with orchestration tools (e.g., Databricks Workflows, Airflow) and infrastructure-as-code (e.g., Terraform).

A proactive mindset, strong communication skills, and a passion for building scalable, reliable data systems.

Professional Spanish & English communication skills (C1-level, written and spoken).

Did we pique your interest, or do you have any questions?

We want to hear from you: contact us ****** US

Ultra Tendency is an international premier Data Engineering consultancy forBig Data, Cloud, Streaming,IIoT andMicroservices.

We design, build, and operate large-scale data-driven applications for major enterprises such as the European Central Bank, HUK-Coburg, Deutsche Telekom, and Europe's largest car manufacturer.

Founded in Germany in ****, UT has developed a reliable client base and now runs 8 branches in 7 countries across 3 continents.

We do more than just leverage tech, we build it.

At Ultra Tendency we contribute source code to +20 open-source projects includingAnsible, Terraform,NiFi, andKafka.

Our impact on tech and business is there for anyone to see.

Enterprises seek out Ultra Tendency because we solve the problems others cannot.

We love the challenge: together, we tackle diverse and unique projects you will find nowhere else.

In our knowledge community, you will be a part of a supportive network, not a hierarchy.

Constant learning and feedback are our drivers for stable development.

With us you can develop your individual career through work-life balance.

We evaluate your application based on your skills and corresponding business requirements.

Ultra Tendency welcomes applications from qualified candidates regardless of race, ethnicity, national or social origin, disability, sex, sexual orientation, or age.

Subscribe our newsletter

New Things Will Always Update Regularly