Databricks Senior Data Engineer

🔔 Are you in Poland? If YES this is the project for YOU!

Our benefits:

👩‍⚕️ Private Medical Care in Luxmed and Life Insurance

🏋️‍♀️ Multisport Card

👨‍👧‍👦 Paid referrals

📚 Self-learning libraries

🛫 Relocation package for seniors and assistance during all process...and MORE!

Project Description:

We are hiring for projects in the Middle East. The team comprises front-end and back-end developers, data analysts and data scientists, architects, analysts, and project managers. You will work with modern technologies and be an integral part of continuing to evolve our high-performing platforms. If you are serious about being a part of this fast-paced and exciting journey, this project should be top of the list!

This role will be primarily responsible for closely collaborating with a business SME to implement data validation rules.

Responsibilities:

• Collaborating with a business SME to implement data validation rules.

• Understand business requirements and actively provide input from a data perspective.

• Understand the underlying data and flow of data.

• Understand overall platform architecture and capabilities and how to load data effectively.

• Recognize and adapt to the changes in processes.

Mandatory Skills Description:

• 7 years + of relevant experience.

• Proficient hands-on experience with Azure Databricks (3y+).

• Proficiency in Python and PySpark (5y+).

• Advanced knowledge in SQL (5y+).

• Should be able to analyse and understand complex data.

• Knowledge of Azure data/delta lake, Azure DevOps, CI/CD, and Git is essential.

• Should clearly understand the data platform lifecycle and contribute to preparing Design documents, Unit Test plans, and Code review reports.

• Knowledge of data Lake house and business intelligence architecture.

• Experience working in an Agile environment (Scrum, Agile) is a plus.

• Interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision.

• Bachelor's degree in IT/Computer Science or related field

Nice-to-Have Skills Description:

Knowledge of the financial markets, portfolio theory, and risk management is a plus