Senior Data Engineering Lead

Interactive Resources - iR • Atlanta Metropolitan Area
Remote
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Lead the design and development of cloud-native data platforms and pipelines for analytics and data science. Own architecture decisions across data lake, lakehouse, and pipeline design. Serve as a technical leader and mentor, guiding engineers through best practices and complex problem solving.

Key Highlights
Cloud-native data platforms and pipelines
Data lake, lakehouse, and pipeline design
Technical leadership and mentorship
Key Responsibilities
Lead the design and development of cloud-native data platforms and pipelines for analytics and data science
Own architecture decisions across data lake, lakehouse, and pipeline design
Serve as a technical leader and mentor, guiding engineers through best practices and complex problem solving
Contribute hands on to Databricks development including notebooks, workflows, and optimization efforts
Establish standards for data modeling, ELT pipelines, orchestration, and performance tuning
Ensure data platforms are reliable, secure, and scalable
Partner with stakeholders to align technical solutions with business needs
Technical Skills Required
Azure data platforms Azure Databricks Data Lake Fabric Data Factory Databricks PySpark SQL Python
Benefits & Perks
$150k annually
Fully Remote

Job Description


Data Engineering Lead / Principal Data Engineer

$150k annually

Fully Remote


This is a senior, hands-on technical leadership role focused on designing and building modern cloud data platforms. You will work closely with engineering, product, and business teams to deliver scalable data solutions that support analytics, reporting, and advanced data initiatives. This role is ideal for someone who enjoys owning architecture and implementation while guiding engineers and setting technical direction.

You will play a key role in shaping the evolution of a cloud-based data platform, with a strong focus on Databricks, lakehouse architecture, and scalable data pipelines. This is a highly visible role where you will influence best practices, mentor team members, and remain deeply involved in technical execution.

Responsibilities

  • Lead the design and development of cloud-native data platforms and pipelines for analytics and data science
  • Own architecture decisions across data lake, lakehouse, and pipeline design
  • Serve as a technical leader and mentor, guiding engineers through best practices and complex problem solving
  • Contribute hands on to Databricks development including notebooks, workflows, and optimization efforts
  • Establish standards for data modeling, ELT pipelines, orchestration, and performance tuning
  • Ensure data platforms are reliable, secure, and scalable
  • Partner with stakeholders to align technical solutions with business needs

Technical Experience

  • Strong experience with Azure data platforms including Azure Databricks, Data Lake, Fabric, and Data Factory
  • Deep hands on expertise in Databricks and distributed data processing frameworks
  • Proficiency in Python, PySpark, and SQL
  • Experience designing modern data architectures such as lakehouse, streaming pipelines, and data mesh
  • Strong understanding of data governance, security, and performance optimization


Similar Jobs

Explore other opportunities that match your interests

Data Analyst (Contract)

Data Science
•
3h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Palo Alto Networks

United State

Analytics Engineer - Business Intelligence

Data Science
•
10h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

NBCUniversal

United State

Mid-Senior Business Analyst

Data Science
•
12h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

CareerUS Solutions

United State

Subscribe our newsletter

New Things Will Always Update Regularly