Senior Data Engineer for P&C Insurance

James Search Group United State
Remote
Apply
AI Summary

Design, build, and maintain the upstream components of a modern data platform for a leading P&C insurance carrier. The position involves coding daily, mentoring peers, and collaborating with analytics engineers and business partners. Key requirements include strong proficiency in Python, SQL, and Spark, with hands-on expertise in Databricks and/or Azure Data Services.

Key Highlights
Design, build, and optimize scalable data pipelines for batch and real-time processing.
Implement data ingestion frameworks, including CDC from core systems, APIs, and third-party platforms.
Develop and optimize Apache Spark jobs on Databricks, leveraging Delta Lake, DLT pipelines, and lakehouse architectures.
Key Responsibilities
Design, build, and optimize scalable data pipelines for batch and real-time processing.
Implement data ingestion frameworks, including CDC from core systems, APIs, and third-party platforms.
Develop and optimize Apache Spark jobs on Databricks, leveraging Delta Lake, DLT pipelines, and lakehouse architectures.
Ensure data quality, lineage, and governance using Unity Catalog, CI/CD, and role-based access/security controls.
Partner with analytics engineers (dbt) to deliver clean, structured upstream data.
Technical Skills Required
Python SQL Spark Databricks Azure Data Services AWS services (S3, Glue, Lambda, etc.) DevOps tools (GitHub, CI/CD pipelines, and testing frameworks)
Benefits & Perks
Competitive base salary ($120,000 – $170,000)
Performance-based bonus
Comprehensive benefits package
401(k) with company match
Generous PTO and wellness programs

Job Description


Senior Data Engineer (P&C Insurance)

Fully Remote | Full-Time

Base Salary: $120,000 – $170,000


Partnering with a Leading P&C Insurance Carrier

James Search Group is proud to partner with a highly rated Property & Casualty insurance carrier that is making significant investments in data engineering, analytics, and machine learning. The company is building a centralized Data & ML/AI organization that unites experts across data architecture, engineering, analytics, governance, and modeling—creating a unique opportunity for growth, collaboration, and innovation.


We are seeking a Senior Data Engineer to design, build, and maintain the upstream components of a modern data platform. From ingestion and real-time streaming to data quality frameworks, you’ll play a pivotal role in shaping the technical foundation of the company’s next-generation data environment. This is a hands-on role where you’ll be coding daily, mentoring peers, and collaborating closely with analytics engineers, data scientists, and business partners.


Office Locations (Optional Hybrid):

This is a remote-first position, but you can also work from one of the carrier’s multiple U.S. office locations.


What You’ll Do:

  • Design, build, and optimize scalable data pipelines for batch and real-time processing.
  • Implement data ingestion frameworks including CDC from core systems, APIs, and third-party platforms (Salesforce, Workday, Duck Creek, etc.).
  • Develop and optimize Apache Spark jobs on Databricks, leveraging Delta Lake, DLT pipelines, and lakehouse architectures.
  • Ensure data quality, lineage, and governance using Unity Catalog, CI/CD, and role-based access/security controls.
  • Partner with analytics engineers (dbt) to deliver clean, structured upstream data.
  • Mentor peers, contribute to architecture decisions, and foster a culture of craftsmanship.
  • Leverage AWS services (S3, Glue, Lambda, etc.) and DevOps tools (GitHub, CI/CD) for scalable, production-grade deployments.


What You Bring:

  • 3-5+ years of professional experience in data engineering, ideally within insurance or financial services.
  • Strong proficiency in Python, SQL, and Spark for building and optimizing pipelines.
  • Hands-on expertise with Databricks (Unity Catalog, Delta Lake, DLT pipelines) and/or Azure Data Services.
  • Strong knowledge of AWS data services, with the ability to adapt across cloud platforms (Azure, GCP).
  • Familiarity with modern data architectures (medallion, lakehouse, streaming).
  • Experience with GitHub, CI/CD pipelines, and testing frameworks.
  • A problem-solving mindset: balancing pragmatism with scalability, and a passion for working in collaborative teams.


What’s In It for You:

  • Competitive base salary ($120K–$170K)
  • Performance-based bonus
  • Comprehensive benefits package
  • 401(k) with company match
  • Generous PTO and wellness programs


This is a rare opportunity to join a ground-floor data transformation at a forward-thinking P&C insurer, working with the latest tools and approaches to build something lasting.


If you’re excited to design and deliver production-grade data systems that directly empower analytics, AI, and business outcomes—we’d love to connect.


Similar Jobs

Explore other opportunities that match your interests

Data Analyst

Data Science
6h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Associate

Wiraa

United State

Senior Clinical Data Scientist

Data Science
6h ago
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Mid-Senior level

The Fountain Group

United State
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Mid-Senior level

jmd technologies inc.

United State

Subscribe our newsletter

New Things Will Always Update Regularly