Databricks Engineer

We are urgently seeking experienced Databricks Engineers to join a high-impact, growing team.

This team is responsible for ensuring patients receive the highest quality long-term care and is one of the first groups adopting a new Databricks platform within the organization.

Location: Fully Remote (No time zone restrictions – team primarily CST)

Contract Duration: 6–12 months (strong likelihood of extensions; no conversion plans at this time) Start Date: ASAP (target onboarding within 2 weeks of offer)

Key Responsibilities:

• Build, optimize, and maintain scalable Databricks data pipelines and workflows
• Perform hands-on engineering (80–100% coding / development focus) – migrating legacy SQL/stored procedure logic to Databricks native code
• Conduct code reviews, pair programming, and provide real-time coaching to help the existing team adopt best practices in Databricks & Python
• Collaborate with a small, tight-knit team (current manager + 3 senior engineers) to replatform out-of-the-box quality features into Databricks
• Document processes, pipelines, and architectural decisions
• Participate in lift-and-shift migration efforts while transitioning to modern Databricks-native implementations
• Work closely with a newly formed platform team to ensure successful adoption

Must-Have Qualifications:

• Strong hands-on experience with Databricks (Delta Lake, notebooks, workflows, Unity Catalog preferred)
• Proven track record writing and optimizing Python code in a Databricks environment
• Solid background in SQL and stored procedures (legacy systems migration experience is highly valued)
• Comfortable performing code reviews, pair programming, and mentoring junior/mid-level engineers on Databricks best practices
• Experience with Git/GitHub or Bitbucket for version control
• 5+ years of relevant data engineering experience (open to strong candidates with less if Databricks depth is exceptional)

Strongly Preferred / Nice-to-Have:

• Databricks certification (Databricks Certified Data Engineer Associate or Professional)
• Prior healthcare, payer, or CMS-related experience (Stars quality, HEDIS, Medicare Advantage, etc.)
• Exposure to modern data platform migrations (lift-and-shift → native refactoring)

Interview & Submittal Process:

• 1 technical round (45 minutes) with 2–3 team members
• Video screen required prior to interview
• 2 professional references required

This is a rare opportunity to be an early adopter on a brand-new Databricks platform within a mission-driven healthcare organization focused on improving patient outcomes.

The team is collaborative, growing quickly, and values engineers who can both deliver hands-on work and help elevate the entire group.

Beacon Hill is an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply.

Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.

California residents: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.