Lead Software Engineer - SparkFlow Framework
Lead the architectural evolution of the SparkFlow framework, design and implement new functional features, and improve developer experience. This role requires deep experience with Apache Spark and strong skills in API design and abstraction design. The ideal candidate will have experience working in large-scale enterprise data environments.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Nice to Have
Job Description
STRATEGIC STAFFING SOLUTIONS HAS AN OPENING!
This is a Contract Opportunity with our company that MUST be worked on a W2 Only. No C2C eligibility for this position. Visa Sponsorship is Available! The details are below.
“Beware of scams. S3 never asks for money during its onboarding process.”
Job Title: Lead Software Engineer – SparkFlow Framework
Contract Length: 12+ Month contract
Hybrid work (3 days on site/ 2 days remote
Location: CHARLOTTE, NC 28202
Pay: 76-78 an hr on W2
Searching for Development & Programming roles that provide visa sponsorship? Connect with international employers through Development & Programming Jobs with Visa Sponsorship opportunities actively seeking talented professionals.
We are seeking a Lead Software Engineer to drive the evolution of SparkFlow, an enterprise data processing framework built on Apache Spark. This role focuses on designing composable abstractions, delivering new functional capabilities within the framework, and improving developer experience.
The engineer will also design and deploy AI-enabled capabilities and lead the integration of the SparkFlow framework into the Unity control plane.
Key Responsibilities
- Lead the architectural evolution of the SparkFlow framework, emphasizing modularity, composability, and clear abstraction boundaries.
- Design and implement new functional features within the framework to expand supported use cases and capabilities.
- Balance feature delivery with framework quality, ensuring performance, backward compatibility, and governance standards.
- Improve developer experience by simplifying APIs, configuration models, extension points, and onboarding patterns.
- Design and implement AI-driven solutions that assist developers and enhance framework usability, productivity, and operability.
- Integrate SparkFlow as a first-class framework within the Unity control plane.
- Collaborate with data, platform, and infrastructure teams to ensure consistent adoption across environments.
- Provide technical leadership through design reviews, code reviews, and architectural guidance.
Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.
Required Experience
- Deep experience with Apache Spark using Scala and/or Java (Python is a plus).
- Proven success building reusable frameworks or libraries, including ownership of functional feature development.
- Strong skills in API design, abstraction design, and extensibility patterns.
- Experience applying AI/ML or LLM-based techniques to developer tooling or data frameworks.
- Experience working in large-scale enterprise data environments.
Interested in opportunities specifically in United State? Discover our dedicated Visa Sponsorship Jobs in United State page featuring roles from top employers in this location.
Nice to Have
- Experience integrating frameworks into control planes or internal developer platforms.
- Familiarity with Spark SQL–centric architectures and data governance patterns.
- Experience modernizing or replacing legacy ETL frameworks.
Similar Jobs
Explore other opportunities that match your interests
Strategic Staffing Solutions
Jobgether