Lead Software Engineer for Enterprise Data Processing Framework
Visa Sponsorship
AI Summary
Lead the architectural evolution of SparkFlow, an enterprise data processing framework built on Apache Spark. Design and implement new functional features within the framework. Improve developer experience by simplifying APIs and configuration models.
Key Highlights
Hybrid work
12+ month contract
Based in Charlotte, NC
Key Responsibilities
Lead the architectural evolution of the SparkFlow framework, emphasizing modularity, composability, and clear abstraction boundaries.
Design and implement new functional features within the framework to expand supported use cases and capabilities.
Balance feature delivery with framework quality, ensuring performance, backward compatibility, and governance standards.
Improve developer experience by simplifying APIs, configuration models, extension points, and onboarding patterns.
Design and implement AI-driven solutions that assist developers and enhance framework usability, productivity, and operability.
Technical Skills Required
Benefits & Perks
W2 only
Visa sponsorship available
Nice to Have
Experience integrating frameworks into control planes or internal developer platforms.
Familiarity with Spark SQL centric architectures and data governance patterns.
Job Description
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Strategic Staffing Solutions, is seeking the following. Apply via Dice today!
STRATEGIC STAFFING SOLUTIONS HAS AN OPENING!
This is a Contract Opportunity with our company that MUST be worked on a W2 Only. No C2C eligibility for this position. Visa Sponsorship is Available! The details are below.
Beware of scams. S3 never asks for money during its onboarding process.
Job Title: Lead Software Engineer SparkFlow Framework
Contract Length: 12+ Month contract
Hybrid work (3 days on site/ 2 days remote
Location: CHARLOTTE, NC 28202
Ref# 245458
Searching for Development & Programming roles that provide visa sponsorship? Connect with international employers through Development & Programming Jobs with Visa Sponsorship opportunities actively seeking talented professionals.
The engineer will also design and deploy AI-enabled capabilities and lead the integration of the SparkFlow framework into the Unity control plane.
Key Responsibilities
- Lead the architectural evolution of the SparkFlow framework, emphasizing modularity, composability, and clear abstraction boundaries.
- Design and implement new functional features within the framework to expand supported use cases and capabilities.
- Balance feature delivery with framework quality, ensuring performance, backward compatibility, and governance standards.
- Improve developer experience by simplifying APIs, configuration models, extension points, and onboarding patterns.
- Design and implement AI-driven solutions that assist developers and enhance framework usability, productivity, and operability.
- Integrate SparkFlow as a first-class framework within the Unity control plane.
- Collaborate with data, platform, and infrastructure teams to ensure consistent adoption across environments.
- Provide technical leadership through design reviews, code reviews, and architectural guidance.
Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.
- Deep experience with Apache Spark using Scala and/or Java (Python is a plus).
- Proven success building reusable frameworks or libraries, including ownership of functional feature development.
- Strong skills in API design, abstraction design, and extensibility patterns.
- Experience applying AI/ML or LLM-based techniques to developer tooling or data frameworks.
- Experience working in large-scale enterprise data environments.
Interested in opportunities specifically in United State? Discover our dedicated Visa Sponsorship Jobs in United State page featuring roles from top employers in this location.
- Experience integrating frameworks into control planes or internal developer platforms.
- Familiarity with Spark SQL centric architectures and data governance patterns.
- Experience modernizing or replacing legacy ETL frameworks.
Similar Jobs
Explore other opportunities that match your interests
Founding AI Engineer Intern
••••••
••••••
••••••
Job Type
••••••
Experience Level
••••••
Arena
United State
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Director
tohono o'odham nation health c...
United State
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Associate
agilegrid solutions
United State