AI Summary
Contribute to the SparkFlow enterprise data processing framework. Implement new features, strengthen existing components, and improve developer experience. Develop AI-enabled solutions and support integration into the Unity control plane.
Key Highlights
Implement new features in the SparkFlow framework
Improve developer experience by simplifying configuration patterns and diagnostics
Develop AI-enabled solutions to assist developers
Key Responsibilities
Build and enhance functional features in the SparkFlow framework
Implement framework extension points to improve composability and reuse
Develop AI-enabled solutions to assist developers
Contribute to Unity control plane integration by implementing adapters, operators, automation, and testing
Technical Skills Required
Benefits & Perks
Visa sponsorship available
12+ month contract
Nice to Have
Python
Hadoop/Hive
Kafka
cloud storage or warehouse patterns
Job Description
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Strategic Staffing Solutions, is seeking the following. Apply via Dice today!
STRATEGIC STAFFING SOLUTIONS HAS AN OPENING!
This is a Contract Opportunity with our company that MUST be worked on a W2 Only. No C2C eligibility for this position. Visa Sponsorship is Available! The details are below.
Beware of scams. S3 never asks for money during its onboarding process.
Job Title: Software Engineer SparkFlow Framework
Contract Length: 12+ Month contract
Hybrid work (3 days on site/ 2 days remote
Location: CHARLOTTE, NC 28202
Searching for Development & Programming roles that provide visa sponsorship? Connect with international employers through Development & Programming Jobs with Visa Sponsorship opportunities actively seeking talented professionals.
The Software Engineer will contribute to the SparkFlow enterprise data processing framework built on Apache Spark. The role focuses on implementing new framework features, strengthening existing components, improving developer experience, and delivering AI-enabled capabilities to simplify framework usage. This position will also support integration of SparkFlow into the Unity control plane by building and hardening required interfaces and workflows.
Key Responsibilities
- Build and enhance functional features in the SparkFlow framework, including sources, targets, transformations, governance and control capabilities, and reliability features.
- Implement and refine framework extension points such as APIs, configurations, and libraries to improve composability and reuse.
- Improve developer experience by simplifying configuration patterns (for example pipeline JSON/configs), reducing onboarding friction, and improving diagnostics and observability hooks.
- Develop AI-enabled solutions that assist developers, such as guided configuration generation, validation tools, troubleshooting accelerators, and other usability improvements.
- Contribute to Unity control plane integration by implementing adapters, operators, automation, and integration testing to support consistent orchestration.
- Participate in code reviews, design discussions, and operational support activities as needed.
Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.
- Strong hands-on engineering experience with Apache Spark using Scala and/or Java (Python is a plus), including Spark SQL-based processing.
- Experience building frameworks or libraries, including API and abstraction design.
- Working knowledge of CI/CD and engineering fundamentals, including Git, build tooling, and unit/integration testing.
- Experience with enterprise data ecosystem components such as Hadoop/Hive, Kafka, and cloud storage or warehouse patterns, including production hardening.
Interested in opportunities specifically in United State? Discover our dedicated Visa Sponsorship Jobs in United State page featuring roles from top employers in this location.
- Experience improving pipeline onboarding and deployment patterns, such as config-driven artifacts, launcher scripts, and scheduler integration.
- Familiarity with governance capabilities, including audit trail capture, metadata or lineage integration, and data-in-motion controls.
- Cloud or hybrid experience, such as Google Cloud Platform Dataproc patterns supporting Spark workloads.
Similar Jobs
Explore other opportunities that match your interests
Founding AI Engineer Intern
••••••
••••••
••••••
Job Type
••••••
Experience Level
••••••
Arena
United State
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Mid-Senior level
Jobs via Dice
United State
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Director
tohono o'odham nation health c...
United State