Senior Hadoop Developer

Jobs via Dice United State
Relocation
Apply
AI Summary

Asterism IT Solutions seeks a Senior Hadoop Developer to design and build ETL/ELT pipelines, data ingestion processes, and distributed data processing jobs. The ideal candidate will have 5-8 years of experience in Data Engineering, Software Engineering, or related technical disciplines. Strong proficiency in Python, SQL, and distributed data tools such as Apache Spark, Databricks, or Hadoop ecosystems is required.

Key Highlights
Design and build ETL/ELT pipelines, data ingestion processes, and distributed data processing jobs
5-8 years of experience in Data Engineering, Software Engineering, or related technical disciplines
Strong proficiency in Python, SQL, and distributed data tools such as Apache Spark, Databricks, or Hadoop ecosystems
Key Responsibilities
Design and build ETL/ELT pipelines, data ingestion processes, and distributed data processing jobs
Experience contributing to automated test suites, analyzing test failures, and supporting test-driven development
Troubleshoot pipeline issues, performance bottlenecks, and data discrepancies
Technical Skills Required
Python SQL Apache Spark Databricks Hadoop ecosystems Teradata Snowflake SQL Server Azure AWS Google Cloud Platform Git CI/CD pipelines Automated deployment practices
Benefits & Perks
Full-time employment
Relocation assistance
Onsite work in Addison, TX
Nice to Have
Prior experience in a financial institution or other regulated industry

Job Description


Dice is the leading career destination for tech experts at every stage of their careers. Our client, Asterism IT Solutions, is seeking the following. Apply via Dice today!

Title: Hadoop developer

Location: Addison, TX – Onsite (Relocation Works)

Duration: Fulltime

Video Interviews

Job Description:

Exp- 5 to 8 years

Roles & Responsibilities

  • 3–5+ years of experience in Data Engineering, Software Engineering, or related technical discipline.
  • Strong proficiency in Python, and SQL for advanced data transformations.
  • Hands-on experience designing and building ETL/ELT pipelines, data ingestion processes, and distributed data processing jobs.
  • Practical experience working with distributed data tools such as Apache Spark, Databricks, or Hadoop ecosystems.
  • Experience building and managing datasets in relational and/or cloud‑based data platforms (Teradata, Snowflake, SQL Server, Azure/AWS/Google Cloud Platform).
  • Solid understanding of data modeling, metadata, data quality controls, data lineage, and secure data management.
  • Experience contributing to automated test suites, analyzing test failures, and supporting test-driven development.
  • Knowledge of CI/CD pipelines, version control (Git), and automated deployment practices.
  • Experience adhering to enterprise data governance, compliance, and operational risk frameworks.
  • Ability to troubleshoot pipeline issues, performance bottlenecks, and data discrepancies.
  • Strong communication skills and ability to collaborate across engineering, product, and business teams.
  • Experience implementing monitoring and observability for data pipelines (logs, metrics, health checks).
  • Advanced experience with performance tuning of SQL, Spark, or distributed data workflows.
  • Knowledge of data security practices (encryption, masking, PII handling).
  • Experience supporting analytical workloads, BI tools, or data science teams.
  • Prior experience in a financial institution or other regulated industry
  • A Data Engineer is essential to implement efficient data flows, enforce data management standards, enhance data quality, and support continuous delivery and release cycles. Without this role, the project risks delays in data readiness, gaps in data compliance, reduced quality of analytical outputs, and inability to support downstream systems effectively.

Similar Jobs

Explore other opportunities that match your interests

Director, Imaging Hardware Engineering

Programming
22m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Anduril Industries

United State

Backend Software Engineer - Geospatial Processing

Programming
41m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Esri

United State

Senior Forward Deployed Engineer

Programming
59m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

OpenAI

United State

Subscribe our newsletter

New Things Will Always Update Regularly