Lead end-to-end data system development, optimize Spark performance, design data models, and build complex reports. Requires 4+ years of experience in Data Engineering with strong SQL, Spark SQL, and PySpark skills.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Job Description
Relocation is required; the company will provide a relocation assistance package
Responsibilities: The candidate will be responsible for building and operating the company’s end-to-end data system, including
Track P – Pipeline & Platform
- Design and develop data pipelines from Bronze to Silver to Gold layer
- Build batch and streaming pipelines, handling late-arriving data, CDC (Change Data Capture), and schema.
- Optimize Spark performance, including partitioning, Z-ordering, and compaction
- Develop shared frameworks and reusable components (e.g., joins, utilities, data quality pre-checks
Track A – Analytics & Reporting
Looking to advance your Data Science career with relocation support? Explore Data Science Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.
- Understand business requirements and KPI definition
- Design Gold and Diamond data models for analytical purpose
- Build complex reports and transformations using SQL and PySpark
- Implement standardized incremental and backfill workflows
Track R – Data Reliability & Monitoring
- Build and maintain Data Quality frameworks (e.g., row count checks, schema validation, metric consistency
- Perform cross-table and cross-source data validation
- Implement anomaly detection and alerting mechanism
- Conduct root-cause analysis and reduce recurring data issues
Requirement:
Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.
- + 4 years of experience in Data Engineering or related roles
- Strong proficiency in SQL, Spark SQL, and PySpark
- Hands-on experience with Databricks/Spark environment
- Solid understanding of data modeling concepts: fact/dimension tables, grain, star schema...
- Strong analytical thinking and problem-solving skills, with the ability to troubleshoot pipeline issues and optimize data process
What we offer
- Competitive Compensation: Enjoy a salary package tailored to your skills and experience, along with performance-based bonuses
- Comprehensive Benefits: We support your well-being with allowances, and assistance with work visa process
- Work-Life Balance: Unwind with generous holiday and New Year bonus
- Top-Tier Equipment: Stay productive with the latest tools, including a MacBook and iPhone
- Thriving Culture: Immerse yourself in a dynamic, inclusive work environment that fosters grown.
Similar Jobs
Explore other opportunities that match your interests
hippo insurance
Data Science & AI Consultant
Accenture
Group Leader, Space Remote Sensing and Data Science
