Senior Data Engineer (Cybersecurity Focus)

muscon pathways New York City Metropolitan Area
Remote Relocation
Apply
AI Summary

Join a fast-paced cybersecurity organization as a Senior Data Engineer to build large-scale data systems for threat detection, correlation, and automated remediation. 8-10+ years of Data Engineering experience required. Strong Python and AWS experience necessary.

Key Highlights
Build and maintain large-scale data pipelines
Design robust ETL/ELT workflows using PySpark, Spark, and Databricks
Work with streaming & near real-time data (Kafka, APIs, micro-batching)
Key Responsibilities
Build and maintain large-scale data pipelines
Design robust ETL/ELT workflows using PySpark, Spark, and Databricks
Work with streaming & near real-time data (Kafka, APIs, micro-batching)
Support cybersecurity analytics, log processing, and threat detection use cases
Technical Skills Required
Python PySpark Apache Spark Databricks AWS S3 Glue EMR Lambda Kafka
Benefits & Perks
12-month contract (likely extensions)
Open to relocation candidates
Nice to Have
Java exposure
Cybersecurity domain experience
Experience with high-throughput or real-time data platforms

Job Description


🚀 We’re Hiring: Senior Data Engineer (Cybersecurity Focus)

📍 New York City / Plano, TX (3 days onsite, 2 days remote)

🔁 12-month contract (likely extensions)

📦 Open to relocation candidates

We’re looking for a Senior Data Engineer to join a fast-paced cybersecurity organization building large-scale data systems that power threat detection, correlation, and automated remediation — including GenAI-driven security tools used by both operations teams and leadership.

This is a data engineering–first role (~80% DE / ~20% ML exposure). Strong engineering fundamentals matter far more than tool familiarity.


🔧 What you’ll do
  • Build and maintain large-scale, high-volume data pipelines
  • Design robust ETL/ELT workflows using PySpark, Spark, and Databricks
  • Develop and optimize data systems on AWS (S3, Glue, EMR, Lambda, etc.)
  • Work with streaming & near real-time data (Kafka, APIs, micro-batching)
  • Support cybersecurity analytics, log processing, and threat detection use cases
  • Ensure pipelines are scalable, reliable, and production-grade
  • Collaborate closely with data science, cybersecurity, and platform teams


🧠 What we’re looking for
  • 8–10+ years of Data Engineering experience (10+ preferred)
  • Strong Python for data engineering (pandas, DataFrames)
  • Deep hands-on experience with PySpark / Apache Spark
  • Proven work with Databricks
  • Strong AWS experience (especially S3 + data services ecosystem)
  • Experience designing end-to-end data pipelines at scale
  • Solid understanding of data modeling & SCD (Slowly Changing Dimensions)


🌊 Streaming & Systems Knowledge
  • Hands-on or strong exposure to Kafka (consumer-side understanding required)
  • API-based integrations
  • Experience with high-volume systems (not just light micro-batching)
  • Ability to explain tradeoffs between batch vs micro-batch vs streaming architectures



⭐ Nice to have
  • Java exposure (not mandatory)
  • Cybersecurity domain experience
  • Experience with high-throughput or real-time data platforms



Similar Jobs

Explore other opportunities that match your interests

Quantitative Data Scientist

Data Science
1d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Stabile Search

New York City Metropolitan Area
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

biohub

New York City Metropolitan Area

Business Analyst, Provider Networks & Care Management

Data Science
3w ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Fractal

New York City Metropolitan Area

Subscribe our newsletter

New Things Will Always Update Regularly