Data Engineer - High-Performance Data Storage and Analytics

Atto Trading • Ukraine
Relocation
Apply
AI Summary

Atto Trading seeks an experienced Data Engineer to design, build, and maintain a comprehensive Data Lake for high-frequency trading strategies. The ideal candidate will have 5+ years of experience in data engineering, strong understanding of market data formats, and expertise in designing and modernizing data infrastructure.

Key Highlights
Design and implement high-performance data storage systems
Configure and maintain compute clusters for distributed data processing
Plan capacity and scalability roadmaps for 100TB+ annual data growth
Technical Skills Required
Data Engineering Spark Iceberg Trino/Presto Parquet optimization ETL pipelines Prefect/Airflow Infrastructure High-performance networking and compute Storage Systems High-performance distributed storage Networking Low-latency networking DPDK Kernel bypass technologies Programming Python SQL APIs Data Analysis Advanced SQL Tableau
Benefits & Perks
Competitive compensation package
Performance-based bonus opportunities
Healthcare & Sports/gym budget
Mental health support
Paid time off (25 days)
Relocation support (where applicable)
International team meet-ups
Learning and development support
Access to professional tools, software, and resources

Job Description


Atto Trading, a dynamic quantitative trading firm founded in 2010 and leading in global high-frequency strategies, is looking for a Data Engineer to join our team.

We are expanding an international, diverse team with experts in trading, statistics, engineering, and technology. Our disciplined approach, combined with rapid market feedback, allows us to quickly turn ideas into profit. Our environment of learning and collaboration allows us to solve some of the world's hardest problems, together. As a small firm, we remain nimble and hold ourselves to the highest standards of integrity, ingenuity, and effort.

Role Highlights:

We are seeking an experienced Data Engineer to design, build, and maintain our comprehensive Data Lake for a fast-growing number of research and production datasets. This role combines hardware and platform infrastructure expertise with data engineering excellence to support our rapidly growing data assets (:200TB current, scaling :100TB/year).

Responsibilities:

  • Architect and manage high-performance, scalable on-premise data storage systems optimized for large-scale data access and analytics workloads
  • Configure and maintain compute clusters for distributed data processing
  • Plan capacity and scalability roadmaps to accommodate 100TB+ annual data growth
  • Design and implement efficient monitoring and alerting systems to forecast growth trends and proactively react to critical states
  • Design, create, automate, and maintain various data pipelines
  • Enhance existing and setup new "data checks" and alerts to determine when the data is "bad"
  • Design and implement a comprehensive on-premise Data Lake system connected to VAST storage solution for normalized market data across:
  • US Equities, US Futures, and SIP feeds
  • Other market data sources that will be further added
  • Security Definition data for various markets
  • Various private column data
  • Build and operate end‑to‑end data pipelines and SLA/SLO monitoring to ensure data quality, completeness, and governance
  • Analyze existing data models, usage patterns, and access frequencies to identify bottlenecks and optimization opportunities
  • Develop metadata and catalog layers for efficient data discovery and self‑service access
  • Design and deploy event‑driven architectures for near real‑time market data processing and delivery
  • Orchestrate ETL/ELT data pipelines using tools like Prefect (or Airflow), ensuring robustness, observability, and clear operational ownership
  • Ensure fault tolerance, scalability, and high availability across existing systems
  • Partner with traders, quantitative researchers, and other stakeholders to understand use cases and continuously improve the usability, performance, and reliability of the Data Lake

Requirements

  • 5+ years of experience in data engineering or data platform roles
  • Proven experience with large‑scale data infrastructure (hundreds of TBs of data, high‑throughput pipelines)
  • Strong understanding of market data formats and financial data structures (e.g., trades, quotes, order books, corporate actions)
  • Experience designing and modernizing data infrastructure within on-premise solutions
  • Bachelor's degree in Computer Science, Engineering, or related field required; Master's degree preferred or equivalent practical experience

Tech Skills:

  • Data Engineering - Spark, Iceberg (or similar table formats), Trino/Presto, Parquet optimization
  • ETL pipelines - Prefect/Airflow or similar DAG-oriented tools
  • Infrastructure - High-performance networking and compute
  • Storage Systems - High-performance distributed storage, NAS/SAN, object storage
  • Networking - Low-latency networking (aware about DPDK and kernel bypass technologies. Data center infrastructure basics
  • Programming - Python (production‑grade), SQL, building APIs (e.g., FastAPI)
  • Data Analysis - Advanced SQL, Tableau (or similar BI tools), data profiling tools

Nice to have:

  • Experience in HFT or financial services
  • Background in high‑frequency trading (HFT) or quantitative finance

Benefits

  • Competitive compensation package
  • Performance-based bonus opportunities
  • Healthcare & Sports/gym budget
  • Mental health support, including access to therapy
  • Paid time off (25 days)
  • Relocation support (where applicable)
  • International team meet-ups
  • Learning and development support, including courses and certifications
  • Access to professional tools, software, and resources
  • Fully equipped workstations with high-quality hardware
  • Modern office with paid lunches

Our motivation:

We are a company committed to staying at the forefront of technology. Our team is passionate about continual learning and improvement. With no external investors or customers, we are the primary users of the products we create, giving you the opportunity to make a real impact on our company's growth.

Ready to advance your career? Join our innovative team and help shape the future of trading on a global scale. Apply now and let's create the future together!

Similar Jobs

Explore other opportunities that match your interests

Business Analyst

Data Science
•
4w ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Entry level

TechMagic

Ukraine

Senior Operations Manager

Data Science
•
1h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Anduril Industries

United State

Senior Strategy & Analytics Manager

Data Science
•
1h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Agoda

Thailand

Subscribe our newsletter

New Things Will Always Update Regularly