Senior Streaming Data Engineer

FxPro • Latvia
Visa Sponsorship Relocation
Apply
AI Summary

Join FxPro as a Senior Streaming Data Engineer to build, operate, and scale on-premise data platforms. You will design, implement, and optimize ETL/ELT pipelines and ensure reliable data ingestion from multiple sources. Strong Linux administration skills and experience with Kafka and streaming data systems are required.

Key Highlights
Build and operate streaming ingestion pipelines
Design and implement ETL/ELT pipelines
Ensure reliable data ingestion from multiple sources
Key Responsibilities
Build and operate streaming ingestion pipelines from multiple sources into on-premise systems and databases hosted on Linux VMs
Design, implement, and optimize end-to-end ETL/ELT pipelines
Implement and maintain Kafka-based ingestion patterns
Use Redis where appropriate for caching, buffering, and real-time processing patterns
Maintain and optimize analytical storage solutions used for BI and analytics workloads
Ensure reliable data ingestion from relational databases
Implement monitoring, logging, alerting, and operational runbooks for pipelines and data systems
Ensure secure access and auditability across services and databases
Collaborate with BI, Analytics, and Data Science teams to deliver reliable datasets
Technical Skills Required
Linux administration Python SQL (PostgreSQL and/or MS SQL) Kafka ETL/ELT pipelines Redis ClickHouse
Benefits & Perks
Excellent compensation package
Medical insurance
Provident fund
In-house gym with a personal trainer
Free daily lunch catering, snacks, and beverages
Company discount card for various products & services
21 days of annual leave and 10 days of sick leave annually
Shuttle bus service from Limassol
Birthday gift
Relocation bonus and visa/work permit support
Nice to Have
Experience with CDC tooling or patterns
Familiarity with observability tools such as Prometheus, Grafana, ELK, or OpenSearch

Job Description


Join FxPro: a leading international fintech company. Be a part of our expanding international team, with offices in Limassol, London, Nassau, Dubai, and Yerevan. FxPro boasts a diverse workforce of over 600 employees representing 50 nationalities, making it an exciting and dynamic workplace. At FxPro, we see each team member as an integral part of our success story.


As a Senior Streaming Data Engineer, you will be responsible for building, operating, and scaling our on-premise data platform running on Linux virtual machines. You will also enable streaming data ingestion from multiple sources and ensure reliable, production-grade data availability for analytics and machine learning use cases.


Responsibilities


  • Build and operate streaming ingestion pipelines from multiple sources into on-premise systems and databases hosted on Linux VMs
  • Design, implement, and optimize end-to-end ETL/ELT pipelines
  • Implement and maintain Kafka-based ingestion patterns, including topics, partitions, consumer groups, and reliability strategies
  • Use Redis where appropriate for caching, buffering, and real-time processing patterns
  • Maintain and optimize analytical storage solutions (e.g., ClickHouse or similar) used for BI and analytics workloads
  • Ensure reliable data ingestion from relational databases (PostgreSQL, MS SQL)
  • Implement monitoring, logging, alerting, and operational runbooks for pipelines and data systems
  • Ensure secure access and auditability across services and databases
  • Collaborate with BI, Analytics, and Data Science teams to deliver reliable datasets


Requirements


  • Strong Linux administration skills, including troubleshooting and production operations
  • Strong Python skills for building production-grade data services, automation, and testing
  • Strong SQL skills (PostgreSQL and/or MS SQL), including performance tuning
  • Hands-on experience building and operating ETL/ELT pipelines in production environments
  • Hands-on experience with Kafka and streaming data systems in production environments
  • Good understanding of core data engineering concepts such as data quality, schema evolution, partitioning, and idempotency
  • Experience working with analytical databases such as ClickHouse or similar technologies


Nice to have


  • Experience with CDC tooling or patterns (e.g., Debezium or equivalent approaches)
  • Familiarity with observability tools such as Prometheus, Grafana, ELK, or OpenSearch
  • Experience working in security-constrained production environments


Interview steps


  1. Recruiter screen (30 minutes)
  2. Technical Interview (1 hour)
  3. Final Interview with manager (30 minutes)


Our benefits


  • Excellent compensation package
  • Medical insurance
  • Provident fund
  • In-house gym with a personal trainer
  • Free daily lunch catering, snacks, and beverages
  • Company discount card for various products & services
  • 21 days of annual leave and 10 days of sick leave annually
  • Shuttle bus service from Limassol
  • Birthday gift
  • Relocation bonus and visa/work permit support

Similar Jobs

Explore other opportunities that match your interests

Senior Data Engineer - Healthcare AI

Data Science
•
24m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

ut md anderson

United State

Data Scientist - Finance Forecasting

Data Science
•
33m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

anthropic

United State

Senior Systems Lead

Data Science
•
2h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

the newt in somerset

United Kingdom

Subscribe our newsletter

New Things Will Always Update Regularly