AI Summary
Join a global platform that collects and analyzes web data to solve business problems. As a Senior Scraping Engineer, you will design and develop high-load, highly parallel distributed systems. You will work with a team of over 250 specialists from Europe and North America.
Key Highlights
Design and develop high-load, highly parallel distributed systems
Bypass modern anti-bot protections at both the browser and network levels
Design microservices architecture and deploy it on Kubernetes
Set up monitoring and logging using Prometheus, Grafana, and Loki
Build and maintain robust CI/CD pipelines
Technical Skills Required
Benefits & Perks
Competitive salary up to $5000 net
Remote work flexibility or hybrid work schedule
High autonomy and influence on architecture and team decisions
Budget for conferences, courses, and work tools
Job Description
About the company and the project:
A global platform that collects and analyzes web data to solve business problems is currently looking for an experienced Scraping engineer to join its team.
The company has access to more than 20 million resident IP addresses worldwide, and its web scraping and proxy infrastructure solutions are used by leading enterprises worldwide.
Based in the USA, today the team consists of over 250 specialists working from Europe and North America.
You are offered a remote work format from anywhere in the world or hybrid form of collaboration in Valencia (prefferably).
Your tasks on the position:
- Data-planning: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
- Control-planning: API, authorization, billing, quotas, monitoring
- Infrastructure: microservices, Docker/K8s, CI/CD, observability
- Establishing development and release processes
- Code quality controlling and technical decision overseeing
- Browser and network-level fingerprinting (JA3, TLS, CDP)
- Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others
- CI/CD setup, Helm charts, scaling configuration
- Monitoring organization (Prometheus, Grafana, Loki) and SLA processes
- 3+ years of proven hands-on experience in designing and developing high-load, highly parallel distributed systems
- Advanced, practical experience in bypassing modern anti-bot protections at both the browser and network levels
- Deep knowledge of web session management, browser automation, and data extraction
- Strong experience in designing microservices architecture and deploying it on Kubernetes (including Helm charts, scaling configuration)
- Hands-on experience setting up monitoring and logging using Prometheus, Grafana, and Loki
- Experience in building and maintaining robust CI/CD pipelines
- Willingness to work remotely under a B2b contract with a UK entity or to relocate independently and work in a hybrid work format from Valencia
- English C1+
- Experience with CAPTCHA solving services
- Experience in building products from the ground up (greenfield projects)
- Background in a product company
- Willingness to relocate to Valencia for a hybrid work model
- Competitive salary depending on your experience and skills (up to 5000$ net)
- Remote work flexibility or working in a modern office in Valencia 5/2 in a hybrid work schedule
- High autonomy and influence on architecture and team decisions
- Budget for conferences, courses, and work tools
- A team with strong expertise and an open feedback culture
- Transparent interaction with hiring managers and business involvement in hiring
- Attention to the work-life balance and internal initiatives of the team
- Participatig in developing the company's key product from scratch