AI Summary
Join a global platform that collects and analyzes web data to solve business problems. Design and develop high-load, highly parallel distributed systems. Work remotely or in a hybrid format from Valencia.
Key Highlights
Design and develop high-load, highly parallel distributed systems
Bypass modern anti-bot protections at both the browser and network levels
Set up monitoring and logging using Prometheus, Grafana, and Loki
Work on microservices architecture and deploy on Kubernetes
Establish development and release processes
Technical Skills Required
Benefits & Perks
Competitive salary (up to $5000 net)
Remote work flexibility
Hybrid work schedule
High autonomy and influence on architecture and team decisions
Budget for conferences, courses, and work tools
Transparent interaction with hiring managers and business involvement in hiring
Attention to work-life balance and internal initiatives of the team
Job Description
About the company and the project:
A global platform that collects and analyzes web data to solve business problems is currently looking for an experienced Scraping engineer to join its team.
The company has access to more than 20 million resident IP addresses worldwide, and its web scraping and proxy infrastructure solutions are used by leading enterprises worldwide.
Based in the USA, today the team consists of over 250 specialists working from Europe and North America.
You are offered a remote work format from anywhere in the world or hybrid form of collaboration in Valencia (prefferably).
Your tasks on the position:
- Data-planning: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
- Control-planning: API, authorization, billing, quotas, monitoring
- Infrastructure: microservices, Docker/K8s, CI/CD, observability
- Establishing development and release processes
- Code quality controlling and technical decision overseeing
- Browser and network-level fingerprinting (JA3, TLS, CDP)
- Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others
- CI/CD setup, Helm charts, scaling configuration
- Monitoring organization (Prometheus, Grafana, Loki) and SLA processes
- 3+ years of proven hands-on experience in designing and developing high-load, highly parallel distributed systems
- Advanced, practical experience in bypassing modern anti-bot protections at both the browser and network levels
- Deep knowledge of web session management, browser automation, and data extraction
- Strong experience in designing microservices architecture and deploying it on Kubernetes (including Helm charts, scaling configuration)
- Hands-on experience setting up monitoring and logging using Prometheus, Grafana, and Loki
- Experience in building and maintaining robust CI/CD pipelines
- Willingness to work remotely under a B2b contract with a UK entity or to relocate independently and work in a hybrid work format from Valencia
- English C1+
- Experience with CAPTCHA solving services
- Experience in building products from the ground up (greenfield projects)
- Background in a product company
- Willingness to relocate to Valencia for a hybrid work model
- Competitive salary depending on your experience and skills (up to 5000$ net)
- Remote work flexibility or working in a modern office in Valencia 5/2 in a hybrid work schedule
- High autonomy and influence on architecture and team decisions
- Budget for conferences, courses, and work tools
- A team with strong expertise and an open feedback culture
- Transparent interaction with hiring managers and business involvement in hiring
- Attention to the work-life balance and internal initiatives of the team
- Participatig in developing the company's key product from scratch