Lead Cloud Engineer
About Us
At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 240 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data
For more than a decade, Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. And today, the data we extract helps thousands of organizations make smarter business decisions, secure competitive advantage, and drive sustainable growth. Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web. About the Job:
As Lead Cloud Engineer, you will drive the architecture, development, and reliability of our Scrapy Cloud platform. You take the lead in implementing best practices for scalability, performance optimization, and system resilience. This role combines hands-on engineering with strategic leadership, focusing on high-availability infrastructure, automation, and continuous improvement in cloud software development.
About the Team
The Scrapy Cloud team, within the App team, comprises developers, data engineers, and product managers focused on building a high-performance, scalable platform. We prioritize engineering excellence, reliability, and collaboration, fostering a culture of innovation and continuous improvement.
Requirements
Roles & Responsibilities
- Lead the design and development of the Scrapy Cloud product maintaining high quality, performance, scalability and resiliency.
- Encourage team collaboration and open communication, facilitating regular meetings for brainstorming and feedback.
- Coordinate with product management to align team objectives with business goals.
- Drive the architectural decisions and guide technical design discussions within the team.
- Identify performance bottlenecks and implement solutions proactively.
- Mentor team members and support their professional growth through feedback and development plans.
- Stay up-to-date with industry trends and technologies to foster innovation.
- Ensure high delivery standards while maintaining a healthy team culture.
Requirements
- Proficient in Python and experience with web frameworks such as Django, Flask, or similar.
- Strong background in cloud technologies (e.g., AWS, GCP, Kubernetes) and containerization.
- Thorough understanding of managing and optimizing cloud infrastructure and performance.
- Proven experience with CI/CD pipelines and infrastructure-as-code tools.
- Experience with designing and implementing APIs
- Excellent communication skills in English, both written and verbal.
Benefits
By joining the Zyte team, you will
- Become part of a self-motivated, progressive, multi-cultural team.
- Have the freedom & flexibility to work remotely.
- Get the chance to work with cutting-edge open source technologies and tools.
At Zyte, we eat data for breakfast and you can eat your breakfast anywhere while you work for Zyte. Foun
ded in 2010, we are a globally distributed team of over 200 Zytans working from over 28 countries. We are on a
mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data.For more than a decade, Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. And today, the data we extract helps thousands of organizations make smarter business decisions, secure competitive advantage, and drive sustainable growth. Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web.
By joining the Zyte team, you will:
Become part of a self-motivated, progressive, multi-cultural, and curious team that excel every day.
- When you need help there is always someone there who has your back.
- Have the freedom & flexibility to work remotely.
- We are committed to making our customers excited.We love to innovate and create new ways of doing things, always striving to do better and be better.
- Get the chance to work with cutting-edge technologies and tools.