Zyte
Quality Engineer (Automation & AI)
RemoteNot specified. Estimate: worldwide · 83% confidence
- Role
- QA
- Employment
- Full-time
Salary not disclosed
Check eligibility
The listing doesn't say where it hires from. It may be open worldwide (83% confidence). This is an estimate, not an eligibility rule; verify before applying.Signals: company workplace model and company offices.
No BS summary
Quality automation engineer for an AI-native QA role. Needs strong test automation, preferably Playwright, CI/CD with GitHub Actions or similar, and hands-on use of AI coding agents like Claude Code.
Core skills
AI coding agentsPlaywrightGitHub Actions
Required skills
Claude CodeVS CodeCI/CDLLM APIs
Optional skills
LLM-based applicationsPrompt engineeringAI observabilityJira
About the Role
Zyte is looking for a Quality Engineer to join our unified Quality Engineering function. This is an automation-first, AI-native role embedded directly within our engineering squads.
You will be responsible for designing risk-based test strategies, rapidly converting them into automated checks using AI-assisted development workflows, and continuously improving the quality, speed, and reliability of software delivery. Quality at Zyte is not a gatekeeping function. It is an engineering discipline focused on preventing defects, accelerating delivery, and increasing confidence in every release.
AI coding agents are a core part of how we work. You will be expected to use Claude Code or equivalent AI-assisted development environments as your primary development partner for generating, reviewing, debugging, refactoring, and maintaining automation code.
What You Will Do
- Design risk-based test strategies for new features and releases, then rapidly convert those strategies into automated coverage using AI-assisted development workflows
- Use Claude Code within VS Code or equivalent AI coding agents as your primary development environment to generate, scale, and maintain automated test coverage
- Build and maintain automated test suites using Playwright, integrated within GitHub CI/CD pipelines, ensuring quality gates are embedded throughout the software development lifecycle
- Design and implement agentic testing workflows that generate, adapt, and maintain automated tests using AI models and APIs
- Build reusable frameworks, utilities, shared libraries, and AI-powered tools that increase test authoring velocity across engineering teams
- Partner closely with engineers, product managers, and designers to shift quality left, influencing requirements, design decisions, observability, and deployment strategies
- Continuously improve test suite health by reducing flakiness, increasing execution speed, and ensuring reliable quality signals for every release
- Drive quality upstream by identifying risks early and implementing preventative quality practices
- Own and improve quality metrics including automated coverage growth, escaped defects, test execution performance, flakiness rates, and release confidence
- Enable developers to write, execute, and maintain automated tests as part of their daily workflow
What We Are Looking For
- Strong software engineering fundamentals, with the ability to review, validate and debug code across any modern programming language
- Strong experience with modern test automation frameworks, preferably Playwright
- Demonstrated ability to use AI coding agents as a primary development partner for generating, reviewing, debugging, refactoring, and maintaining code
- Comfortable delegating significant portions of implementation work to AI agents while maintaining high engineering and quality standards
- Experience building and maintaining scalable automation frameworks
- Experience integrating automated test suites into CI/CD pipelines using GitHub Actions or similar platforms
- Experience with agentic testing frameworks, AI-powered testing tools, or LLM API integrations within engineering workflows
- Proven track record of increasing automation coverage, reducing manual effort, and improving software quality outcomes
- Strong understanding of quality engineering principles, test strategy, risk analysis, and defect prevention
- Comfortable working as an embedded engineer within cross-functional product squads
- Strong communication skills with the ability to provide concise, actionable updates and collaborate effectively across teams
- Curiosity, adaptability, and a growth mindset toward emerging AI technologies and engineering practices
Nice to Have
- Experience testing AI-powered products, agents, or LLM-based applications
- Experience designing evaluation frameworks for AI-generated outputs
- Familiarity with prompt engineering, AI quality assessment, and AI observability
- Experience with performance, load, or resilience testing
- Experience with test management platforms integrated with Jira
- Experience building internal developer platforms, testing tools, or engineering productivity solutions
Success in This Role
Within your first six months, you will:
- Increase automated regression coverage for your squad
- Reduce manual testing effort sprint over sprint
- Build reusable automation components adopted by multiple teams
- Demonstrate effective use of AI agents to accelerate automation development and maintenance
- Improve release confidence while supporting fast, reliable software delivery
- Contribute to a culture where quality is owned by the entire engineering team
What you'll do
- Design risk-based test strategies for new features and releases and convert them into automated coverage using AI-assisted development workflows
- Use Claude Code within VS Code or equivalent AI coding agents as the primary development environment to generate, scale, and maintain automated test coverage
- Build and maintain automated test suites using Playwright integrated within GitHub CI/CD pipelines
- Embed quality gates throughout the software development lifecycle
- Design and implement agentic testing workflows that generate, adapt, and maintain automated tests using AI models and APIs
- Build reusable frameworks, utilities, shared libraries, and AI-powered tools that increase test authoring velocity across engineering teams
- Partner with engineers, product managers, and designers to shift quality left
- Influence requirements, design decisions, observability, and deployment strategies
- Continuously improve test suite health by reducing flakiness and increasing execution speed
- Ensure reliable quality signals for every release
- Drive quality upstream by identifying risks early and implementing preventative quality practices
- Own and improve quality metrics including automated coverage growth, escaped defects, test execution performance, flakiness rates, and release confidence
- Enable developers to write, execute, and maintain automated tests as part of their daily workflow
What they require
- Strong software engineering fundamentals, with the ability to review, validate, and debug code across any modern programming language
- Strong experience with modern test automation frameworks, preferably Playwright
- Demonstrated ability to use AI coding agents as a primary development partner for generating, reviewing, debugging, refactoring, and maintaining code
- Comfortable delegating significant portions of implementation work to AI agents while maintaining high engineering and quality standards
- Experience building and maintaining scalable automation frameworks
- Experience integrating automated test suites into CI/CD pipelines using GitHub Actions or similar platforms
- Experience with agentic testing frameworks, AI-powered testing tools, or LLM API integrations within engineering workflows
- Proven track record of increasing automation coverage, reducing manual effort, and improving software quality outcomes
- Strong understanding of quality engineering principles, test strategy, risk analysis, and defect prevention
- Comfortable working as an embedded engineer within cross-functional product squads
- Strong communication skills with the ability to provide concise, actionable updates and collaborate effectively across teams
- Curiosity, adaptability, and a growth mindset toward emerging AI technologies and engineering practices
- Preferred: Experience testing AI-powered products, agents, or LLM-based applications
- Preferred: Experience designing evaluation frameworks for AI-generated outputs
- Preferred: Experience with performance, load, or resilience testing
- Preferred: Experience building internal developer platforms, testing tools, or engineering productivity solutions
Zyte builds tools and services to collect, format, and deliver web data at scale for businesses.
Details
Apply routeWorkable
Salary not disclosed