Senior Test Automation Engineer (AI Systems)
- Role
- QA
- Experience
- Senior
- Employment
- Contract
Open to PL, CZ, BA, HR, RO only. Set where you work from to check your eligibility.
No BS summary
Our client, a Big4 Consultancy group, is seeking a Senior Test Automation Engineer to design and execute automated testing strategies for complex AI-enabled applications. The role involves API testing, frontend automation, backend data flows, system integration, performance testing, and validation of LLM outputs and prompt behavior.
Core skills
Required languages
About Gramian
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
About the Role
Our client is a Big4 Consultancy group that works with leading financial institutions on AI-driven transformation, automation, advanced analytics, and financial crime prevention . Their work spans intelligent fraud detection, AML/KYC modernization, autonomous workflows, enterprise AI platforms, and the secure industrialization of AI in highly regulated environments.
We are looking for a Senior Test Automation Engineer to design and execute automated testing strategies for complex AI-enabled applications. The role spans API testing, frontend automation, backend data flows, system integration, performance testing, and validation of LLM outputs and prompt behavior .
CONTRACT: Contractor assignment, expected October 2026 – July 2027, with potential extension
COMMITMENT: Full-time
LOCATIONS: Europe-based, preferably CEE; remote, with potential future hybrid work in Prague
PROCESS: Initial qualification followed by technical and client interviews
NOTES: Fluent English is required.
Responsibilities
Design and maintain comprehensive automated testing strategies across frontend, backend, APIs, and data flows. Build and maintain automated test suites using Selenium, Playwright, Cypress , or comparable frameworks. Develop test approaches for validating LLM prompts, model outputs, consistency, and hallucination behavior . Execute system integration, regression, and end-to-end testing. Perform performance and load testing before production releases. Validate that automated workflows meet defined business rules and performance SLAs. Investigate defects, document reproducible bug reports, and support root-cause analysis. Collaborate closely with developers and platform teams on issue resolution. Maintain reliable regression coverage across evolving application releases. Contribute to test standards, quality gates, and release-readiness criteria.
Requirements
5–10 years of professional QA, test automation, or software testing experience . Strong hands-on experience with Selenium, Playwright, Cypress , or similar automation frameworks. Proven experience testing complex web applications, APIs, and backend integrations . Experience designing and executing end-to-end, regression, and system integration tests. Hands-on experience with performance or load testing . Strong ability to investigate failures, identify root causes, and document defects clearly. Experience integrating automated testing into CI/CD pipelines. Fluent professional English .
What you'll do
- Design and maintain comprehensive automated testing strategies across frontend, backend, APIs, and data flows.
- Build and maintain automated test suites using Selenium, Playwright, Cypress, or comparable frameworks.
- Develop test approaches for validating LLM prompts, model outputs, consistency, and hallucination behavior.
- Execute system integration, regression, and end-to-end testing.
- Perform performance and load testing before production releases.
What they require
- 5–10 years of professional QA, test automation, or software testing experience.
- Strong hands-on experience with Selenium, Playwright, Cypress, or similar automation frameworks.
- Proven experience testing complex web applications, APIs, and backend integrations.
- Experience designing and executing end-to-end, regression, and system integration tests.
- Hands-on experience with performance or load testing.
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.