Overview
NOTE: HYBRID work model, 2-days/week in office. Office located in Toronto, Ontario.
Type: 6 Month Contract, 7.5 hours/day, 37.5 hours/week with a strong possibility of extension
Work Experience: 8+ years as Senior QA API Automation Engineer, API, API Security Testing, Playwright, Cypress, RestAssured, Postman/Newman, Karate, AI/LLM test cases, JSON, Jenkins, GitHub, WireMock, Java, JavaScript/TypeScript, Python, Pytest, C#, microservices, JMeter, Gatling, k6, Docker, Kubernetes, QA Lead, Agile
Industry: Bank
DESCRIPTION:
Seeking an outstanding Senior QA API AI Automation Engineer to lead the architecture, strategy, and execution of API automation across our digital platforms, including AI- and LLM-powered services. This is a senior technical expert role focused on driving quality engineering excellence, building modern automation frameworks, and elevating test maturity through innovation and best practices.
Key Responsibilities
- Own the end-to-end API automation strategy and framework architecture across microservices and distributed systems.
- Build advanced API automation using Playwright (API), Cypress (API), RestAssured, Postman/Newman, and Karate.
- Design and automate AI/LLM test use cases to validate response quality, correctness, consistency, determinism, and safety.
- Build API-level automated tests for LLM prompt handling, structured outputs (JSON), error scenarios, and edge cases.
- Implement contract testing, schema validation, negative testing, and API security testing.
- Integrate automation into CI/CD pipelines (Jenkins, GitHub Actions) and drive shift-left quality practices.
- Use service virtualization and mocking tools (WireMock) to stabilize environments and accelerate delivery.
- Improve automation stability, reduce flakiness, and define quality KPIs and reporting metrics.
- Provide technical leadership, mentorship, and code reviews across automation initiatives.
Hands-On Playwright Experience
- Hands-on expertise with Playwright to design, build, and maintain enterprise-grade API automation frameworks.
- Implement service virtualization to simulate complex backend systems, third-party services, and AI dependencies, enabling early and stable testing.
- Design and enforce API contracts, schema validation, and data-driven tests using Playwright.
- Integrate Playwright test suites into CI/CD pipelines and leverage dashboards to track coverage, execution health, and quality KPIs.
- Collaborate with security, architecture, and DevOps teams to align Playwright usage with enterprise governance standards.
- Provide best-practice guidance and technical leadership on scalable Playwright adoption.
Required Qualifications
- 8–12 years of QA and automation experience, including 4–6 years in a senior or QA Lead role.
- Lead a team of 5-6 QA Automation Engineers.
- Deep expertise with API automation frameworks and strategies.
- Strong programming skills in Java, JavaScript/TypeScript, Python, Pytest, or C#.
- Hands-on expertise with Playwright, Cypress, RestAssured, Karate, and Postman/Newman.
- Strong experience with CI/CD pipelines, microservices, Git, cloud platforms, and containerization.
Preferred Qualifications
- Experience testing AI- and LLM-powered APIs and validating response quality and correctness.
- Familiarity with AI quality risks such as hallucinations, non-deterministic outputs, bias, and response drift.
- Experience validating structured AI outputs (JSON, schemas, contracts).
- Contract testing (Pact) and performance testing (JMeter, Gatling, k6).
- API security testing and advanced service virtualization experience.
- Demonstrated mentorship and technical leadership experience.
Key Skills
Playwright (API), Cypress (API), RestAssured, Postman, Karate, Python, Pytest, AI/LLM API Testing, CI/CD, Docker, Kubernetes, JavaScript
As part of our hiring process, we use AI‑based systems to support the initial screening of applicants.
