AI Senior Software Engineer in Test
You will join an autonomous Agile team and work closely with the Product Owner, Technology Lead, Data Scientist and AI engineers to create a competitive advantage for Kaizen and offer a unique online experience to our customers. As an AI Senior Software Engineer in Test, you will utilise your experience and technical expertise to make your mark in the quality of the products and experiences we offer our customers. You will act as the voice of our customers, providing meaningful quality feedback that helps improve our AI and GenAI products and models. Your understanding of the testing lifecycle will enable you to liaise seamlessly with a broad cross-section of colleagues, product owners and stakeholders, and provide a vote of confidence regarding the quality of the product. You will help us evaluate and improve with insights the quality of our personalised recommendations by moving away beyond traditional API testing. Rather than simply verifying whether an API returns results, you will help determine whether it returns the best possible results for our customers at a given moment.
- Review user stories and acceptance criteria in order to develop effective test plans and both manual and automated tests cases in collaboration with the AI team.
- Design complex automation solutions regarding functional and non functional testing.
- Apply your deep knowledge of testing strategies and demonstrate the ability to contribute in all levels of the testing pyramid.
- Take ownership of the Software Testing Life Cycle (STLC) for new features on testing suites, taking technical ownership to ensure timely and quality delivery.
- Research test tools, methodologies, and trends and upgrade existing practices and processes.
- Use both automated and manual testing to help us evaluate and improve the quality of our personalised recommendations and responses provided by our AI and GenAI products and models.
- Lead efforts alongside our AI teams to evaluate non-deterministic conversational GenAI products and AI models.
- Bachelor's or Master's degree in Computer Science/Software Engineering or an IT-related discipline (required)
- 5+ years of experience as a Senior Software Engineer in Test (required)
- Hands-on and strong experience in at least one programming language, preferably Python (required)
- Strong knowledge of software QA methodologies, tools and processes (required)
- Hands-on experience with web browser automation tools such as Selenium or Playwright (required)
- Good understanding of all levels of the testing pyramid (required)
- Experience in defect tracking and test management tools such as JIRA, X-Ray etc (required)
- Experience working closely with product teams to understand requirements and verify/validate they are met (required)
- Passion for continuous learning, curiosity about how things work and interest in providing quality feedback to improve customer experiences (required)
- Excellent written and verbal communication skills in English (required)
- General understanding of GenAI and AI technologies (required)
- Experience testing and evaluating non-deterministic conversational GenAI products using LLMs-as-a-judge for example and AI models (nice-to-have)
- Prior experience with iGaming (nice-to-have)
- Hybrid way of working
- A buddy will support you with your onboarding
- Competitive pay & bonus scheme
- Developmental 360° feedback framework
- Monthly meal allowance
- Private health insurance for you and your family
- Unlimited access to Udemy & continuous training
- Family Support