QA Expert (Manual Testing, AI/ML Focus)

Be the quality guardian for cutting-edge AI Agents and ML models that serve thousands of customers of DSK Bank daily. You’ll ensure that AI assistants providing financial guidance, real-time product recommendations, and intelligent issue resolution work flawlessly and safely. Your rigorous testing will protect customers from AI errors and the bank from operational risks, while accelerating the safe release of innovative features. You’ll be the critical bridge between rapid AI innovation and production reliability—offloading development teams and establishing quality baselines that enable faster, safer deployments.

General duties:

Design and execute comprehensive manual testing strategies for AI Agents, ML models, and cross system integrations across ML & AI platforms.

Validate LLM/Agent behavior, output accuracy, guardrail adherence, and edge cases; probe risky scenarios and document reproducible test cases.

Perform API testing using tools like Postman or Swagger; ensure contract adherence and proper error handling.

Conduct back-end quality checks using SQL for data integrity, validation, and reconciliation across services .

Create and maintain detailed test plans, test cases, scripts, and reports; track defects and manage UAT sign-offs in Azure DevOps or similar tools.

Execute regression testing after feature changes to protect critical banking journeys.

Partner with automation engineers to prioritize and integrate high-value automated tests into CI/CD pipelines.

Collaborate with Data Scientists, ML Engineers, Software Developers, DevOps, Product Owners, and Business Analysts to triage defects, align on acceptance criteria, and ensure quality gates before production releases.

Requirements:

Must have

3+ years of hands-on experience in manual testing.

Strong proficiency with REST API testing.

Solid SQL skills for writing queries and performing data validations.

Experience in Agile/Scrum methodologies and working with cross-functional teams.

Excellent communication skills in English.

Nice to have

Back-end and API testing experience with tools like Postman, Swagger, or similar.

Experience with test management and defect tracking tools (Azure DevOps Test Plans, JIRA, or similar).

Familiarity with CI/CD integration and collaboration with automation engineers.

Strong analytical thinking and attention to detail for uncovering edge cases.

Experience testing AI/ML systems, LLM evaluation, or prompt engineering.

Background in fintech, banking, or financial reporting systems.

Automation testing skills (Selenium, Cypress, or similar).

ISTQB® Certified Tester – AI Testing (CT-AI) or similar certification.

Experience with performance testing or security testing of APIs.

What we offer:

Excellent opportunities for professional and career development in one of Bulgaria’s leading banks;

Food vouchers in the amount of 102.26 EUR per month;

25 paid holiday leave;

Additional Health Insurance;

Favorable conditions for housing and mortgage lending, as well as for bank products and services;

Annual bonus scheme depending on the achieved results;

Preferential conditions for Multisport / CoolFit card;

Great location;

Discounts in various companies;

Professional trainings for specific knowledge and skills (internal academies);

Refer a Friend Bonus.

If you are challenged by this opportunity, we would be glad to review your application.If you are challenged by this opportunity, please send your detailed CV in English with a recent photo. Only short-listed candidates will be contacted. All applications will be treated in strict confidentiality.