Senior General QA Engineer (LLM/AI Focus)
Recruiter
Senior General QA Engineer (LLM/AI Focus)
We at devspiration are seeking a General Senior QA Engineer to join our team. This role requires strong expertise in LLM/AI testing, test automation, and data validation across a leading professional financial services firm, one of the “Big Four” companies.
RESPONSIBILITIES:
- Design, plan, execute, and report manual and automated tests
- Validate and test LLM/AI-driven features and AI agents (prompt validation, response accuracy, edge cases, hallucination checks, etc.)
- Analyze requirements and design comprehensive test cases
- Perform API and backend testing including data validation
- Execute regression, system, and integration testing
- Collaborate closely with developers, product, and QA teams
- Report and track defects through resolution
- Participate in Agile ceremonies and contribute to continuous improvement of QA processes
- Support production releases and troubleshooting
REQUIREMENTS:
- 5+ years of professional manual and automation QA experience (web)
- Strong C# skills required; Strong Python background is highly valued. Сandidates without C# are acceptable if they understand basic concepts and are willing to upskill quickly
- Strong experience testing LLM/AI-based functionality is a must
- Understanding of AI/LLM concepts, AI agents, prompt/response validation
- Playwright experience is must
- High SQL knowledge
- Experience with application development and multi-platform architectures
- Experience with Azure DevOps or similar test management tools
- English — Upper Intermediate, both written and verbal
WE OFFER:
- A brand-new office in a BC “Natsionalnyy” + remote working options
- 18 business days of vacation, 10 days of sick leave, national holidays off
- Compensation for technical conferences/events participation
- Free English classes
- Medical insurance
Become part of a professional and patriotic team that supports the Armed Forces of Ukraine and those in need. Join us in making a meaningful impact. 💙
