GenAI Quality Engineer
Primary stack
Nice to have's
Job description
About the Position
We are looking for a GenAI Quality Engineer to join our team at Tieto Tech Consulting in Sofia, Bulgaria. In this role, you will help ensure the quality, reliability, and performance of modern AI-first applications, including products powered by Large Language Models (LLMs).
This role is based on a hybrid work model, with 3 days per week in our Sofia office.
Responsibilities
- Validate LLM-based applications and AI-generated outputs
- Evaluate quality, reliability, and behavior of probabilistic AI systems
- Create test cases from evolving requirements
- Identify gaps, inconsistencies, and risks in product requirements
- Collaborate with product managers, engineers, and AI specialists throughout the development lifecycle
- Analyze defects, perform root cause analysis, and drive issue resolution
Requirements
- Experience testing AI-powered applications, GenAI solutions, chatbots, copilots, or similar products
- Understanding of AI/ML concepts and Large Language Models (LLMs)
- Strong analytical and problem-solving skills
- Experience creating test plans, test cases, and quality metrics
- Excellent spoken and written English
Nice to Have
- Experience with AI testing tools and frameworks
- Experience evaluating LLM responses for accuracy, relevancy, safety, and consistency
- Familiarity with prompt engineering and AI quality assessment techniques
- Knowledge of Python or another programming language used in automation
- Experience working in Agile development environments
- Exposure to cloud platforms such as Azure, AWS, or GCP
We Offer
- Opportunity to work in a dynamic and innovative environment
- Be part of a leading technology company with an annual revenue of approximately EUR 2 billion
- Join a team of over 14,000 talented professionals
About the Company
Tieto Tech Consulting (MentorMate from 2001 to 2026) provides design-led, data-centric, and AI-powered digital engineering & consulting services to enterprises worldwide. With a strong heritage of Nordic quality, local presence, and global-scale operations, we are backed by 8,500+ IT professionals. Our clients trust us for advanced data and analytics skills, top industry-specific expertise, specialized software R&D, and the capabilities of a multinational team.
We believe in the power of diversity, equity, and inclusion. We encourage applicants of all backgrounds, genders (m/f/d), and walks of life to join our team, as we believe that this fosters an inspiring workplace and fuels innovation.
Stay alert to recruitment scams:
-
Tieto only communicates via @tieto.com email addresses.
-
We never ask candidates to pay fees or share financial details during recruitment.
-
If you receive a suspicious message claiming to be from Tieto, don't respond - verify it via our official careers site.
-
For more information visit Important Advisory Regarding Recruitment Fraud | Tieto Blog
© Tietoevry Create Ukraine (formerly Infopulse Ukraine). This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
Tietoevry Create is a global leader in design, data, and digital engineering services. Combining local expertise with the power of around 9,000 global team members, we build tailored digital solutions that align with our customers’ business objectives and maximize their value.About IntegrationInfopulse has been part of Tietoevry since 2007 and is now undergoing full integration into Tietoevry Create, one of the company’s specialized business units. This strategic alignment brings together our decades of trusted engineering excellence with Tietoevry’s global delivery capabilities and focused expertise in AI, digital design, and modern software development. The integration not only enables deeper collaboration and knowledge sharing across teams but also ensures our partners & clients benefit from a unified, future-ready portfolio of services.Join a truly global digital collective of over 9,000 team members united by a love for technology. With industry-leading expertise in design, data and engineering, we accelerate business value and craft impactful digital solutions. Welcome to Tietoevry Create!Why choose us?Enjoy a truly hybrid work modelWe believe that flexibility drives value and sustainability for our team and clients alike. That is why we chose a hybrid work model that supports our different needs and ensures an outstanding work-life balanceBe an important part of a global teamOur individuality and passion for technology unite us and enable us to create an environment of mutual professional nurturing. Leveraging our industry expertise and skill set, we carefully select suitable technologies to empower our team and deliver exceptional results.Grow your skills in meaningful projectsThe best way to learn is by doing and in our constant pursuit of excellence, we broaden our skillset while we do our work. We share our knowledge and collaborate in creating impactful solutions for global clients daily.TietoevryTietoevry is a leading software and digital engineering services company with global market reach and capabilities. We provide customers across different industries with mission-critical solutions through our specialized software businesses* Tietoevry Care, Tietoevry Banking and Tietoevry Industry, as well as our digital engineering business Tietoevry Create. Our 16 000* talented vertical software, design, cloud and AI experts are dedicated to empowering our customers to succeed and innovate with latest technology.Tietoevry’s annual revenue for the continuing businesses* is approximately EUR 2 billion. The company’s shares are listed on the NASDAQ exchange in Helsinki and Stockholm, as well as on Oslo Børs.www.tietoevry.com* Tietoevry Tech Services is excluded due to the divestment signed in March 2025. The transaction is expected to close during Q3 2025.
More at Tietoevry Create Ukraine (formerly Infopulse Ukraine)
All 66 rolesDevOps Engineer (Temporary) - Tieto Caretech (m/f/d)
Tietoevry Create Ukraine (formerly Infopulse Ukraine) · Finland
Informatica Analyst - Tieto Tech Consulting (m/f/d)
Tietoevry Create Ukraine (formerly Infopulse Ukraine) · Finland
Senior SW Engineer - Tieto Banktech (m/f/d)
Tietoevry Create Ukraine (formerly Infopulse Ukraine) · Sweden
Automation Quality Engineer
Tietoevry Create Ukraine (formerly Infopulse Ukraine) · Bulgaria