Java QA Automation Engineer

About the Position

Java QA Automation Engineer

Bucharest / Romania

Testing & Quality Assurance /

Fixed term /

Remote

Apply for this job

About Qualysoft

Qualysoft is a software engineering company with 25 years of experience, established in Vienna, Austria, and active in Romania since 2007. We deliver End to End IT Consulting Services, including Team Augmentation, Dedicated Teams, and Custom Software Development. Our expertise spans multiple industries such as BSFI, Telecom, Retail & E-commerce, Energy and Utilities, Automotive, Manufacturing, Logistics, and High Tech.

We are powered by cutting-edge technologies: AI, Data & Analytics, Cloud, DevOps, IoT, and Test Automation. Our global presence includes Switzerland, Germany, Austria, Sweden, Hungary, Slovakia, Serbia, Romania, and Indonesia. With a team of over 500+ software engineers, we have strategic partnerships with Microsoft, Tricentis, Creatio, and Doxee.

Responsibilities

• Build API and integration test coverage for Java/Spring routers and database workflows.
• Design and implement Playwright E2E tests for critical user journeys.
• Create stable mocking and fixture strategies (MSW, test fixtures, seeded test data).
• Set up CI quality gates for linting, unit/integration/E2E tests, coverage, and reporting.
• Expand coverage to untested UI and workflow areas and prevent regressions.
• Build an LLM evaluation discipline with golden datasets and measurable quality gates.
• Track model output reliability, detect drift, and gate releases on quality/stability thresholds.
• Improve test maintainability, remove flakiness, and optimize runtime.
• Use LangChain4j for JVM-native LLM application support, including agents, RAG, and guardrails.
• Use Langfuse Java SDK and OpenTelemetry for trace capture, prompt/version tracking, and experiment comparison.
• Use the OpenAI Java SDK for structured outputs, function calling, webhook verification, and response validation.
• Use Promptfoo in CI for language-agnostic regression and red-team checks around the Java stack.
• Use Java schema validation and guardrail patterns with Jackson, Swagger annotations, and LangChain4j guardrails.
• Use OpenTelemetry-based traces and Langfuse datasets as the reproducible source of truth for release gates.

Requirements

• 3+ years in QA automation for production systems.
• Strong Java backend testing skills.
• Strong frontend testing.
• Experience building and maintaining Playwright/Cypress/Selenium E2E suites.
• API testing experience (REST, schema validation, auth/error scenarios).
• Experience with SQL/PostgreSQL testing and test data management.
• CI/CD pipeline experience (GitHub Actions, Azure Pipelines, or Jenkins).
• Practical understanding of testing non-deterministic LLM outputs.

Nice to Have

• Familiarity with Java-compatible LLM evaluation and regression tooling such as Promptfoo and Langfuse, plus trace-based observability and output validation via API/OpenTelemetry integrations.
• Performance and benchmark testing experience.
• WebSocket testing experience.
• Security and dependency scanning awareness.
• Experience in legal-tech, fintech, or other regulated domains.

We Offer

• Premium medical package
• Lunch Tickets & Pluxee Card
• Bookster subscription
• 13th salary/yearly bonuses
• Enterprise job security with a startup mentality (diverse & engaging environment, international exposure, flat hierarchy) under the stability of a secure multinational
• A supportive culture (we value ownership, autonomy, and healthy work-life balance) with great colleagues, team events, and activities
• Flexible working program and openness to remote work
• Collaborative mindset – employees shape their own benefits, tools, team events, and internal practices
• Diverse opportunities in Software Development with international exposure
• Flexibility to choose projects aligned with your career path and technical goals
• Access to leading learning platforms, courses, and certifications (Pluralsight, Udemy, Microsoft, Google Cloud)
• Career growth & learning – mentorship programs, certifications, professional development opportunities, and above-market salary

About the Company

We are an equal opportunity employer and value diversity. All employment decisions are made without regard to age, gender, disability, race, ethnicity, religion, sexual orientation, or any other protected characteristic. We encourage applicants from all backgrounds to apply.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.