Tech Stack
Azure DevOpspytestDatabricksPythonCI/CDAPI TestingETLGitSQL
Job Description, Responsibilities & Requirements
About the Position
We are seeking a Lead QA Automation Engineer to ensure the quality and reliability of our data platforms in Abu Dhabi, United Arab Emirates. You will be responsible for developing and maintaining test automation frameworks for our data pipelines, ETL processes, and backend systems. This role offers the opportunity to work on cutting-edge technologies in a highly dynamic and collaborative environment.
Responsibilities
- Design and maintain automated test frameworks (unit, integration, end-to-end)
- Drive Change and Stakeholder Engagement: Lead efforts to introduce and promote the test automation framework across teams. Drive buy-in from stakeholders and developers by demonstrating the framework's value, providing clear communication, and ensuring alignment with team goals.
- Automate data quality checks for platforms like Data Warehouses (DWH), Data lake, and BigData environments.
- Distribute Across Projects: Design the test tools as an individual package that can be reused in various projects, allowing multiple teams to benefit from a shared test automation solution.
- Automate API and backend testing (REST/gRPC)
- Run performance, scalability, and fault-tolerance tests
- Integrate tests into CI/CD pipelines
- Collaborate closely with platform, infra, and ML engineers
Requirements
Must have
- Minimum 8 years in QA Automation
- Strong, practical experience with Python (3+ years):
- Ability to write clean, maintainable automation code
- Ability to manage and extend automation frameworks
- Not just scripting - actual engineering level proficiency
- Strong, proven experience with Pytest (2+ years):
- Fixtures, parametrization, markers
- Test suite structuring
- Framework development & maintenance
- Hands-on experience with Git (daily usage):
- Branching strategies, PR workflows, code reviews
- Hands-on experience with Azure DevOps:
- Pipelines, repos, boards, test plans
- Backend & API testing expertise:
- REST services, authentication, data validation
- Ability to design and automate API tests
- Strong SQL and Python for test automation:
- Writing complex queries
- Data validation across ETL pipelines
- Experience with Databricks (2+ years):
- Not just reading notebooks - actual testing experience
- Experience with test automation tools:
- Building, maintaining, and scaling frameworks
- Understanding of CI/CD processes:
- Ability to integrate tests into pipelines
- Familiarity with data warehouses & ETL testing
- Ability to own architecture & drive quality strategy
- Experience collaborating with developers
- Able to influence, challenge, and guide engineering teams
- QA leadership experience
- Leading initiatives, mentoring, driving standards
- Fast learner, adaptable to new tools & technologies
Nice to Have
- Experience in the BSFI domain
- Understanding of the Investment Data Domain
- Familiarity with ServiceNow
- Familiarity with Dynatrace or Datadog
- PySpark experience
- ISTQB or equivalent certification
We Offer
- Competitive salary
- Relocation friendly
- Opportunity to work in a dynamic and collaborative environment
About the Company
Join our team in Abu Dhabi, United Arab Emirates, and be part of a company that values quality and innovation in data platforms.