Senior Data Engineer
Primary stack
Nice to have's
Job description
About the Position
We are seeking a Senior Data Engineer to join our insurance project team. In this role, you will be responsible for designing and building robust ETL pipelines, ensuring the quality of data deliverables, and supporting data migration efforts. You will collaborate closely with cross-functional teams to lock requirements early, drive quality through developer-led testing, and contribute to the successful delivery of complex data initiatives within the insurance domain.
Responsibilities
- Develop extraction, transformation, validation, reconciliation, and loading logic in line with approved source-to-target mappings and ETL HLDs
- Own the quality of ETL deliverables by designing, executing, and evidencing developer-led testing before QA involvement
- Create and maintain automated unit tests, component tests, and data validation checks for ETL pipelines
- Validate source-to-target mappings, transformation logic, reconciliation controls, and error-handling scenarios as part of development
- Produce test evidence demonstrating that ETL code meets functional and non-functional requirements prior to promotion
- Support dry runs and test migrations, investigate defects, perform root cause analysis, and implement fixes
- Build ETL jobs that can be re-run safely with clear logging and error handling
- Create and update supporting documentation such as runbooks and technical implementation notes
- Actively participate in ALL scrum ceremonies
- Contribute to the "Three Amigos" discussions (typically BA, QA, Tech Lead) for each ETL story to lock requirements and acceptance criteria early and avoid rework
- Raise and manage technical dependencies early with the Delivery Manager
Requirements
- 5+ years of experience in data engineering
- Background in operational data migration
- Expertise in ETL design and build, including migration orchestration
- Proficiency in SQL
- Knowledge of Python and PySpark
- Excellent command of written and spoken English (B2+ level)
Nice to Have
- Familiarity with Databricks
- Knowledge of PostgreSQL databases
- Experience with AWS S3 buckets
- Understanding of Apache Kafka
- Skills in Java APIs, REST, and SOAP
- Competency in ETL performance optimisation
- Proficiency in Jenkins and Git
- Experience with EIS (Billing v12, ClaimCore v12, CustomerCore v20, PolicyCore v12, EIS Solutions)
- Familiarity with Prometheus and Grafana
- Understanding of the insurance domain, specifically within the UK market
We Offer
- Remote work in Ukraine
About the Company
[Company description if present]
© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.