
Senior Data Engineer
Primary stack
Nice to have's
Job description
About the Position
We're looking for a Senior Data Engineer to join our team in Abu Dhabi, United Arab Emirates in an onsite working mode. This role involves working on a large-scale data platform migration using modern data technologies and building production-ready pipelines in a dynamic delivery environment. You will be part of a dedicated engineering team focused on high-impact work that requires strong hands-on expertise.
Responsibilities
- Build, optimize, and productionize data pipelines on Databricks using PySpark and SQL
- Re-engineer and migrate transformation logic from a legacy platform to Databricks
- Design and perform data validation and reconciliation to ensure accuracy across platforms
- Tune performance through partitioning, Delta optimization, cluster configuration, and ingestion strategies
- Contribute to medallion-layer design and implement data quality frameworks
- Review code and mentor junior engineers to promote best practices
- Work within Git-based CI/CD setups and follow Agile delivery processes
Requirements
- 7+ years of data engineering experience with recent hands-on delivery
- Strong proficiency with Databricks platform, PySpark, SQL, and Delta Lake
- In-depth knowledge of ingestion patterns, Spark performance tuning, and partitioning strategies
- Solid SQL expertise with practical ability to write and validate queries
- Experience in data migration or re-platforming projects
- Professional-level English communication skills
- Bachelor’s degree in computer science, information technology, or a related field
Nice to Have
- Databricks Certified Data Engineer Professional certification
- Familiarity with Palantir Foundry
- Background in financial services or asset management
- Experience with Unity Catalog governance
- Knowledge of large-scale data quality or reconciliation frameworks
© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.
More at EPAM
All 2376 rolesSimilar jobs

Senior Data Engineer
Intellias · Spain +3

Senior Data Engineer
Intellias · Spain +3

Senior Data Engineer
Intellias · Spain +3

Senior Data Engineer
Intellias · Spain +3