Senior Azure Data Engineer
Primary stack
Nice to have's
Job description
About the Position
We are looking for a Senior Azure Data Engineer to join our team and drive the development and optimization of scalable data solutions in the cloud.
The ideal candidate will have deep expertise in PySpark, strong experience with Azure Data Factory and Synapse, and a solid background in modern DevOps practices.
Responsibilities
- Design, develop and optimize large-scale data processing solutions with PySpark
- Implement and maintain advanced data pipelines and workflows in Azure Data Factory and Azure Synapse
- Develop, automate and monitor development and build pipelines for robust data engineering solutions
- Collaborate with cross-functional teams to deliver scalable and reliable data solutions
- Apply best practices for code optimization, version control with Git and infrastructure automation
- Integrate Azure Functions for data orchestration and transformation tasks
- Contribute to infrastructure setup and automation using Terraform
- Document solutions and mentor junior team members
Requirements
- Minimum 8 years’ experience in data engineering
- Expertise in PySpark with a focus on writing optimized and scalable code
- Background in Azure Data Factory and Azure Synapse for data integration and orchestration
- Skills in Azure services and Azure Functions
- Experience designing and managing development and build pipelines in cloud environments
- Proficiency in Git for version control and collaboration
- Familiarity with Terraform for infrastructure automation
- Qualifications in integrating Azure Functions into data workflows
- Knowledge of building development and build pipelines
- Advanced knowledge of Azure DevOps, CI/CD and infrastructure as code tools
- Competency in problem-solving, communication and documentation skills
We Offer
- Opportunity to work remotely from Ukraine
- Engaging in cutting-edge data engineering projects
- Collaborate with a team of experienced professionals
About the Company
EPAM Systems is a global software engineering and product development company, delivering digital transformation and technology innovation to the world’s leading companies.
© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.