Lead Python Data Engineer
Primary stack
DatabricksPythonAzure
Nice to have's
LeadershipData pipeline performance optimizationData quality assuranceCross-functional collaborationTechnical guidance
Job description
Description language:
About the Position
We are in search of a skilled Lead Python Data Engineer to join our team. The successful candidate will play a crucial role in developing data pipelines in Azure, with a primary focus on building a Data Quality framework.
Responsibilities
- Develop and maintain data pipelines in Azure, with a specific focus on DQ framework development
- Collaborate with cross-functional teams to design, develop, and implement data solutions
- Create and implement data models and processes for data extraction, transformation, and loading
- Optimize and monitor data pipeline performance and reliability
- Ensure data quality and integrity throughout the data pipeline process
- Troubleshoot and resolve data pipeline issues in a timely manner
- Contribute to the continuous improvement of data engineering best practices
- Provide technical guidance and support to team members as necessary
Requirements
- Minimum of 5 years of experience in Data Software Engineering
- 1+ years of relevant leadership experience
- Proficiency in Python and hands-on experience with Azure Data Factory
- Strong understanding and practical knowledge of Databricks
- Ability to design, develop, and maintain scalable data pipelines
- Solid understanding of data modeling, data access, and data storage techniques
- Experience with data pipeline orchestration and workflow management
- Strong analytical and problem-solving abilities
- Excellent written and verbal communication skills
- B2+ English level proficiency
We Offer
- Opportunity to work remotely in Ukraine
- Be part of a dynamic and innovative team
- Competitive salary and benefits package
- Professional growth and development opportunities
About the Company
[Company description if present]
© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.