Job Description, Responsibilities & Requirements
About the Position
We are looking for a talented Senior Python Engineer with Spark to join our team working on financial data and analytics. You'll be a crucial player in a team accountable for data integration and transformation, developing models and managing a vast array of structured financial data.
You'll design and build robust software that efficiently processes data through our medallion architecture. We make use of cutting-edge technology with Databricks on Microsoft Azure.
Responsibilities
- Design and build software for processing data through medallion architecture on Databricks in Microsoft Azure
- Apply software engineering processes and principles to data engineering
- Work across the whole software development lifecycle
- Provide mentorship to junior engineers
Requirements
- At least 3 years of experience in Python software development
- Solid understanding of Apache Spark and its applications
- Proficient in Data Modeling and SQL for efficient data processing
- Experience working with Databricks in Microsoft Azure for data processing and analysis
- Ability to work across the whole software development lifecycle, including understanding requirements, contributing to designs, writing code, writing automated tests, providing production support, and helping with deployments
- B2+ English level proficiency
Nice to Have
- Experience with Databricks and Delta Lake
About the Company
EPAM Systems is a global software engineering and product development company that partners with many of the world's leading businesses to deliver high-quality software solutions. We are committed to innovation, quality, and customer satisfaction.
We Offer
- Opportunity to work in a dynamic and innovative environment
- Competitive compensation package
- Professional growth and development opportunities
- Collaborative and inclusive work culture