Senior Data Engineer

About the Position

We are seeking an experienced and driven Senior Data Engineer to join our expanding Data Engineering team in Bulgaria, focusing on designing and scaling data pipelines in Databricks with PySpark on Microsoft Azure.

In this role, you will be a key member of one of our established Platform Teams, delivering reliable, scalable, and high-performance data platforms that drive innovation across our organization.

Responsibilities

• Design cloud-native analytical solutions using Big Data and NoSQL technologies
• Build and optimize scalable data pipelines in Databricks with PySpark on Azure
• Develop and maintain data lakes and data warehouses to ensure reliability and performance
• Design and implement ETL/ELT workflows to collect, clean, and structure data
• Implement data quality, lineage, and monitoring frameworks
• Collaborate with ML and analytics teams to deliver clean, production-ready datasets
• Conduct code reviews to uphold technical standards and best practices
• Mentor junior engineers and foster a high-performance, collaborative culture
• Integrate CI/CD methodologies into data engineering workflows using tools such as Jenkins or GitLab CI/CD
• Support requirements gathering and deliver solutions in alignment with architects, technical leads, and cross-functional teams
• Engage with stakeholders to understand business processes, model input data, and ensure deliverables meet requirements

Requirements

• 4+ years of experience in Data Engineering or a related field
• Proficiency in Python and PySpark
• Hands-on experience with Databricks and Microsoft Azure cloud services
• Familiarity with software version control tools (e.g., GitHub, Git)
• Experience with CI/CD frameworks such as Jenkins, Concourse, or GitLab CI/CD
• Proven ability to build scalable, robust, and highly available data solutions
• Strong problem-solving, analytical, and stakeholder engagement skills

Nice to Have

• Experience with additional programming languages such as Java, SQL, or Scala
• Knowledge of SAP BTP or similar enterprise data platforms
• Familiarity with agile development methodologies

We Offer

• Opportunity to work with cutting-edge technologies in a dynamic environment
• Competitive compensation package
• Professional growth and development opportunities

About the Company

EPAM Systems is a global software engineering and product development company, delivering digital transformation and technology innovation to the world’s leading companies.