EPAM logo

Senior Data Engineer (PySpark)

EPAM·Salary not specified

Job description

About the Position

Senior Data Engineer (PySpark)

We are seeking a Senior Data Engineer with expertise in AI-enabled data platforms and PySpark to join our team in Hungary. This role is hybrid and offers a unique opportunity to work in a dynamic, entrepreneurial corporate environment.

Responsibilities

  • Implement data processing and transformation with Python, PySpark, and SparkSQL
  • Work with OneLake (Delta / OpenLake) for efficient data storage and analytics
  • Develop and support solutions using Cosmos DB (NoSQL API)
  • Contribute to Fabric workloads including Data Engineering, Data Factory Gen2, and Lakehouse
  • Design, develop, and maintain scalable data pipelines using Azure Fabric
  • Implement and maintain CI/CD pipelines and follow DevOps best practices
  • Integrate data solutions with Power BI for reporting and analytics
  • Collaborate with AI, data science, and product teams to support AI-driven use cases
  • Ensure data quality, performance, security, and reliability
  • Participate in Agile ceremonies and contribute to sprint delivery
  • Support production issues and continuous improvements

Requirements

  • 5+ years of experience in Data Software Engineering or related engineering roles
  • Solid experience with PySpark and SparkSQL
  • Experience with Cosmos DB (NoSQL API)
  • Hands-on experience with OneLake or Delta Lake and OpenLake concepts
  • Knowledge of Data Factory Gen2 and M-code
  • Experience with CI/CD pipelines using Azure DevOps or equivalent
  • Good understanding of Azure services
  • Experience integrating data solutions with Power BI
  • Experience with Azure Fabric would be an asset
  • Strong problem-solving and analytical skills
  • Ability to work independently on complex tasks
  • Experience working in Agile or Scrum environments
  • Upper-intermediate proficiency in English (B2+)

Nice to Have

  • Engineering community of industry professionals
  • Friendly team and enjoyable working environment
  • Flexible schedule and opportunity to work remotely within Hungary
  • Chance to work abroad for up to 60 days annually
  • Business-driven relocation opportunities

We Offer

  • Dynamic, entrepreneurial corporate environment
  • Diverse multicultural, multi-functional, and multilingual work environment
  • Opportunities for personal and career growth in a progressive industry
  • Global scope, international projects
  • Widespread training and development opportunities
  • Access to LinkedIn Learning solutions
  • Competitive salary and various benefits
  • Advanced wellbeing and CSR programs, recreation area

© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.

More at EPAM

All 3139 roles

Popular searches