Job Description, Responsibilities & Requirements
Description language:
About the Position
We are seeking a skilled Big Data Engineer to become an essential part of this forward-looking and dynamic team.
In this role, you will leverage advanced cloud technologies to deliver impactful solutions.
If you excel at tackling complex challenges, creating robust cloud-based solutions, and driving meaningful business outcomes, this opportunity offers the chance to join a fast-paced, collaborative environment where your work shapes global success.
Responsibilities
- Build scalable, cloud-based systems in Azure using tools like Azure Data Factory, Azure Data Lake Storage, and Databricks to enhance seamless, high-performance data pipelines
- Migrate on-premises MS SQL databases to Azure Data Lake, utilizing the Delta Lake format to optimize operational performance
- Develop interfaces that connect non-Microsoft proprietary applications, enabling interoperability and unlocking valuable data insights
- Provide expertise in Data Lakes, Data Warehouses (DWH), and Delta Lakehouse architectures to guide transformative business solutions
- Assess new feature proposals, prioritize them based on business value, and collaborate to make impactful product development decisions
Requirements
- 4+ years of experience as a Data Engineer
- Background in working with Python or Scala
- Expertise with Databricks or Spark
- Experience with Clouds: AWS or Azure
- Background in working with Agile or XP methodologies, thriving in fast-moving, adaptive environments
- Experience in AI development would be a plus
- Good English communication skills (Upper-Intermediate/B2+ or higher) to engage effectively with diverse teams and stakeholders
Nice to Have
- Proficiency in advanced Azure tools such as Synapse Analytics, Cosmos DB, or Apache Synapse
- Flexibility to use Core Python or Scala for automation and advanced data processing
We Offer
- Opportunity to work with cutting-edge technologies in a remote setting
- Be part of a forward-looking and dynamic team
- Competitive compensation package
About the Company
EPAM Systems is a global software engineering and product development company that partners with many of the world's leading businesses to deliver high-quality software solutions.