Senior Data Engineer

About the Position

We are seeking a Senior Data Engineer with 8+ years of experience to modernize and maintain an eCommerce platform for a US-based retail company.

Responsibilities

• Implement a solution to support processing of big data volumes and integrate it into the current architecture.
• Design and implement data models, including conceptual, logical, and physical data models.
• Build robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources.
• Integrate data from disparate sources using appropriate techniques.
• Design and implement data warehousing solutions.
• Perform complex queries, data transformations, and performance tuning on cloud-based data storages.
• Integrate metadata and governance processes into cloud-based data platforms.

Requirements

Must Have

• 8+ years of experience
• Strong, recent hands-on expertise with Azure Data Factory and Synapse (3+ years)
• Strong expertise in designing and implementing data models
• Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks
• Extensive experience with building robust and scalable ETL/ELT pipelines
• Ability to integrate data from disparate sources
• Proficiency in designing and implementing data warehousing solutions
• Proficiency in SQL
• Experience integrating metadata and governance processes into cloud-based data platforms
• Experience with Python and Python-based ETL tools
• Experience with shell scripting in Bash, Unix, or Windows shell
• Demonstrated ability to lead cross-functional engineering teams

Nice to Have

• Experience with Elasticsearch
• Familiarity with containerization and orchestration technologies (Docker, Kubernetes)
• Troubleshooting and Performance Tuning
• Collaboration and Communication skills
• Computer Science and data science academic and education credentials

We Offer

• Remote work in Brazil
• Relocation friendly

About the Company

This role is part of the DWH Development and Cross Industry Solutions teams, focusing on the modernization, maintenance, and development of an eCommerce platform for a big US-based retail company.

Application

Apply for the Senior Data Engineer position in Remote Brazil.