Senior Data Engineer

About the Position

We are seeking a Senior Data Engineer with 8+ years of experience to support processing of big data volumes for a US-based retail company. The primary goal of the project is the modernization, maintenance, and development of an eCommerce platform serving millions of omnichannel customers each week.

Responsibilities

• Implement a solution for a big retail company.
• Support processing of big data volumes.
• Integrate solution to current architecture.

Skills

Must Have

• 8+ years of experience in data engineering.
• Strong, recent hands-on expertise with Azure Data Factory and Synapse (3+ years).
• Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models.
• Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.
• Extensive experience with building robust and scalable ETL/ELT pipelines.
• Ability to integrate data from disparate sources, including databases, APIs, and external data providers.
• Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault).
• Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.
• Experience integrating metadata and governance processes into cloud-based data platforms.
• Experience with cloud-based analytical databases.
• Experience with Python and Python-based ETL tools.
• Experience with shell scripting in Bash, Unix, or Windows shell.
• Demonstrated ability to lead cross-functional engineering teams, define technical strategy and architecture, drive delivery of complex data platforms, mentor engineers, and effectively communicate with stakeholders at all organizational levels.

Nice to Have

• Experience with Elasticsearch.
• Familiarity with containerization and orchestration technologies (Docker, Kubernetes).
• Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.
• Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.
• Ability to plan, estimate, and track progress of implementing features.
• Computer Science and data science academic and education credentials.

Languages

• English: B2 Upper Intermediate

We Offer

• Remote work in Serbia.
• Relocation friendly.

About the Company

This role is part of the DWH Development and Cross Industry Solutions teams, focusing on the modernization and development of an eCommerce platform for a big US-based retail company.