Job Description, Responsibilities & Requirements
Description language:
About the Position
We are seeking a Senior Data Engineer with 8+ years of experience to join our team in Remote Ukraine. The primary goal is to modernize, maintain, and develop an eCommerce platform for a big US-based retail company, focusing on big data processing and cloud-native solutions.
Responsibilities
- Design and implement data models to support efficient data storage and retrieval.
- Develop robust and scalable ETL/ELT pipelines.
- Integrate data from various sources, including databases, APIs, and external data providers.
- Design and implement data warehousing solutions.
- Perform complex queries, data transformations, and performance tuning on cloud-based data storages.
- Integrate metadata and governance processes into cloud-based data platforms.
Requirements
-
Must have
- Readiness to work until 8.00 pm CET (no need to do overtimes)
- Overall years of experience required 8+ (at least 1+ year in a Lead/Architect position)
- Strong, recent hands-on expertise with Azure Data Factory and Synapse (3+ years)
- Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models
- Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions
- Extensive experience with building robust and scalable ETL/ELT pipelines
- Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages
- Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)
- Experience integrating metadata and governance processes into cloud-based data platforms
- Experience with cloud-based analytical databases
- Experience with Python and Python-based ETL tools
- Experience with shell scripting in Bash, Unix, or Windows shell is preferable
- Demonstrated ability to lead cross-functional engineering teams, define technical strategy and architecture, drive delivery of complex data platforms, mentor engineers, and effectively communicate with stakeholders at all organizational levels
-
Nice to have
- Experience with Elasticsearch
- Familiarity with containerization and orchestration technologies (Docker, Kubernetes)
- Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis
- Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams
- Ability to plan, estimate, and track progress of implementing features
- Computer Science and data science academic and education credentials
Languages
- English: B2 Upper Intermediate
We Offer
- Opportunity to work remotely from Ukraine
- Competitive salary and benefits package
- Professional growth and development opportunities
About the Company
Join our team and contribute to the modernization and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.