Senior Data Engineer

About the Position

We are seeking a Senior Data Engineer with 8+ years of experience to join our team in Poland, specializing in Azure Data Factory, Synapse, and ETL/ELT pipelines.

Responsibilities

• Implement a solution for a big retail company.
• Support processing of big data volumes.
• Integrate solution to current architecture.

Requirements

• 8+ years of experience required.
• Strong, recent hands-on expertise with Azure Data Factory and Synapse (3+ years).
• Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models.
• Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.
• Extensive experience with building robust and scalable ETL/ELT pipelines.
• Ability to integrate data from disparate sources, including databases, APIs, and external data providers.
• Proficiency in designing and implementing data warehousing solutions.
• Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.
• Experience integrating metadata and governance processes into cloud-based data platforms.
• Certification in Azure, Databricks, or other relevant technologies is an added advantage.
• Experience with cloud-based analytical databases.
• Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.
• Experience with Python and Python-based ETL tools.
• Experience with shell scripting in Bash, Unix or windows shell is preferable.
• Demonstrated ability to lead cross-functional engineering teams, define technical strategy and architecture, drive delivery of complex data platforms, mentor engineers, and effectively communicate with stakeholders at all organizational levels.

Nice to Have

• Experience with Elasticsearch.
• Familiarity with containerization and orchestration technologies (Docker, Kubernetes).
• Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.
• Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.
• Ability to plan, estimate and track progress of implementing features.
• Computer Science and data science academic and education credentials.

We Offer

• Relocation options.
• Experience in an international environment.
• Cross-cultural experience.
• Feedback culture.
• Regular appraisals.
• Annual holiday - 20 or 26 days.
• Occasional leave - 1 or 2 days.
• Child care leave - 2 days or 16 hours per year.
• Absence due to force majeure - 2 days or 16 hours per year.
• Maternity Leave - 20 weeks.
• Parental Leave - 41 weeks.
• Paternity Leave - 14 days.
• Expert-led tech courses.
• Internal instructor-led soft skills courses.
• Comprehensive in-house self-learning resources.
• Access to external self-learning libraries.
• Cloud Programs: MS Cloud Academy, AWS Partner Academy, Google Cloud Academy.
• Custom Learning Programs: upskilling, reskilling, technical mentorship.
• Leadership Programs for Managers.
• Multisport card.
• Possibility to order Multisport card at the corporate rate for family members.
• LuxGood Program: wellbeing seminars, contests, relaxation sessions, yoga sessions, etc.
• One Team Program: Buddy for each New Joiner; seminars, meeting and workplace space to support integration with local community and culture; “Hire me” workshops for partners.
• Preferential banking offer.
• Preferential car leasing offer.
• Cafeteria program discounts.
• Luxoft Social Benefit Fund: sport and recreation benefits.
• Private Healthcare Insurance with unlimited access to specialists.
• Full dental support.
• Travel Insurance.
• Possibility to add private healthcare coverage for family members at the corporate rate.
• Life insurance at the corporate rate for employees and family members.
• Reimbursement for corrective glasses.
• Many fun social activities organized by the Luxoft team.
• Online entertainment events for the whole company and local team events.
• A workplace where you’re treated with respect within a multicultural team.
• Rotation between projects and accounts.
• New career opportunities.

About the Company

The primary goal of the project is the modernization, maintenance, and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week. Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart. Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.