Luxoft logo

Senior Data Engineer

Luxoft·Salary not specified

Primary stack

PythonBashWindowsETLVaultAzureDelta LakeSQL

Nice to have's

Elasticsearchcontainerization and orchestration technologiesDockerKubernetesPerformance TuningCollaboration and CommunicationComputer Science and data science academic and education credentials

Job description

Description language:

About the Position

We are seeking a Senior Data Engineer with over 8 years of experience to join our team in Remote Ukraine. The role focuses on building scalable data solutions for a big US-based retail company.

Responsibilities

  • Design and implement data models, including conceptual, logical, and physical data models.
  • Develop robust and scalable ETL/ELT pipelines.
  • Integrate data from various sources using appropriate techniques.
  • Design and implement data warehousing solutions.
  • Perform complex queries, data transformations, and performance tuning on cloud-based data storages.
  • Integrate metadata and governance processes into cloud-based data platforms.
  • Lead cross-functional engineering teams and define technical strategy and architecture.

Requirements

  • Must Have

    • Readiness to work until 8.00 pm CET (no need to do overtimes)
    • Overall years of experience required 8+ (at least 1+ year in an Architect position)
    • Strong, recent hands-on expertise with Azure Data Factory and Synapse (3+ years)
    • Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark
    • Extensive experience with building robust and scalable ETL/ELT pipelines
    • Ability to integrate data from disparate sources, including databases, APIs, and external data providers
    • Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)
    • Proficiency in SQL for complex queries, data transformations, and performance tuning
    • Experience integrating metadata and governance processes into cloud-based data platforms
    • Certification in Azure, Databricks, or other relevant technologies is an added advantage
    • Experience with cloud-based analytical databases
    • Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix
    • Experience with Python and Python-based ETL tools
    • Experience with shell scripting in Bash, Unix, or windows shell
    • Demonstrated ability to lead cross-functional engineering teams, define technical strategy and architecture, drive delivery of complex data platforms, mentor engineers, and effectively communicate with stakeholders at all organizational levels.
  • Nice to Have

    • Experience with Elasticsearch
    • Familiarity with containerization and orchestration technologies (Docker, Kubernetes)
    • Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis
    • Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams
    • Ability to plan, estimate, and track progress of implementing features
    • Computer Science and data science academic and education credentials

We Offer

  • Opportunity to work remotely from Ukraine
  • Competitive salary and benefits
  • Collaborative and innovative work environment

About the Company

Luxoft is a global provider of digital transformation and technology services, empowering businesses to thrive in the digital age. We are committed to delivering innovative solutions and fostering a culture of excellence and continuous learning.

Languages

  • English: B2 Upper Intermediate

Apply

Interested candidates can apply for the Senior Data Engineer position in Remote Ukraine.

© Luxoft. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

A provider of software development services and innovative IT solutions with a worldwide customer base consisting mainly of large multinational corporations.

More at Luxoft

All 785 roles

Popular searches