Senior Data Engineer

About the Position

We are seeking a Senior Data Engineer with 8+ years of experience to join our US-based retail company in Salisbury, North Carolina, focusing on big data processing and integration.

Responsibilities

• Design and implement data solutions for a big retail company.
• Support processing of large data volumes.
• Integrate solutions into the current architecture.

Requirements

• Must Have

  • Readiness to work until 8.00 pm CET (no need to do overtimes)
  • Overall years of experience required 8+ (at least 1+ year in a Lead/Architect position)
  • Strong, recent hands-on expertise with Azure Data Factory and Synapse (3+ years)
  • Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models
  • Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark
  • Extensive experience with building robust and scalable ETL/ELT pipelines
  • Ability to integrate data from disparate sources, including databases, APIs, and external data providers
  • Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)
  • Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages
  • Experience integrating metadata and governance processes into cloud-based data platforms
  • Certification in Azure, Databricks, or other relevant technologies is an added advantage
  • Experience with cloud-based analytical databases
  • Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix
  • Experience with Python and Python-based ETL tools
  • Experience with shell scripting in Bash, Unix, or Windows shell is preferable
  • Demonstrated ability to lead cross-functional engineering teams, define technical strategy and architecture, drive delivery of complex data platforms, mentor engineers, and effectively communicate with stakeholders at all organizational levels

• Nice to Have

  • Experience with Elasticsearch
  • Familiarity with containerization and orchestration technologies (Docker, Kubernetes)
  • Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis
  • Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams
  • Ability to plan, estimate, and track progress of implementing features
  • Computer Science and data science academic and education credentials

We Offer

• Competitive salary
• Opportunity to work in a dynamic and innovative environment
• Relocation friendly

About the Company

Luxoft is a global technology services company that specializes in delivering digital transformation solutions. We are committed to excellence and innovation, providing our clients with cutting-edge technology solutions to drive their business forward.

Application

To apply for this position, please visit our careers page and submit your application.

Note: This job description is a general outline of the responsibilities and requirements for this position. It is not exhaustive and may be subject to change based on business needs.