Data Engineer (Microsoft Azure)

About the Position

We're seeking a Data Engineer (Microsoft Azure) with 7+ years of experience in data engineering, data integration, and ETL/ELT processes to join our team in Remote United States. The role will support large-scale data integration, analytics, machine learning, AI solutions, and business intelligence through modern data platforms and automated ETL/ELT pipelines.

Responsibilities

• Design, develop, and optimize ETL/ELT solutions using Azure Databricks, LakeBase, and Spark.
• Build and deploy large-scale data pipelines supporting analytics, machine learning, predictive modeling, reporting, and data products.
• Integrate structured and unstructured data from databases, APIs, FTPs, cloud storage, and various file formats.
• Develop and optimize complex SQL queries and data models.
• Build AI-based solutions for business needs, process automation, and operational efficiency.
• Improve data reliability, integrity, performance, and overall platform quality.
• Contribute to data architecture, engineering standards, frameworks, and best practices.
• Provide technical guidance and mentorship to other data engineers.

Requirements

• 7+ years of experience in data engineering, data integration, data modeling, data architecture, and ETL/ELT processes.
• 5+ years of hands-on Python experience and 2+ years of experience with SQL, complex data schemas, and query performance optimization.
• At least 2 years of hands-on experience with Redis-backed state management and event-driven processing, as well as building cloud solutions using Azure Databricks with Unity Catalog, Snowflake, Azure Functions, and Service Bus.
• Practical experience with Terraform-based DevOps automation and CI/CD tools including GitHub Actions, Git, Artifactory, and Sonar.

Nice to Have

• Excellent communication skills
• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related discipline.
• Strong understanding of Data Lake, Delta Lake, and Data Warehousing architectures, as well as advanced data modeling techniques including slowly changing dimensions, aggregation, partitioning, and indexing.
• Exposure to LLM/AI solution delivery
• Ability to independently troubleshoot and performance-tune large-scale enterprise systems
• Collaborate effectively across technical and business teams
• Mentor engineers
• Communicate technical concepts to both technical and non-technical audiences

We Offer

• Full-time position
• Senior experience level
• Remote work option

About the Company

Luxoft is a leading global provider of digital transformation and technology services. We empower businesses to innovate and thrive in the digital age by leveraging cutting-edge technologies and industry expertise.