Senior Data Engineer

About the Position

We are seeking a Senior Data Engineer with 5+ years of experience to architect and migrate data pipelines to AWS for a leading financial services company. This role involves a strategic data engineering engagement with our client to plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue.

Responsibilities

• Design, build, and maintain ETL/ELT pipelines on AWS
• Migrate existing data pipelines and workloads from legacy/on-prem systems to AWS
• Develop and optimize data models for data warehouse/data lake (Redshift, S3)
• Build and orchestrate data workflows (Glue, Step Functions, Lambda, EMR)
• Implement data quality checks, validation, and reconciliation processes
• Optimize pipeline performance and manage compute/storage costs
• Ensure data security and access control (IAM, KMS, encryption)
• Monitor and troubleshoot pipeline failures (CloudWatch, logging)
• Collaborate with data analysts, BI developers, and architects on data requirements
• Document data pipelines, architecture, and operational runbooks

Requirements

• 5+ years of experience
• Hands-on experience building data pipelines on AWS (Glue, EMR, Lambda, Step Functions)
• Strong SQL and experience with data warehousing (Redshift, dimensional modeling)
• Proficiency in Python or Scala for data engineering
• Experience with S3-based data lake architecture (partitioning, cataloging, formats like Parquet)
• Experience migrating data pipelines from on-prem or other cloud platforms
• Understanding of data governance, security, and access control on AWS
• Experience with CI/CD for data pipelines

Nice to Have

• AWS certification (Data Analytics Specialty or Data Engineer Associate)
• Experience with streaming data (Kinesis, MSK/Kafka)
• Familiarity with Infrastructure as Code (Terraform/CloudFormation)
• Experience with orchestration tools (Airflow, dbt)
• Experience in financial domain

We Offer

• Competitive salary
• Opportunity to work with a leading financial services company
• Collaborative and technically rich environment
• Chance to shape a multi-phase, multi-million-pound programme

About the Company

DXC Luxoft is a global leader in digital transformation and technology services, providing innovative solutions to clients across various industries. Our Bengaluru office is part of our Strategy & Design Consulting (SI) division, focusing on delivering cutting-edge data engineering solutions.