
Senior Data Engineer
Primary stack
Nice to have's
Job description
About the Position
We are seeking a Senior Data Engineer with expertise in Apache Spark and Databricks to join our team and drive next-generation retail analytics.
Skills
- Data Software Engineering
- Scala
- Apache Spark
- Data Solution Architecture
- SQL
- Databricks
- Data Architecture
- PySpark
About the Role
We are looking for a Senior Data Engineer to build a next-generation retail and omnichannel analytics platform, and we need you to drive hands-on data engineering, platform best practices, and scalable architecture. You will shape ingestion and transformation frameworks, enable self-service analytics, and advance AI-enabled engineering.
Responsibilities
- Design scalable data ingestion, transformation, and data product frameworks
- Define Databricks best practices for medallion layers, governance, and performance
- Build batch and near real-time pipelines using Databricks and Spark
- Deliver end-to-end data products for retail and omnichannel analytics use cases
- Develop trusted analytical datasets, semantic models, and governed consumption layers
- Implement data quality, lineage, monitoring, and observability standards
- Lead proof-of-concepts to evaluate and adopt new platform capabilities
- Define AI SDLC and AI-assisted development patterns for engineering teams
- Partner with cross-functional stakeholders to align solutions and ensure adoption
- Mentor engineers on reusable frameworks and operational excellence
Requirements
- 3+ years of data engineering experience
- Strong leadership skills to drive technical direction and mentor engineers
- Proven project delivery skills across end-to-end analytics lifecycles
- Advanced Databricks skills in enterprise production environments
- Expert Apache Spark and PySpark skills for scalable data processing
- Strong SQL skills for analytics, modeling, and performance tuning
- Upper-Intermediate English proficiency (B2)
Nice to Have
- Data architecture experience for lakehouse and enterprise analytics platforms
- Data solution architecture experience to standardize patterns across teams
- Scala experience for Spark-based pipeline development
What We Offer
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling, and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek, and LinkedIn
© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.
More at EPAM
All 3139 roles
Solution Architect - HCL Commerce
EPAM · India

Lead Java Automation Test Engineer with AI
EPAM · India

Lead Software Developer - Java with AWS Cloud
EPAM · India

Solution Architect – Java Full Stack
EPAM · India