EPAM logo

Lead Data Engineer

EPAM·Salary not specified

Primary stack

dbtApache SparkDatabricksETLSQL

Nice to have's

Dimensional modelingPython programmingEnd-to-end delivery ownershipClear communicationSelf-directed working style

Job description

About the Position

We are seeking a Lead Data Engineer to own end-to-end data modeling and pipeline delivery as a major enterprise data lake is re-architected. You will work hands-on with Databricks and dbt, partner closely with US-based stakeholders, and collaborate with an India-based engineering team. You thrive with high autonomy, clear documentation, and strong ownership.

Responsibilities

  • Own dimensional data models from requirements through deployment using Kimball-aligned patterns
  • Design, build, and maintain pipelines in Databricks and dbt to support a modernized data lake
  • Translate business requirements into scalable datasets, anticipating future reporting and analytics needs
  • Lead end-to-end delivery including development, unit testing, UAT support, and release coordination
  • Produce clear technical documentation in Confluence and maintain decision records and data definitions
  • Partner with US-based stakeholders to align outcomes, scope, and delivery expectations
  • Collaborate with an India-based engineering team to coordinate build, reviews, and handovers
  • Support basic dashboarding and validation to confirm data meets business expectations

Requirements

  • Dimensional modeling capability including star schema, fact and dimension design, and aggregate awareness
  • Hands-on experience with Python programming
  • Databricks experience for data engineering development and operational support
  • dbt (data build tool) experience including modular modeling, testing, and deployment practices
  • SQL proficiency for analytics-grade transformations and performance-aware querying
  • Traditional ETL and data warehousing foundation adapted to modern cloud data stacks
  • End-to-end delivery ownership across requirements, build, testing, UAT, and deployment
  • Clear communication and strong documentation habits for non-technical stakeholder engagement
  • Self-directed working style with comfort operating under light-touch leadership

Nice to Have

  • Experience re-architecting enterprise data lakes or data warehouses in multi-phase programs
  • Familiarity with release planning across distributed teams and time zones
  • Exposure to basic BI development or semantic layer design to support reporting consumption

We Offer

By choosing EPAM, you're getting a job at Great Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023, and one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023. Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters. You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices. We offer a transparent career path and an individual roadmap to engineer your future and accelerate your journey. At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.

About the Company

EPAM is a leading global software development and digital platform engineering company. We partner with the world’s most innovative companies to deliver technology solutions that drive business transformation and growth.

© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.

More at EPAM

All 3139 roles

Popular searches