EPAM logo

Senior Data Engineer

EPAM·Salary not specified

Primary stack

Apache SparkScalaDatabricksSQL

Nice to have's

Data Solution Architecture

Job description

About the Position

We are looking for a Senior Data Engineer to build and evolve a next-generation analytics platform with a strong focus on Databricks-based data products. You will combine hands-on delivery, technical leadership, and architecture to enable trusted, scalable, and AI-enabled data capabilities.

Responsibilities

  • Design scalable data ingestion and transformation frameworks for analytics use cases
  • Build batch, near real-time, and streaming pipelines using Databricks and Apache Spark
  • Define Databricks best practices for Medallion layers, performance, and operations
  • Deliver end-to-end data products from raw ingestion through governed consumption layers
  • Develop trusted analytical datasets and semantic models for reporting and self-service
  • Implement data quality, lineage, monitoring, and observability across pipelines
  • Lead proof-of-concepts and evaluate new capabilities within the Databricks ecosystem
  • Enable AI-assisted engineering patterns and reusable accelerators for faster delivery
  • Coordinate with engineering and analytics stakeholders to align on delivery plans
  • Mentor engineers and promote consistent platform standards across teams

Requirements

  • 3+ years of data engineering experience with modern data platforms
  • Strong leadership skills to drive engineering standards and mentor other engineers
  • Proven project delivery experience building enterprise analytics solutions end to end
  • Advanced Apache Spark and PySpark skills for large-scale processing
  • Advanced Databricks skills in production environments, including performance tuning
  • Strong SQL skills for transformation logic and analytics-ready datasets
  • Solid data architecture knowledge, including Lakehouse and Medallion patterns
  • Hands-on CI/CD and data engineering SDLC experience using Git-based workflows
  • Strong data governance skills covering security, quality, and operational controls
  • Excellent communication skills to lead technical discussions with cross-functional teams
  • Upper-Intermediate English proficiency (B2) for effective collaboration

Nice to Have

  • Data Architecture experience designing scalable Lakehouse patterns
  • Data Solution Architecture experience translating business needs into platform designs
  • Scala experience for Spark-based pipeline development

We Offer

  • International projects with top brands
  • Work with global teams of highly skilled, diverse peers
  • Healthcare benefits
  • Employee financial programs
  • Paid time off and sick leave
  • Upskilling, reskilling, and certification courses
  • Unlimited access to the LinkedIn Learning library and 22,000+ courses
  • Global career opportunities
  • Volunteer and community involvement opportunities
  • EPAM Employee Groups
  • Award-winning culture recognized by Glassdoor, Newsweek, and LinkedIn

Locations

  • Argentina
  • Brazil
  • Chile
  • Colombia
  • Mexico

Remote

  • Available

© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.

More at EPAM

All 3139 roles

Popular searches