EPAM logo

Lead Data Software Engineer

EPAM·Salary not specified

Primary stack

NoSQLApache SparkKafkaScalaPythonJavaSQL

Nice to have's

MLOpsdata pipelinesdata ingestionplatform engineeringcloud-based solutions

Job description

About the Position

We are seeking an open-minded Lead Data Software Engineer to drive the development and maintenance of our data-driven architecture.

In this role, you will work on developing pipelines to build business-related data products and designing cloud-based platform solutions to support DataHub functionality.

If you’re passionate about shaping the future of data engineering and thrive in an environment where innovation and collaboration are key, we invite you to join us.

Responsibilities

  • Design and implement data pipelines
  • Perform data ingestion processes to integrate existing data sources into the new platform
  • Participate in platform engineering, including cloud-based solutions to support the architecture, such as ingestion frameworks, platform orchestrators, and exploratory environments
  • Conduct MLOps activities to build production-ready cloud-based solutions to support existing ML pipelines
  • Take part in the design of on-premises to cloud migration activities

Requirements

  • Strong experience in Java, Python, or Scala
  • Proficiency in SQL
  • Understanding of common Big Data challenges (splitability, massive parallel processing, load-balancing, data locality, streaming, etc.) and relevant technologies (Apache Spark, Kafka, NoSQL databases)
  • Familiarity with data modeling concepts such as relational/dimensional data, SCD, and snowflaking
  • Hands-on experience with any major cloud provider: Azure, AWS, or GCP
  • B2 English level, both verbal and written

We Offer

  • Opportunity to work in a hybrid role in Latvia
  • Be part of a team that shapes the future of data engineering

About the Company

[Company description if present]

© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.

More at EPAM

All 2376 roles

Popular searches