EPAM logo

Lead Data Engineer with Terraform

EPAM·Salary not specified

Primary stack

GitHub ActionsDevOpsBigQueryPub/SubPythonCI/CDGCPDataflowTerraformSQL

Nice to have's

Google Cloud Professional Data Engineer CertifiedData Lake technologiesCDC using DatastreamDataplexKnowledge CatalogAnalytics HubLooker

Job description

About the Position

We are seeking an experienced Lead Data Engineer with strong Terraform expertise to design, build, and maintain scalable data solutions on Google Cloud Platform. In this role, you will lead the development of robust data pipelines while driving best practices across infrastructure automation and DevOps processes.

Responsibilities

  • Design and build scalable data pipelines using GCP services
  • Lead the development of data solutions leveraging BigQuery, Dataflow, and Dataform/dbt
  • Orchestrate workflows with Cloud Composer/Airflow
  • Manage real-time data streaming through Pub/Sub and Cloud Storage
  • Implement infrastructure as code using Terraform
  • Establish and maintain CI/CD pipelines with GitHub Actions
  • Collaborate with stakeholders to translate business requirements into technical solutions
  • Ensure data quality, reliability, and performance across all systems
  • Mentor team members and promote engineering best practices

Requirements

  • 5+ years of hands-on experience with SQL and Python
  • Expertise in GCP services including BigQuery, Dataflow, and Dataform/dbt
  • Proficiency in Cloud Composer/Airflow, Pub/Sub, and Cloud Storage
  • Skills in DevOps practices including CI/CD, GitHub Actions, and Terraform
  • Good verbal and written communication skills
  • Good business acumen
  • English proficiency at B2 level or higher

Nice to Have

  • Google Cloud Professional Data Engineer Certified
  • Familiarity with Data Lake technologies such as Iceberg
  • Knowledge of CDC using Datastream
  • Understanding of Dataplex, Knowledge Catalog, and Analytics Hub
  • Competency in Looker

We Offer

  • Remote work in Türkiye
  • Opportunity to work with cutting-edge technologies on Google Cloud Platform
  • Collaborative and innovative work environment

About the Company

EPAM Systems is a global software engineering and product development company. We partner with the world’s leading brands to deliver innovative digital solutions and drive their digital transformation.

© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.

More at EPAM

All 2376 roles

Popular searches