
Senior Data Engineer (Cloud)
Primary stack
Nice to have's
Job description
About the Position
We are seeking a Senior Data Engineer (Cloud) to design, build, and run reliable ETL and ELT pipelines for enterprise data platforms. You will use Python, SQL, and Apache Airflow with cloud services across Microsoft Azure, Google Cloud Platform (GCP), or Amazon Web Services (AWS). You will troubleshoot issues, improve delivery automation, and partner with clients on requirements and trade-offs.
Responsibilities
- Design and build scalable ETL and ELT pipelines using Python, SQL, and cloud-native services
- Write, optimize, and troubleshoot complex SQL for transformations, validation, and performance
- Create and maintain data models and warehouse structures that support quality, availability, and scale
- Orchestrate workflows in Apache Airflow including scheduling, monitoring, and incident resolution
- Support pipeline delivery and platform operations across Azure, Google Cloud Platform (GCP), or Amazon Web Services (AWS)
- Improve continuous integration and continuous delivery (CI/CD), source control, and automated deployment for data solutions
- Investigate data, integration, and infrastructure issues, drive root-cause analysis, and implement fixes
- Collaborate with clients and cross-functional teams to align on requirements, risks, dependencies, and delivery plans
Requirements
- Hands-on experience building ETL and ELT pipelines and supporting data warehousing
- Advanced SQL skill sets including optimization, data validation, and complex transformations
- Python proficiency for pipeline development and software engineering practices
- Experience with distributed processing using PySpark or Apache Beam
- Practical cloud experience with Microsoft Azure, Google Cloud Platform (GCP), or Amazon Web Services (AWS) for data workload
- Workflow orchestration background with Apache Airflow or Google Cloud Composer
- Knowledge of data modeling, data lifecycle management, and data quality control
- Clear communication with the ability to explain trade-offs, risks, and solution options to stakeholders
Nice to Have
- Infrastructure as code exposure using Terraform or Kubernetes
- Streaming familiarity with Kafka and event-driven patterns
- Data integration tooling experience with Fivetran
We Offer
By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021, 2022, and 2023. Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters. You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices. We offer a transparent career path and an individual roadmap to engineer your future and accelerate your journey. At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.
About the Company
EPAM is a globally recognized software engineering and product development company. We are committed to delivering high-quality solutions and services to our clients, leveraging cutting-edge technologies and industry best practices.
© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.
More at EPAM
All 3139 roles
Solution Architect - HCL Commerce
EPAM · India

Lead Java Automation Test Engineer with AI
EPAM · India

Lead Software Developer - Java with AWS Cloud
EPAM · India

Solution Architect – Java Full Stack
EPAM · India