EPAM logo

Senior Azure Data Engineer

EPAM·Salary not specified

Primary stack

DevOps

Nice to have's

PythonDatabricksAzure DevOpsDatabricks Asset BundlesSpark

Job description

About the Position

We are seeking a Senior Azure Data Engineer to join our software, system, and test engineering team. The role focuses on building and maintaining resilient data pipelines and processing systems for a large user base. Your contributions will ensure our data solutions align with business demands and maintain high industry standards. You will coordinate with architects, tech leads, and team members to deliver on product objectives. If you bring expertise in Azure DevOps, Databricks, and designing scalable data solutions, we encourage you to apply and make an impact through innovative projects.

Responsibilities

  • Build and maintain data pipelines alongside large-scale customer-focused processing systems
  • Establish data frameworks to provide stable and reliable operations
  • Ensure data solutions adhere to business requirements and industry standards
  • Recommend strategies to boost data quality, efficiency, and reliability
  • Collaborate with system architects, technical leads, and team members to achieve aligned goals
  • Deploy Databricks workflows using Databricks Asset Bundles
  • Support scalable data platforms designed for a broad user base
  • Write Python scripts to automate data processes and improve performance
  • Oversee Azure DevOps CI/CD pipelines and associated deployment tools

Requirements

  • Background in data DevOps engineering with a minimum of 3 years of practical experience
  • Knowledge of Azure DevOps CI/CD pipelines, Terraform, and deployment strategies for large infrastructures
  • Expertise in deploying Databricks workflows using Databricks Asset Bundles
  • Competency in developing data pipelines on Azure Databricks with Spark
  • Capability to design and sustain scalable data platforms for large-scale consumers
  • Proficiency in Python programming
  • Skills in collaboration to work effectively with architects and other technical professionals
  • English competency at an intermediate level or higher

Nice to Have

  • Experience in creating preliminary prototypes for new product functionalities
  • Background in designing data set processes for governance, production, and data modeling
  • Familiarity with multiple programming languages and tools for seamless system integration

We Offer

  • Dynamic, entrepreneurial corporate environment
  • Diverse multicultural, multi-functional, and multilingual work environment
  • Opportunities for personal and career growth in a progressive industry
  • Global scope, international projects
  • Widespread training and development opportunities
  • Access to LinkedIn Learning solutions
  • Competitive salary and various benefits
  • Advanced wellbeing and CSR programs, recreation area

About the Company

[Company description if present]

© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.

More at EPAM

All 3139 roles

Popular searches