Senior Azure Data Engineer
Primary stack
Nice to have's
Job description
About the Position
We are seeking a Senior Azure Data Engineer to join our software, system, and test engineering team in Hungary. The role focuses on building and maintaining resilient data pipelines and processing systems for a large user base. Your contributions will ensure our data solutions align with business demands and maintain high industry standards. If you bring expertise in Azure DevOps, Databricks, and designing scalable data solutions, we encourage you to apply and make an impact through innovative projects.
Responsibilities
- Build and maintain data pipelines alongside large-scale customer-focused processing systems
- Establish data frameworks to provide stable and reliable operations
- Ensure data solutions adhere to business requirements and industry standards
- Recommend strategies to boost data quality, efficiency, and reliability
- Collaborate with system architects, technical leads, and team members to achieve aligned goals
- Deploy Databricks workflows using Databricks Asset Bundles
- Support scalable data platforms designed for a broad user base
- Write Python scripts to automate data processes and improve performance
- Oversee Azure DevOps CI/CD pipelines and associated deployment tools
Requirements
- Background in data DevOps engineering with a minimum of 3 years of practical experience
- Knowledge of Azure DevOps CI/CD pipelines, Terraform, and deployment strategies for large infrastructures
- Expertise in deploying Databricks workflows using Databricks Asset Bundles
- Competency in developing data pipelines on Azure Databricks with Spark
- Capability to design and sustain scalable data platforms for large-scale consumers
- Proficiency in Python programming
- Skills in collaboration to work effectively with architects and other technical professionals
- English competency at an intermediate level or higher
Nice to Have
- Experience in creating preliminary prototypes for new product functionalities
- Background in designing data set processes for governance, production, and data modeling
- Familiarity with multiple programming languages and tools for seamless system integration
We Offer
- Opportunity to work in a dynamic and innovative environment
- Collaborate with a talented and diverse team
- Competitive compensation package
- Professional growth and development opportunities
About the Company
EPAM Systems is a global software engineering and product development company with a focus on delivering digital transformation and technology innovation to clients across various industries.
© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.