Senior Databricks Engineer
Primary stack
Nice to have's
Job description
About the Position
Senior Databricks Engineer (Madrid, on-site) – International client
We are seeking a talented Senior Databricks Engineer with strong expertise in Azure Databricks and Apache Spark to design, build, and maintain scalable data pipelines. In this role, you will work with diverse data sources to deliver reliable, high-quality data solutions, ensuring data accuracy, integrity, and performance. You will collaborate closely with stakeholders, including data owners and analysts, to understand business requirements and implement efficient data processing solutions, while proactively monitoring and optimizing data pipelines within a cloud-based environment.
Responsibilities
- Design, build, and maintain scalable and efficient data pipelines using Databricks. Integrate data from various sources (e.g., Azure storage account, SFTP, Fabric) using Apache Spark within Databricks.
- Implement processes and checks to ensure the accuracy and completeness of data.
- Work closely with data owners, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Monitor data pipelines for issues and resolve them promptly to maintain data flow integrity.
Requirements
Must have:
- Experience with Databricks-specific tools and features.
- Experience with Datafactory.
- Proficiency in programming languages such as Python or Scala for data processing on Databricks.
- Experience with Azure cloud platform.
- Strong understanding of SQL.
- Experience with ETL and processes, Unity Catalog.
Good-to-have:
- Certifications in Databricks or related cloud technologies.
Language
- English (C1) MANDATORY.
Location
- Madrid (first 3-6 months on-site).
Salary
- 40.000-50.000€ SBA.
We Offer
- Flexible working hours.
- Cutting-edge technologies to stay updated with current trends.
- Work modality options: on-site, remote, or hybrid.
- Opportunities to work in various locations worldwide.
About the Company
Forming part of The White Team means collaborating with a company composed of professionals with extensive experience in technology consulting. We firmly believe that companies and clients set the path forward in the sector, but it is the people who build it. We consider it vital that our organization is based on our best asset and value-added brand, which is our human team.
The White Team was founded in 2012 by experienced consultants with a clear mission: to help companies worldwide optimize their business profitability through the efficient use of information technologies.
© The Whiteam Consulting. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.