Senior Databricks Architect
Primary stack
Job description
About the Position
Senior Databricks Architect - London (Hybrid)
Our client, a large-scale organization undergoing significant investment in data and cloud technologies, is seeking an experienced Senior Databricks Architect to join its expanding Data & AI practice.
This is an exciting opportunity to play a key role in large-scale data transformation programs, helping enterprise organizations modernize legacy platforms and build cloud-native data solutions. You'll be responsible for designing and delivering scalable data architectures, enabling advanced analytics, real-time data processing, and modern data product delivery.
Responsibilities
- Designing and delivering enterprise-scale data platforms using Databricks and AWS
- Building batch and real-time data pipelines from legacy and modern source systems
- Implementing real-time and event-driven data processing solutions
- Developing data transformation frameworks using Spark, PySpark, and SQL
- Designing Lakehouse architectures using Databricks and Medallion Architecture principles
- Creating scalable, reusable data products to support modern data operating models
- Integrating data from complex legacy and enterprise data sources
- Driving data governance, quality, security, and operational best practices
- Collaborating with business stakeholders, engineering teams, and data consumers
- Providing architectural leadership across complex transformation programs
Requirements
- Proven experience as a Data Architect, Databricks Architect, Lead Data Engineer, or Solutions Architect
- Strong expertise in Databricks, Apache Spark, PySpark, and SQL
- Experience designing and implementing modern data lake or lakehouse architectures
- Hands-on experience with Kafka
- Strong understanding of AWS data services, particularly Amazon S3
- Experience integrating data from complex enterprise and legacy data environments
- Strong understanding of data governance, security, and data quality frameworks
- Experience delivering large-scale cloud and data transformation programs
- Excellent communication and stakeholder management skills
We Offer
- Salary up to £115,000
- Performance-related bonus
- Comprehensive benefits package
- Excellent career progression opportunities
- Access to training and professional certifications
- Exposure to enterprise-scale cloud and data transformation projects
- Opportunity to work with the latest Databricks, AWS, and streaming technologies
- Collaborative, innovation-led working environment
About the Company
Join an organization investing heavily in next-generation data and cloud technologies. With interview slots currently being scheduled, we expect strong interest in this position.
Apply now or send your CV directly for immediate consideration.
© Nigel Frank International. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
We’re the recognized global leaders in Microsoft recruitment — it’s all we doFounded in 2006 Nigel Frank International has grown to become the global leader in Microsoft technology recruitment.We started out by focusing on Microsoft business management solutions, and having become industry experts in the Dynamics and Azure fields, we extended our scope to deliver professionals from the rest of the Microsoft stack, including Office 365, SharePoint, Skype for Business, BI, SQL, and .NET.Our global expansion began in 2010 when we opened our first USA office in New York; since then, we’ve opened 10 offices on four continents.With a team of 500+ dedicated consultants, we are the largest Microsoft technology recruitment firm in the world. Our sole focus on Microsoft technology, along with our global scale, allows us to offer both job seekers and employers unparalleled access to the widest range of high-quality roles and candidates in the ecosystem, while still delivering a highly personalized service.We’re backed by TPG Growth, one of the leading private equity firms in the world and investors in Uber, Spotify, and Airbnb. Our $16.4m investment in marketing and support allows us to reach key Microsoft professionals through industry events, sponsorships, and outreach.
More at Nigel Frank International
All 148 roles.NET Developer
Nigel Frank International · Norway
Senior Data Engineer
Nigel Frank International · United Kingdom
Data Architect
Nigel Frank International · United Kingdom
Dynamics F&O Supply Chain Consultant
Nigel Frank International · Sweden