Tech Stack
Job Description, Responsibilities & Requirements
About the Position
Databricks Data Architect
Location: London, England
Salary: £95,000 to £125,000 GBP
Employment Type: Perm
Experience Level: Senior
Join a high-growth consultancy at the forefront of modern data engineering and AI. This is a place where architects shape real data strategy, influence enterprise-level decision-making, and build world-class Databricks lakehouse platforms for some of the UK's most progressive organizations.
You'll work in an environment that values expertise, encourages innovation, invests heavily in your professional development, and gives you the autonomy to architect complex, cutting-edge data ecosystems. If you enjoy solving hard problems, designing at scale, and working directly with clients to bring modern data platforms to life, you will thrive here.
Responsibilities
- Architecting and implementing Databricks Lakehouse solutions across ingestion, processing, storage, governance, and analytics
- Designing scalable, modern data platforms for structured and unstructured data
- Translating business needs into robust technical architectures
- Leading architectural engagements and owning delivery across scope, budget, and timelines
- Advising clients on best practices, governance models, data strategy, and optimization
- Debugging and tuning Databricks workloads for performance and cost efficiency
- Implementing security, RBAC, IAM, encryption, lineage, and cataloguing (Unity Catalog, Purview)
- Building CI/CD pipelines using Databricks Repos, GitHub Actions, Azure DevOps
- Supporting RFI/RFP responses and delivering Proof of Concepts
- Contributing reusable architectural patterns to the wider Architecture Practice
Requirements
- Deep end-to-end experience delivering enterprise Databricks analytics solutions
- Expertise in Lakehouse Architecture, Delta Lake, Spark, PySpark
- Strong data modelling skills (3NF, Kimball, Data Vault)
- Experience exposing Delta Lakehouse to Power BI or Tableau
- Skilled in Python, Scala, or SQL for data engineering
- Experience building scalable ETL pipelines (Workflows, Delta Live Tables)
- Hands-on experience with Azure, AWS, or GCP (storage, compute, networking)
- Knowledge of Databricks security: RBAC, IAM, encryption
- Excellent analytical skills and the confidence to challenge thinking at all levels
- Bonus: Databricks certifications (Data Engineer, ML, Lakehouse, GenAI)
We Offer
- Generous annual leave
- Private medical insurance and wellbeing support
- Guaranteed investment in your professional development & certifications
- A culture that rewards high performance and nurtures talent
- Exciting client work with real impact on data & AI transformation
- Hybrid working with flexibility and autonomy
About the Company
At Nigel Frank, we are committed to providing innovative data engineering and AI solutions to our clients. Our team of experts is dedicated to shaping the future of data, and we are looking for passionate individuals to join us in this exciting journey.
Ready to Shape the Future of Data?
If you're passionate about Databricks, modern data platforms, and want to take a lead role architecting solutions that power AI and analytics for enterprise clients, this is the perfect next step.
Apply now or send your CV directly!