Senior Data Engineering Consultant (Databricks)

• Employment Type: Full-time
• Contract Type: Permanent contract

About the Position

Talan Data x AI is a leading Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight from their data. We are currently seeking a Senior Data Engineering Consultant (Databricks) to join our team.

Responsibilities

• Build and optimize data pipelines using PySpark within Databricks environments.
• Develop and support dashboards and reports using Power BI.
• Collaborate with clients and stakeholders to deliver data solutions.
• Ensure data quality, integration, and transformation processes are robust.
• Lead technical and/or project teams in delivering end-to-end projects.

Requirements

• Multi-skilled experience in Data Management, Data Engineering, Data Warehousing, Data Modelling, Data Quality, Data Integration, Data Analytics, Data Visualisation, Data Science, and Business Intelligence.
• Confident in delivering solutions using Databricks and developing data pipelines using PySpark.
• Proven experience building, publishing, and supporting dashboards and reports using Power BI.
• Strong experience and programming skills in Python and SQL, with the ability to write complex SQL queries.
• Project experience using technologies such as Tableau, Power BI, Cloud, Azure, AWS, GCP, Snowflake, and their integration with Databricks.
• Excellent problem-solving skills and the ability to think critically under pressure.
• Strong communication and interpersonal skills.
• Experience of leading technical and/or project teams.
• A proactive awareness of industry standards, regulations, and developments.
• Project lifecycle experience, having played a leading role in the delivery of end-to-end projects, as well as a familiarity with different development methodologies and disciplines (e.g. Agile, Waterfall, Scrum, DevOps, Testing).
• Experience of DevOps and infrastructure deployments (Azure and Databricks).

Nice to Have

• Delivery experience using SAS (SAS EG, SAS DI, SAS Viya).
• Relational Databases and Data Warehousing concepts.
• Enterprise ETL tools such as Informatica, Talend, Datastage, or Alteryx.
• Project experience using technologies such as Hadoop, Spark, Scala, Oracle, Pega, Salesforce.
• Cross and multi-platform experience.
• Financial services sector experience.
• Line management experience.
• Team building and leading.
• Mentoring/staff development experience.

We Offer

• BDP Plus – A reward programme where you accrue points to trade against a 3-month paid sabbatical or cash equivalent.
• 25 days holiday + bank holidays.
• 5 days holiday buy/sell option.
• Private medical insurance.
• Life cover.
• Cycle to work scheme.
• Eligibility for company pension scheme (5% employer contribution, salary sacrifice option).
• Employee assistance programme.
• Bespoke online learning via Udemy for Business.

About the Company

Talan Data x AI is a leading Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight from their data. At Talan Data x AI, innovation is at the heart of our client offerings, and we help companies to further improve their efficiency with modern processes and technologies, such as Machine Learning (ML) and Artificial Intelligence (AI).

Our consultants are at the heart of everything we do, and we have been recertified as a 2025 Great Place to Work®. This achievement not only highlights Talan Data x AI’s positive organisational culture but also strengthens its reputation as an employer of choice within the industry. We invest heavily in the training and development of our teams and hold regular socials in each region to encourage engagement and network building.

Qualifications

• Willing to work on client sites, potentially for extended periods.
• Willing to travel for work purposes and be happy to stay away from home for extended periods.
• Eligible to work in the UK without restriction.