Lead Data Engineer

About the Position

We are seeking a Lead Data Engineer to join our team and help our clients design, build, and operate reliable data platforms that transform complex data into valuable business insights.

Responsibilities

• Design, build, and maintain data pipelines to ingest, transform, and deliver data from various sources, including APIs.
• Develop solutions using Databricks, Snowflake, or Microsoft Fabric, tailored to client requirements and existing environments.
• Contribute to data architecture and solution design, including data storage, integration, and modeling.
• Develop data models, ontologies, and semantic layers that establish consistent business definitions and support analytics and reporting.
• Implement pipeline orchestration, scheduling, monitoring, and operational support to ensure data services remain reliable.
• Troubleshoot data and pipeline issues, improving performance, scalability, and cost efficiency.
• Apply data quality controls, automated testing, and validation throughout the data lifecycle.
• Implement role-based access control and follow security best practices for data platforms and integrations.
• Apply DevOps practices to data engineering, including version control, repository management, CI/CD, and automated deployment.
• Build data visualizations and reports that make information clear and useful to business users.
• Document solutions, review code, and share knowledge to support maintainable delivery and continuous improvement.

Requirements

• Hands-on experience delivering production data solutions using one or more of Databricks, Snowflake, or Microsoft Fabric.
• Strong programming skills in Python and SQL.
• Experience designing, developing, and operating data pipelines, including ETL/ELT processes, orchestration, and monitoring.
• A sound understanding of data architecture and modeling techniques, including analytical and dimensional modeling.
• An understanding of ontologies and semantic modeling, and how they connect data structures to business concepts.
• Practical experience optimizing data processing and troubleshooting pipeline, query, and platform performance.
• Experience integrating data through APIs, including authentication, error handling, and reliable data exchange.
• Experience applying role-based access control (RBAC) and data security best practices.
• Experience using Git, maintaining repositories, writing automated tests, and building CI/CD workflows for data solutions.
• Experience developing data visualizations and reports.
• The ability to explain technical choices clearly, work collaboratively with business and technical stakeholders, and guide other engineers.

Nice to Have

• Experience with PostgreSQL, SQL Server, Google BigQuery, or Amazon Redshift.
• Experience with R or other programming languages.
• Relevant cloud services across Microsoft Azure, AWS, or Google Cloud.
• Relevant certifications in Databricks, Snowflake, or Microsoft Fabric.

We Offer

• Flexible, hybrid working – 20 “work from anywhere” days per year on top of our hybrid policy.
• Global career pathways and non-linear progression; move between domains, disciplines, or geographies.
• Continuous learning via certifications, internal academies, tech communities, and funded conferences.
• Well-being & lifestyle allowance, loyalty leave, inclusive parental leave, and employee assistance programs.
• A vibrant, inclusive culture where diverse perspectives power innovation.

About the Company

Technology is our how, and people are our why. For 20-plus years, we have paired world-class engineering with deep industry insight, helping global brands create intelligent digital experiences that drive meaningful change. Join us as we expand our Australian Data & AI capability and help clients unlock the full value of their data assets.

Endava is an equal-opportunity employer. We value the differences that make us stronger and commit to transparent, merit-based hiring. We welcome applications from people of all backgrounds, experiences, and perspectives-because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.

Ready to drive AI-powered transformation?

Apply today with your CV and a short cover note outlining a data-led solution you are proud to have shaped. We look forward to exploring how your expertise can help our clients turn bold ideas into real-world impact.