Senior Data Engineer with Python and Databricks

About the Position

We are seeking a Senior Data Engineer with Python and Databricks to join our innovative team. Collaborate with data scientists and analysts to create effective data pipelines and drive meaningful change.

Responsibilities

• Work with data scientists and analysts to understand data needs and create effective data pipelines.
• Design, implement, and maintain data pipelines for data ingestion, processing, and transformation using cloud services and other technologies.
• Create and maintain data solutions in Azure using tools such as Data Factory, Synapse, Databricks/Spark, Polars/Pandas, and Fabric.
• Implement data validation and cleansing procedures to ensure data quality, integrity, and dependability.
• Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
• Monitor and resolve data pipeline problems, ensuring data consistency and availability.

Requirements

• Proficient in Python and SQL.
• Knowledge of good data design principles (concepts such as Kimball and Star Schema), data warehousing concepts, and data modeling.
• Strong experience with Relational and ideally NoSQL databases.
• Strong understanding of ETL/ELT processes.
• Exposure to data monitoring and observability tools.
• Relevant experience with Event-Driven Architecture.
• Good understanding of Agile ways of working.

We Offer

• Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus.
• Career coaching, global career opportunities, non-linear career paths, internal development programs for management and technical leadership.
• Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences.
• Hybrid work and flexible working hours, employee assistance program.
• Global internal wellbeing program, access to wellbeing apps.
• Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programs, events, and celebrations.

About the Company

Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change. By combining world-class engineering, industry expertise, and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses. From prototype to real-world impact - be part of a global shift by doing work that matters.

At Endava, we’re committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives-because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.