Senior Data Engineer (Python, AWS)

About the Position

Senior Data Engineer (Python, AWS)

Join our team as a Senior Data Engineer (Python, AWS) to design, implement, and maintain data pipelines for data ingestion, processing, and transformation.

Company Description

Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.

By combining world-class engineering, industry expertise, and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.

From prototype to real-world impact - be part of a global shift by doing work that matters.

Responsibilities

• Work together with data engineers, scientists, and analysts to understand the needs for data and create effective data pipelines
• Solution design, implement, and maintain data pipelines for data ingestion, processing, and transformation using cloud services and other technologies
• Create and maintain data solutions mostly in Azure, AWS, or GCP (Redshift, Aurora, Athena, Data Factory, Big Query, etc.) and rarely on-premise (Sql Server, Oracle, PostgreSQL)
• Implementing data validation and cleansing procedures to ensure the quality, integrity, and dependability of the data
• Improve the scalability, efficiency, and cost-effectiveness of data pipelines
• Monitoring and resolving data pipeline problems, ensuring consistency and availability of the data

Requirements

• Proficient in Python and SQL
• Strong experience with Relational and ideally NoSQL databases
• Knowledge of good data design principles (concepts such as Kimball and Star Schema), data warehousing concepts, and data modelling
• Strong understanding of ETL/ELT processes
• Exposure to data monitoring and observability tools
• Relevant experience with Event-Driven Architecture
• Good understanding of Agile ways of working

We Offer

• Finance: Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus
• Career Development: Career coaching, global career opportunities, non-linear career paths, internal development programs for management and technical leadership
• Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences
• Work-Life Balance: Hybrid work and flexible working hours, employee assistance program
• Health: Global internal wellbeing program, access to wellbeing apps
• Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programs, events and celebrations

At Endava, we’re committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives-because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.