Senior Data Engineer

About the Position

Equal Experts is an innovative consultancy specializing in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We are currently seeking contract Senior Data Engineers with proven senior-level experience to join the Equal Experts network. Our Data Engineers are highly skilled in creating data pipelines for ingest, transformation, and storage of data, usually at scale, and are familiar with standing up analytics clusters.

Responsibilities

• Working with the client and the team to determine data processing and access needs and how best to deliver them.
• Creation and support of highly available data pipelines and storage solutions (e.g., data warehouses).
• Delivery of software using agile (pair programming, TDD, CI/CD, etc.) practices.
• Automation of data infrastructure and deployments.
• Advocating agile practices to the client organization.
• Mentoring client team members.
• Helping improve the team and clients’ data capabilities.

Requirements

• Significant experience working on data pipelines, platforms, and projects.
• Experience in developing solutions in one or more of the main Cloud providers (AWS, GCP, Azure).
• Strong background in at least one programming language, Python or Scala preferable.
• Working with a variety of databases, data warehouses, and distributed file systems in production environments.
• Strong experience in SQL and data modeling.
• Exposure to data processing at scale.
• Working with source control and infrastructure as code (Git/Github, Terraform, Ansible, etc.) and CI/CD tools.
• Understanding and being able to support data scientists or business intelligence teams in data prep, mentoring, and support functions.
• Strong collaboration and communication skills, including the ability to communicate effectively while working remotely with globally distributed teams.

We Offer

• Opportunity to work with a leading consultancy specializing in custom software solutions.
• Be part of a global network with offices in Australia, India, South Africa, the UK, the EU, and the USA.
• Work on important projects for our clients.
• Recognized for our leadership in the application of agile and lean delivery methods.

About the Company

Equal Experts is an innovative consultancy specializing in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important projects for our clients, deliver market-leading propositions across the digital, online, and mobile channels, and are recognized for our leadership in the application of agile and lean delivery methods to assure delivery.