Data DevOps Engineer

About the Position

We are seeking a Data DevOps Engineer to join our team at PTT Consulting. As a Data DevOps Engineer, you will serve as a platform expert responsible for the design, development, automation, testing, support, and administration of the Enterprise Infrastructure for Big Data and Fast Data processing.

Responsibilities

• Communicate effectively with technical and non-technical stakeholders.
• Support and host discussions within a multidisciplinary team, with potentially difficult dynamics.
• Be an advocate for the team externally, and can manage differing perspectives.
• Understand and help teams to apply a range of techniques for data profiling.
• Source system analysis from different sources.
• Bring multiple data sources together in a conformed model for analysis.
• Establish enterprise-scale data integration procedures across the data development life cycle, and ensure that teams adhere to them.
• Manage resources to ensure that data services work effectively at an enterprise level.
• Identify areas of innovation in data tools and techniques, and recognize appropriate timing for adoption.
• Establish standards, keep them up to date, and ensure adherence to them.
• Keep abreast of best practice in the industry.
• Understand the concepts and principles of data modeling and can produce relevant data models.
• Recognize opportunities for the reuse and alignment of data models in different organizations.
• Design the method to categorize data models within an organization.
• Design an appropriate metadata repository and present changes to existing metadata repositories.
• Understand a range of tools for storing and working with metadata.
• Provide oversight and advice to more inexperienced members of the team.
• Ensure that the most appropriate actions are taken to resolve problems as they occur.
• Coordinate teams to resolve problems and to implement solutions and preventative measures.
• Use agreed standards and tools to design, code, test, correct, and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations.
• Collaborate with others to review specifications where appropriate.
• Show a thorough understanding of the technical concepts required for the role, and can explain how these fit into the wider technical landscape.
• Review requirements and specifications, and define test conditions.
• Identify issues and risks associated with work.
• Analyze and report test activities and results.

Requirements

• Background in computer science, engineering, physics, mathematics, or equivalent
• Strong background in system administration and shell scripting
• Strong hands-on experience with Python and SQL
• Strong problem-solving skills
• Eagerness to learn new approaches and technologies

Nice to Have

• Experience with Azure cloud services
• Experience with Databricks and Spark
• Experience with administration of large clusters
• Experience with Private endpoint configuration
• Understanding of modern Big Data technologies (Hadoop, Spark, Kafka, NoSQL)
• Experience with virtualization
• Experience with containerization (Docker, Kubernetes)
• Experience with CI/CD tools
• Experience with Infrastructure as code
• Experience with configuration or infrastructure management tools

About the Company

A global leader with a sharp focus on lottery solutions. A confident step forward building on a long history of delivering safe and secure technology, demonstrating strong commitment to customers as a dedicated lottery service provider. Leveraging collective insight, experience, and expertise to create reliable and engaging solutions that help lottery clients achieve objectives, meet player needs, and deliver meaningful benefits to communities.