Tech Stack
PythonGCPETLSQL
Job Description, Responsibilities & Requirements
About the Position
GCP Data Engineer
Nigel Frank is seeking a GCP Data Engineer with expertise in big data engineering and ETL processes to join our team in Johannesburg, South Africa. This is a Contract role at the Mid-Level experience level.
Responsibilities
- Architects Data analytics framework
- Translates complex functional and technical requirements into detailed architecture, design, and high performing software
- Leads Data and batch/real-time analytical solutions leveraging transformational technologies
- Works on multiple projects as a technical lead driving user story analysis and elaboration, design and development of software applications, testing, and builds automation tools
- Development and Operations
- Database Development and Operations
- Policies, Standards and Procedures
- Business Continuity & Disaster Recovery
- Research and Evaluation
- Creating data feeds from on-premise to AWS Cloud
- Support data feeds in production on break fix basis
- Creating data marts using Talend or similar ETL development tool
- Manipulating data using Python
- Processing data using the Hadoop paradigm particularly using EMR, AWS's distribution of Hadoop
- Develop for Big Data and Business Intelligence including automated testing and deployment
Requirements
- GCP
- Big Data Engineering
- Data Engineering
- ETL
- Python
- SQL
We Offer
- Competitive contract terms
- Opportunity to work with cutting-edge technologies
- Be part of a dynamic and innovative team
About the Company
Nigel Frank is a leading provider of intelligent cloud and modern workplace solutions. We are committed to delivering excellence and driving innovation in the tech industry.