Tech Stack
CI/CDDevOpsAzure DevOps
Job Description, Responsibilities & Requirements
About the Position
Developer
Nigel Frank is seeking a skilled Data Engineer for an onsite position in Cape Town, South Africa. This role is pivotal in harnessing cutting-edge Azure technologies to drive innovation and transform insights into action.
Responsibilities
Event-Driven & Streaming Architecture
- Design and implement event-driven architectures using Azure Event Hubs and Kafka.
- Build and maintain scalable real-time streaming data pipelines.
- Ensure high availability, fault tolerance, and performance optimization of streaming platforms.
- Define messaging standards, schemas, and integration best practices.
API & Serverless Integration
- Develop and manage APIs using Azure API Management (APIM).
- Build serverless integration services using Azure Functions.
- Design RESTful APIs and microservices-based integration solutions.
- Manage API lifecycle, versioning, and security policies.
Data Platform Enablement
- Integrate data into downstream platforms such as Azure Databricks and SQL-based systems.
- Support real-time ingestion into analytics and operational reporting systems.
- Collaborate with data engineering teams on ingestion frameworks.
Governance, Security & Monitoring
- Implement monitoring, logging, and alerting for integration services.
- Apply authentication and authorization standards (OAuth, managed identities, RBAC).
- Ensure secure and compliant data movement across environments.
- Maintain architecture documentation and integration blueprints.
Collaboration & Delivery
- Partner with enterprise architects and engineering teams to define integration strategy.
- Drive integration initiatives from design to production deployment.
- Provide technical guidance and mentorship to junior engineers.
Requirements
- Bachelor's degree in Computer Science, Engineering, or related field.
- 6-7 years of experience in integration engineering or middleware development.
- Strong hands-on expertise in:
- Azure Event Hubs
- Kafka
- Azure API Management (APIM)
- Azure Functions
- SQL
- Azure Databricks
- Experience designing event-driven and microservices architectures.
- Strong understanding of distributed systems and messaging patterns.
- Experience working in cloud-native Azure environments.
We Offer
- Competitive pension plan
- Retirement savings contributions
- Comprehensive medical insurance
- 5 days a week in office in Claremont
About the Company
Nigel Frank is a leading recruitment firm specializing in Intelligent Cloud and Modern Workplace solutions. We are committed to delivering impactful data solutions and driving innovation in the tech industry.
If you are passionate about data engineering and ready to take on new challenges, we encourage you to apply for this exciting opportunity.