Job Description, Responsibilities & Requirements
About the Position
We are seeking an experienced Senior Cloud / Data Platform Engineer to design, build, and scale the enterprise digital product platform that will power analytics, applications, and AI-driven use cases across the business. This role will own the technical strategy, architecture, and operational outcomes for the cloud data platform, including real-time and batch ingestion, enterprise data storage (medallion architecture), data governance, security, and platform reliability.
As a key member of the Digital Platform team, this role will enable product, analytics, and AI teams to deliver value faster by providing standardized data models, reusable pipelines, and self-service access to trusted data. The role ensures the platform is scalable, secure, and cost-effective, while supporting critical capabilities such as asset and telemetry processing, data quality, lineage, and integration with machine learning services.
This position is accountable for improving platform reliability, performance, and transparency through strong engineering practices, automation, and observability, and for enforcing governance through clear data standards, access controls, and lifecycle management. This role will drive strategic investments in shared data capabilities, prioritize platform enhancements that unlock business value, and ensure the platform evolves in alignment with enterprise architecture and long-term cloud strategy.
Responsibilities
-
Platform Architecture & Roadmap
- Own the technical vision and evolution of the enterprise data platform aligned to business and digital strategy.
- Define the target architecture for real-time and batch data processing, including Medallion architecture patterns and event-driven pipelines.
- Translate platform strategy into quarterly technical objectives, capacity plans, and measurable engineering outcomes.
-
Core Data Platform Capabilities
- Design and operate the enterprise data storage using Amazon S3 and Apache Iceberg.
- Implement and mature Bronze–Silver–Gold (Medallion) architecture for structured, governed data processing.
- Define and maintain reusable building blocks for ingestion, transformation, storage, and serving.
- Establish reference implementations for streaming (Lambda/Flink) and batch ETL (Spark/Flink).
-
Enablement & Data Engineering Experience
- Provide standardized pipelines, templates, and patterns to enable analytics, applications, and ML teams to consume data efficiently.
- Enable self-service access to trusted datasets through Athena/Trino, APIs, and ML pipelines.
- Partner with application, edge, and ML teams to ensure seamless integration from telemetry to business-ready data.
-
Reliability, Security & Compliance
- Enforce enterprise-grade security and governance using Lake Formation, IAM, and KMS.
- Implement data quality, validation, lineage, and observability controls across pipelines.
- Design for resilience through robust error handling, reprocessing, and backfill mechanisms.
- Establish and maintain automated unit testing for data transformations, schemas, and business logic.
- Support System Integration Testing (SIT) and User Acceptance Testing (UAT).
-
Performance, Cost & Scalability
- Design and optimize storage, compute, and query performance for cost efficiency and predictable scaling.
- Monitor and continuously improve platform throughput, latency, and unit economics (e.g., cost per GB, cost per pipeline).
-
Cross-Functional Leadership & Stakeholder Engagement
- Work closely with edge, application, analytics, and AI teams to translate raw telemetry into trusted business insights.
- Partner with architecture, security, and cloud teams to align platform implementation with enterprise standards.
- Act as a technical advisor to product and business stakeholders on data platform capabilities and constraints.
Requirements
-
Preferred Qualifications
- 8–12+ years of experience in cloud, data engineering, or platform engineering roles, with a proven track record of building and operating scalable data platforms used by multiple teams.
- Deep familiarity with Medallion architectures, streaming pipelines, and cloud-native data services, with the ability to make pragmatic design and technology choices.
- Demonstrable expertise in real-time and batch data processing using technologies such as Apache Spark, Apache Flink, and event-driven architectures.
- Strong knowledge of data reliability engineering, including data quality, schema evolution, observability, error handling, and reprocessing at scale.
- Advanced proficiency in SQL and analytical query engines (Athena / Trino or equivalent) for large-scale data analysis.
- Hands-on experience with Amazon S3 and modern table formats such as Apache Iceberg (or Delta Lake).
- Solid understanding of cloud security and data governance, including IAM, KMS, and policy-based access control.
- Experience with workflow orchestration and automation using tools such as Airflow or Step Functions.
- Exposure to industrial IoT, or time-series data environments is highly desirable.
- Strong ability to collaborate with application, edge, analytics, and AI teams to translate raw data into business-ready insights.
- Demonstrated capability to operate in complex, multi-team environments with an emphasis on standardization, reuse, and continuous improvement.
- Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field, or equivalent practical experience.
-
Minimum Qualifications
- 10+ years in Agile delivery roles (Scrum Master/Agile Coach/Process Lead) supporting software product teams; proven success implementing Agile at team-of-teams or portfolio scale.
- Bachelor’s in Computer Science/Engineering or equivalent experience.
We Offer
- Competitive salary
- Opportunity to work in a diverse and inclusive environment
- Comprehensive health and welfare benefits
- Performance-based bonus program
- Professional development opportunities
About the Company
Black & Veatch Family of Companies believes real value is powered by the unique skills and experiences of our professionals. The interchange of ideas from a diverse group of people gives our teams an expanded perspective and the ability to find better solutions for our clients. We are committed to being an employer of choice by creating a valuable work experience that keeps our people engaged, productive, safe, and healthy.