Senior Data Engineer
Primary stack
Nice to have's
Job description
About the Position
We are seeking a Senior Data Engineer with a strong Data Science background to support the design, build, and operation of reliable data pipelines for large-scale data and ML use cases.
Role Overview
The Data Engineer will support the design, build, and operation of reliable, production-ready data pipelines for large-scale data and ML use cases. This role requires a detail-oriented engineer who can bridge raw data ingestion, transformation, quality assurance, and downstream machine learning workflows.
The ideal candidate has hands-on experience building scalable data pipelines and supporting the end-to-end Data Science and ML lifecycle, from raw ingestion and hardening through production deployment, monitoring, and continuous improvement.
This role combines strong data engineering discipline with applied Data Science enablement, with particular emphasis on NLP/NLU use cases, Azure data and AI services, Databricks/PySpark processing, CI/CD, and MLOps practices.
Responsibilities
- Build, harden, and maintain reliable ingestion pipelines that move raw data into production-ready data platforms.
- Design and implement ETL/ELT processes for data cleaning, transformation, schema design, data quality validation, and lineage tracking.
- Develop large-scale data processing and transformation workflows using Databricks and PySpark.
- Support Data Science and ML teams by preparing high-quality datasets, features, and pipelines for NLP, NLU, and broader machine learning use cases.
- Operate and integrate Azure data and AI infrastructure, including Blob Storage, databases, compute resources, MLflow, and Azure AI/ML services.
- Implement CI/CD and MLOps practices, including automated deployment, testing, monitoring, reliability checks, and promotion gates.
- Ensure pipeline reliability, observability, performance, and production readiness across the full data and ML lifecycle.
- Own data quality, traceability, and operational handover so that data products and ML workflows can be trusted in production.
Requirements
- Strong Data Engineering experience, including ETL/ELT, pipeline development, data cleaning, transformation, schema design, and orchestration.
- Hands-on experience building reliable, production-ready data ingestion pipelines with appropriate hardening, validation, monitoring, and operational controls.
- Strong Python and PySpark skills for large-scale data processing, transformation, and pipeline development.
- Practical experience with Databricks for scalable data engineering, distributed processing, and production pipeline implementation.
- Hands-on Azure infrastructure experience, including Blob Storage, databases, compute resources, MLflow, and Azure AI/ML services.
- Solid understanding of data quality, lineage tracking, observability, reliability, and production readiness for data pipelines.
- Strong Data Science and ML lifecycle awareness, with the ability to support model development, experimentation, deployment, monitoring, and continuous improvement.
- Experience supporting NLP and NLU use cases, including preparation of high-quality datasets and pipelines for natural language applications.
Nice to Have
- Experience implementing CI/CD and MLOps practices, including automated testing, deployment, monitoring, promotion gates, and release reliability.
- Ability to bridge Data Engineering and Data Science teams, translating ML workflow needs into reliable data products and production pipelines.
- Experience with enterprise-grade ML platforms, feature pipelines, experiment tracking, model governance, or production ML operations.
- Familiarity with regulated or complex enterprise environments where data quality, traceability, security, and operational resilience are critical.
We Offer
- Fully remote position with possible occasional in-person team sessions/workshops/gatherings (i.e., 1x quarter) likely to take place in Prague.
- Minimum 2-6pm CET overlap with US hours, preferred 2-8pm CET.
About the Company
Participate in AI incubator projects to scout, incubate, and validate client and PwC-internal ideas on a 3–5 year horizon; develop technology roadmaps and prototypes that deliver advanced client solutions; champion internally generated concepts; and continually explore, test, and demonstrate cutting-edge AI to create new products, services, and capabilities.
Apply for this position
Our team will review your application within the next 5 days.
© The Workly. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.