Senior Data Engineer

About the Position

Join Valtech as a Senior Data Engineer in Lisbon, where you'll design and optimize cloud-based data platforms for analytics, AI, and data products.

Responsibilities

Build & Data Platform Engineering

• Design and implement scalable data platforms and pipelines across cloud environments (Azure/Fabric, AWS, GCP, Databricks, Snowflake).
• Develop reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake.
• Build ingestion, transformation, and curation workflows for both structured and unstructured data.

Enable AI, GenAI & Data Products

• Deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems.
• Enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows), as well as agent-based architectures and intelligent workflows.

Data Modeling, Orchestration & Automation

• Design scalable logical and physical data models for analytical and operational use cases.
• Orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents, with a strong focus on automation, reliability, and maintainability of end-to-end pipelines.

Architecture, Governance & Observability

• Apply modern architecture patterns including event-driven and streaming architectures.
• Ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC).
• Establish strong data observability, including monitoring of data freshness, pipeline reliability, and SLA adherence.

Data Serving, Integration & Optimization

• Enable data serving layers (APIs, feature inputs, analytical endpoints) to support downstream systems, including ML and AI platforms.
• Continuously monitor and optimize pipelines and infrastructure for performance, scalability, and cost efficiency.

Collaboration

• Work closely with data scientists, ML engineers, analysts, and business stakeholders to translate requirements into robust data solutions.
• Support adoption of data products and contribute to best practices across the data and AI ecosystem.

Requirements

Must Have Qualifications

Technical Skills

• Strong hands-on experience with Apache Spark and Delta Lake.
• Strong programming skills in Python and SQL.
• Proven experience building batch and streaming data pipelines and production-grade data platforms.
• Solid understanding of data modeling, data quality, and governance principles.

Cloud & Platforms (Key Requirement)

• Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP.
• Familiarity with modern data platforms such as Databricks and Snowflake is expected.

Architecture & Systems Thinking

• Experience with lakehouse architectures and distributed data systems.
• Strong understanding of scalability, reliability, and performance considerations in data pipelines.

Mindset

• Strong problem-solving skills focused on scalability and reliability.
• Collaborative approach to working in cross-functional teams.
• Experience in Agile or consulting environments is beneficial.

Nice to Have Qualifications

• Experience with GenAI and AI data systems (e.g., RAG pipelines, vector databases, LLM data preparation).
• Experience with CI/CD for data pipelines and infrastructure-as-code tools such as Terraform, ARM, or CloudFormation.
• Exposure to streaming technologies (e.g., Kafka), Spark optimization, or advanced analytics and ML workloads (including causal or experimentation platforms).
• Experience building data products or large-scale analytics platforms is beneficial.

We Offer

• Flexibility, with remote and hybrid work options (country-dependent).
• Career advancement, with international mobility and professional development programs.
• Learning and development, with access to cutting-edge tools, training, and industry experts.

About the Company

Valtech is the experience innovation company that exists to unlock a better way to experience the world. By blending crafts, categories, and cultures, we help brands unlock new value in an increasingly digital world.

At the intersection of data, AI, creativity, and technology, we drive transformation for leading organizations, including L’Oréal, Mars, Audi, P&G, Volkswagen Dolby, and more.

At Valtech, we don’t just talk about transformation. We make it happen. Our people are the heart of our success, and we foster a workplace where everyone has the support to thrive, grow, and innovate.

Are you ready to create what’s next? Join us.