Valtech logo

Senior Data Engineer

Valtech·Salary not specified

Primary stack

Apache SparkDatabricksPythonAWSDelta LakeSQL

Nice to have's

GenAICI/CDTerraformCloudFormationKafkaSpark optimizationadvanced analyticsML workloadscausal experimentation platformsdata productslarge-scale analytics platforms

Job description

About the Position

We are looking for an experienced Senior Data Engineer to design, build, and optimize modern, cloud-based data platforms that power analytics, AI, and data products across the organization. You will work on scalable batch, streaming, and near-real-time pipelines, enabling high-quality, curated datasets while ensuring robust data governance, security, and observability across the data ecosystem.

Responsibilities

  • Build & Data Platform Engineering

    • Design and implement scalable data platforms and pipelines primarily on AWS and Databricks.
    • Develop reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake.
    • Implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold) within Databricks.
  • Enable AI, GenAI & Data Products

    • Deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems.
    • Enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows).
  • Data Modeling, Orchestration & Automation

    • Design scalable logical and physical data models for analytical and operational use cases.
    • Orchestrate workflows using tools such as Airflow, dbt, Databricks Workflows, or equivalents.
  • Architecture, Governance & Observability

    • Apply modern architecture patterns including event-driven and streaming architectures.
    • Ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC).
  • Data Serving, Integration & Optimization

    • Enable data serving layers (APIs, feature inputs, analytical endpoints) to support downstream systems.
    • Continuously monitor and optimize pipelines and infrastructure for performance, scalability, and cost efficiency.
  • Requirements Discovery & Business Partnership

    • Bring genuine curiosity to every engagement and understand the business problems behind the data.
    • Apply common sense thinking, detailed analysis, and experience-based recommendations to help derive and refine business requirements.
  • Collaboration

    • Work closely with data scientists, ML engineers, analysts, and business stakeholders to translate requirements into robust data solutions.

Requirements

Must Have Qualifications

  • Technical Skills

    • Strong hands-on experience with Apache Spark and Delta Lake.
    • Strong programming skills in Python and SQL.
    • Proven experience building batch and streaming data pipelines and production-grade data platforms.
  • Cloud & Platforms (Key Requirement)

    • Strong, demonstrable hands-on experience with AWS and Databricks.
    • Familiarity with other modern data platforms such as Snowflake, Azure/Fabric, or GCP is a plus but not required.
  • Architecture & Systems Thinking

    • Experience with lakehouse architectures and distributed data systems.
    • Strong understanding of scalability, reliability, and performance considerations in data pipelines.
  • Mindset

    • Naturally curious, with strong problem-solving skills focused on scalability and reliability.
    • Comfortable applying common sense thinking, detailed analysis, and experience-based recommendations to help derive and challenge business requirements.

Nice to Have Qualifications

  • Experience with GenAI and AI data systems (e.g., RAG pipelines, vector databases, LLM data preparation).
  • Experience with CI/CD for data pipelines and infrastructure-as-code tools such as Terraform or CloudFormation.
  • Additional exposure to streaming technologies (e.g., Kafka), Spark optimization, or advanced analytics and ML workloads (including causal or experimentation platforms).
  • Experience building data products or large-scale analytics platforms.

We Offer

  • Health insurance that guarantees fast access to contracted health services
  • Vacation Plan
  • Subsidy for study materials, trainings, conferences, and events that will contribute to your development
  • Hybrid Working model
  • Performance Evaluation Process that paves the roadmap for a personal and professional career development
  • Refreshments and fruit in the office
  • Team gatherings and parties organized and subsidized by the company

About the Company

Valtech is the experience innovation company that exists to unlock a better way to experience the world. By blending crafts, categories, and cultures, we help brands unlock new value in an increasingly digital world.

At the intersection of data, AI, creativity, and technology, we drive transformation for leading organizations, including L’Oréal, Mars, Audi, P&G, Volkswagen Dolby, and more.

At Valtech, we don’t just talk about transformation. We make it happen. Our people are the heart of our success, and we foster a workplace where everyone has the support to thrive, grow, and innovate.

Are you ready to create what’s next? Join us.

Apply for this Job

Once you apply, our Talent Acquisition team will review your application. Your CV should cover key information on relevant experiences and expertise. We do not require information such as age, gender, marital status, or a headshot in your application. We review all candidates based on skills, experience, and potential.

⚠️ Beware of recruitment fraud!

We are committed to inclusion and accessibility. If you need reasonable accommodations during the interview process, please either indicate it in your application or let your Talent Partner know.

© Valtech. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

Valtech is a global business transformation agency delivering innovation. They enable clients to a connect more directly with consumers across their digital and physical touchpoints while optimizing time-to-market and ROI.

More at Valtech

All 197 roles

Popular searches