COMARCH logo

Senior Data Engineer

COMARCH·Salary not specified

Primary stack

DockerPythonAirflowCI/CDUnit TestingGitSQL

Nice to have's

ETL/ELTSparkdbtSplinkGreat Expectations

Job description

About the Position

Senior Data Engineer

Numer referencyjny: SDE/Adm

Lokalizacje:

Kraków, Poland


We are looking for a Senior Data Engineer to join our team in Kraków, Poland. If you have a passion for building scalable data architectures, creating advanced data pipelines, and translating complex concepts into business language, we want you!

We are in the midst of a crucial digital and financial transformation (project F1) and are seeking a Senior Data Engineer to take technical responsibility for the development of our data platform (Data Hub) in the areas of Master Data Management (MDM) and Data Quality.

Take the next step in your career and build a modern data environment from the ground up in an international technology company!

Responsibilities

  • Designing and implementing data layer architecture (staging, raw, golden record, presentation) in the Data Hub
  • Creating and automating data pipelines (ETL/ELT) using Apache Airflow, Spark, dbt, and advanced SQL
  • Implementing and optimizing "Golden Record" creation pipelines using the Splink library (Python) and deterministic and probabilistic rules
  • Managing data merging and priority rules (survivorship rules) for customers and suppliers
  • Implementing and maintaining the Great Expectations framework for automated data quality validation
  • Taking over external vendors' code repositories and standardizing them in-house while maintaining best practices (Git, Docker, CI/CD)

Requirements

  • Minimum 4-5 years of commercial experience as a Data Engineer
  • Excellent knowledge of SQL (including analytical functions, query optimization, designing views and table structures) and Python (data processing, pandas/polars libraries, API integrations)
  • Practical knowledge of data orchestration tools (e.g., Apache Airflow) and experience in building data warehouses or Data Hubs
  • Experience in the area of MDM / Record Linkage (data deduplication, matching engines) or strong motivation to develop in this direction
  • Familiarity with good engineering practices: version control (Git), containerization (Docker), deployment automation (CI/CD), and unit testing
  • Ability to communicate fluently and translate complex technical issues into business language
  • Fluent in Polish (native) and good knowledge of English (minimum B2)

Nice to Have

  • Experience with ETL/ELT
  • Experience with Spark
  • Experience with dbt
  • Experience with Splink
  • Experience with Great Expectations

We Offer

  • Participation in one of the largest digital and process transformations in Poland and decision-making in the architecture of data pipelines and data orchestration
  • Access to internal and external training, participation in industry conferences, work with modern technologies and AI, and a clear career path (e.g., towards Lead Data Architect)
  • Trust, high level of autonomy, and openness to experiments and new ideas
  • Hybrid work model and flexible start times
  • Cafeteria system - you can choose full subsidy for a Multisport card, allocate funds for culture, leisure or sports and shopping
  • Convenient access - parking spaces available for everyone and full facilities for those commuting by bike

About the Company

Get to Know Us

One place, many opportunities

Watch the video

Similar Job Openings

  • Various locations IT Solution Architect DevOps and Architect
  • Various locations Business Systems Analyst (Insurance) Analysis
  • Various locations QA Software Engineering Expert Software Quality Control

Recruitment Process Stages

  1. Find a job offer that interests you
  2. Fill out and submit the application form
  3. Check your email inbox. You will receive confirmation of your application submission
  4. We will be in touch

© COMARCH. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

COMARCH logo
COMARCH

Finance,Trade,SME

About the Company Comarch, established in 1993 in Krakow, creates innovative IT solutions for companies in over 60 countries. The company specializes in ERP, CRM, IT security, telecommunications, and AI. It supports the finance, trade, and SME sectors, collaborating with global brands such as BP. Products, Services & Tech Stack Core Solutions: ERP CRM IT Security Telecommunications AI Technologies & Frameworks: Java 21+ Angular 22+ AI-Native ERP Project Scope & Target Clients Client Base: Finance Trade SMEs Engineering Scale: Large projects Complex engineering tasks

More at COMARCH

All 93 roles

Popular searches