Senior Data Engineer

About the Position

We are seeking a Senior Data Engineer to optimize our DWH infrastructure and develop ETL services using Airflow and Python. Join our team at Admitad and contribute to keeping our data warehouse healthy and evolving.

Responsibilities

• Keep DWH infrastructure healthy and evolve system architecture
• Develop and refactor the ETL service (Airflow / Python)
• Write tests (pytest)
• Support legacy ETL pipelines (Logstash)
• Add/change data deliveries from Kafka and third-party service APIs
• Create and change dbt models for aggregates and views
• Take part in initiatives to reduce DWH cost (storage, compute, pipelines, and models)
• Participate in reviews and team meetings; collaborate with other engineering teams
• Keep technical documentation and Wiki up to date

Requirements

• 3+ years of Data Engineer experience
• Knowledge of Python 3.9+, asyncio, pytest
• Experience writing SQL queries
• Ability to work with Git version control
• Knowledge of Docker, GitLab CI, Unix CLI
• Knowledge of and hands-on experience with Kafka
• Ability to find and solve problems
• Experience with dbt and ClickHouse (or similar OLAP) is preferred
• Experience optimizing DWH cost: reducing storage and compute via TTL/partitioning, incremental ETL, SQL/OLAP model optimization
• Ability to measure and explain impact in terms of money and resources

Nice to Have

• Data lifecycle: hot/cold storage, archival, retention policies
• Experience migrating and simplifying legacy ETL into a cheaper, more manageable setup
• DBT: incremental models, volume-growth tests, control of expensive aggregates

We Offer

• Work in the international company
• Hybrid working format (office/home office)
• Corporate education – courses and trainings
• Voluntary health insurance after probation period
• Effective onboarding program for a better start
• Corporate events and team buildings

About the Company

Admitad is a leading international company in the digital marketing industry. We provide innovative solutions for affiliate marketing and are committed to fostering a collaborative and dynamic work environment.