Big Data Engineer
Primary stack
Job description
Big Data Engineer
Stanowisko: Big Data Engineer
Możemy w krótkim czasie przesłać Ci dobrych kandydatów. Skontaktuj się z nami
About the Position
We are seeking a Senior Big Data Engineer with expertise in Apache Spark, Hadoop, and Kafka to join our team in Poland.
Responsibilities
- Projektowanie i wdrażanie pipeline’ów batch oraz streaming w Apache Spark i Apache Kafka
- Budowa i optymalizacja klastrów Hadoop (HDFS, YARN, Hive) oraz migracja workloadów do chmury
- Tworzenie procesów ETL/ELT przetwarzających dane w skali terabajtów dziennie
- Modelowanie danych w hurtowniach i data lakehouse (Delta Lake, Iceberg)
- Automatyzacja orkiestracji zadań w Apache Airflow lub Dagster
- Zapewnianie jakości danych, monitoringu i alertowania w pipeline’ach produkcyjnych
- Optymalizacja kosztów i wydajności zapytań w środowiskach chmurowych (AWS EMR, GCP Dataproc, Azure Databricks)
- Współpraca z Data Scientistami przy dostarczaniu feature store dla modeli ML
- Implementacja polityk bezpieczeństwa i governance danych (RODO, szyfrowanie, access control)
- Dokumentacja architektury oraz code review kodu PySpark/Scala w zespole
Requirements
| Competency | Required Level | Details |
|---|---|---|
| Apache Spark | Expert | PySpark/Scala, tuning wydajności, partycjonowanie, broadcast joins |
| Hadoop Ecosystem | Advanced | HDFS, YARN, Hive, HBase, zarządzanie klastrem |
| Streaming | Advanced | Apache Kafka, Spark Structured Streaming, Flink |
| Cloud | Advanced | Min. jedna: AWS (EMR, Glue, S3), GCP (Dataproc, BigQuery), Azure (Databricks) |
| Programming Languages | Expert | Python biegle, Scala lub Java na dobrym poziomie, SQL zaawansowany |
| Orchestration | Advanced | Apache Airflow, Dagster, harmonogramowanie DAG |
| Data Lakehouse | Intermediate | Delta Lake, Apache Iceberg, Hudi |
| DevOps / IaC | Intermediate | Docker, Kubernetes, Terraform, CI/CD dla pipeline’ów |
| Experience | Min. 5 years | W tym min. 3 lata pracy z produkcyjnymi systemami big data |
| English Language | B2/C1 | Praca w międzynarodowych zespołach i dokumentacja techniczna |
Salary and Market Range 2026
Senior Big Data Engineer zarabia w Polsce 18 000–30 000 PLN brutto/mc na umowie o pracę, a na kontrakcie B2B stawki sięgają 130–200 PLN/h netto. Rozpiętość wynika z kilku mierzalnych czynników:
- Location – Warszawa i praca w pełni zdalna dla firm zagranicznych plasują się w górnych widełkach, mniejsze ośrodki 10-15% niżej
- Industry – fintech, bankowość i AdTech płacą premium 15-20% względem korporacji przemysłowych
- Certifications – Databricks Certified Data Engineer Professional, AWS/GCP Data Engineer podnoszą stawkę o 8-12%
- Experience – kandydaci z portfolio wdrożeń petabajtowych oraz znajomością Scali negocjują górną granicę
- Cooperation Model – B2B daje wyższą stawkę nominalną, UoP realny pakiet z benefitami
Standardowy pakiet obejmuje prywatną opiekę medyczną, kartę sportową, budżet szkoleniowy 4 000–8 000 PLN rocznie, dofinansowanie certyfikatów chmurowych, elastyczne godziny pracy oraz model hybrydowy lub w pełni zdalny.
How Cooperation with Smartways.io Works for Hiring a Big Data Engineer
Smartways.io delivers selected candidates for the Big Data Engineer position within 3-4 weeks, based on active headhunting rather than passive waiting for applications. The cooperation process follows these stages:
- Requirement Analysis (Days 1-3) – workshop with the hiring manager, defining the tech stack, seniority level, salary range, and ideal candidate profile
- Direct Search and Market Mapping (Days 4-12) – identifying and actively reaching out to passive candidates knowledgeable in Spark and Hadoop
- Technical Verification (Days 10-16) – competency interviews, checking production experience and motivation for change
- Shortlist Presentation (Days 15-20) – presenting 3-5 profiles with a recommendation, report, and availability
- Offer Support (Days 18-25) – coordinating final interviews, negotiations, and closing with a guaranteed hire
The entire process from brief to signed contract typically closes in 3-4 weeks. Each recruitment is covered by a guarantee – if the candidate leaves during the probation period, we conduct a new search at no additional cost.
FAQ – Common Questions about the Big Data Engineer Position
How long does the recruitment of a Big Data Engineer by Smartways.io take?
The standard process takes 3-4 weeks from brief to signing the contract. We usually present a shortlist of 3-5 verified candidates within 15-20 days from the start of the project.
What is the difference between a Big Data Engineer and a Data Engineer?
A Data Engineer builds pipelines on classic warehouses and smaller volumes, while a Big Data Engineer specializes in distributed processing of terabyte and petabyte scales using Spark, Hadoop, and Kafka. In practice, a Big Data Engineer is a more specialized, higher-valued profile.
How much does a Big Data Engineer earn in Poland in 2026?
A Senior Big Data Engineer earns 18,000–30,000 PLN gross/month on an employment contract, and 130–200 PLN/hour net on a B2B contract. The highest rates are offered by fintech, banking, and foreign companies hiring remotely.
Can a Big Data Engineer work fully remotely?
Yes, most big data engineer projects allow for a fully remote or hybrid model. Foreign companies recruiting in Poland almost always offer full remote with higher salary ranges.
What technologies must a senior Big Data Engineer know?
Key technologies include Apache Spark (PySpark/Scala), Hadoop, Kafka, orchestration in Airflow, and at least one cloud – AWS, GCP, or Azure Databricks. Knowledge of Delta Lake or Apache Iceberg is increasingly required.
Should we consider other roles instead of a Big Data Engineer?
If the main goal is to build a data processing application backend, consider a senior backend developer. For cluster infrastructure administration, a system administrator is helpful, and for ERP integrations – a SAP MM consultant. We are happy to advise on the right profile during the requirements analysis stage.
Hire a Big Data Engineer
Our specialists are ready to join your team.
Position: Big Data Engineer
We can send you good candidates in a short time. Contact us
SmartWays Sp. z o.o. - 2026 - all rights reserved.
© SmartWays Recruitment. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
IT,Finance,Sales,Purchasing,Other industries
About the Company SmartWays Recruitment offers bespoke and scalable recruitment solutions tailored to the evolving needs of businesses across various industries. The company focuses on recruitment within EMEA markets but delivers projects globally. Their services include direct search, contracting, body leasing, executive search, recruitment process outsourcing, and HR on-demand services. Products, Services & Tech Stack Core Solutions: Direct Search Contracting Body Leasing Executive Search Recruitment Process Outsourcing HR on-demand Project Scope & Target Clients Client Base: IT Finance Sales Purchasing Other industries Engineering Scale: Projects for large corporations, small businesses, and start-ups.