About the Position

Senior Data Engineer (Hadoop, Spark)

We are looking for a Senior Data Engineer to join our team in Kraków, Poland. This role involves working in a hybrid model, contributing to scalable data solutions in a dynamic DevOps environment.

Responsibilities

Define and contribute to software design and development using Pyspark
Automate testing of new and existing components
Promote development standards through code reviews and mentoring
Provide production support and troubleshooting
Implement tools and processes ensuring performance, scalability, and monitoring
Collaborate with Business Analysts to interpret and implement requirements
Participate in planning, sprint reviews, and retrospectives
Contribute to system architecture and design

Requirements

Experience with Pyspark or Scala development and design
Experience using scheduling tools such as Airflow
Knowledge of the Hadoop ecosystem including Spark, Hive, YARN, and ETL frameworks
Strong SQL and RESTful services knowledge
Experience working on Unix or Linux platforms
Hands-on experience building data pipelines using Hadoop components
Experience with Git, GitHub, Jenkins, Ansible, and JIRA
Understanding of big data modeling using relational and non-relational techniques
Experience debugging code and communicating findings to development teams

Nice to Have

Experience with Elasticsearch
Experience developing Java APIs
Experience in data ingestion processes
Understanding of cloud design patterns
Exposure to DevOps and Agile methodologies such as Scrum and Kanban
Experience with Spark streaming
Experience with Apache Airflow in production
Experience with the Hadoop ecosystem in enterprise environments
Knowledge of Python backend services
Experience with Scala for high-performance systems
Experience in data integration and ETL processes
Knowledge of PL/SQL
Experience with Linux and Unix system operations

We Offer

Hybrid work in Kraków (2 office days per week)
Working in a highly experienced and dedicated team
Benefit package tailored to your needs (medical, sport, lunch subsidy, life insurance, etc.)
Online training and certifications
Access to an e-learning platform
Social events

About the Company

We are GFT Poland. WE KNOW how to tackle complex issues with an innovative approach to deliver the highest value. Our reputation has been built around one simple rule: we do not overpromise, WE DELIVER. We deliver to our employees, clients, and partners. WE GROW as you grow, so investing in you is our business strategy. Caring for each other is our priority. WE CARE who you are, what you need, how you feel. WE CARE to smile, have fun, and develop as human beings.

Why Choose GFT?

A culture of top performance
Deep tech IT engineering & consulting
1200 skilled & top-class experts
77% of the team are regular/senior
Products that contribute to a sustainable world
Competitive salary and benefits
Ambitious projects, trainings, and tools you need to flourish
Google Cloud Partner of the Year - for going above and beyond for customers

Salary

Salary range: 15800-24300 PLN gross/month

Apply Now

Not ready to apply? Stay connected! Enter your e-mail and we will keep you informed about upcoming events and opportunities that match your interests.

Senior Data Engineer (Hadoop, Spark)

Job description