About the Position

We are looking for a Lead Data Engineer to join our team and lead the technical delivery of data migration and engineering initiatives. You will work closely with Engineers, Data Analysts, and Business Analysts to design scalable data solutions in GCP, guide the engineering pod, promote development standards, and support the team throughout the Agile development process.

Responsibilities

Provide technical leadership for data migration projects, including solution design, approach, and estimation
Design and develop scalable data pipelines using GCP, PySpark, and Scala
Provide guidance on environment setup, system architecture, and cloud design patterns
Implement solutions focused on performance, scalability, availability, accuracy, and monitoring
Promote coding standards, conduct code reviews, and support knowledge sharing
Mentor engineers and oversee the technical delivery of the engineering pod
Work with Business Analysts to ensure requirements are correctly interpreted and implemented
Support production environments, troubleshoot issues, and communicate findings to development teams
Participate in planning sessions, status meetings, sprint reviews, and retrospectives
Identify opportunities to use AI enablers to improve traditional engineering workflows

Requirements

At least 10 years of experience in software design, data engineering, and development in Agile and DevOps environments
Strong development and solution design experience with PySpark or Scala
Hands-on experience with Google Cloud Platform and building data pipelines in GCP
Experience with Apache Spark, Spark SQL, Hadoop, YARN, Hive, MapReduce, and ETL frameworks
Experience with Python, SQL, PL/SQL, and data integration
Experience with Apache Airflow or similar scheduling tools
Experience with REST APIs and RESTful services
Strong knowledge of Unix and Linux environments
Experience with Git, GitHub, Jenkins, Ansible, and Jira
Experience with automated testing, deployment, and monitoring
Understanding of cloud architecture and cloud design patterns
Ability to lead an engineering pod and guide the work of other engineers
Ability to work autonomously and act as a technical subject-matter expert
Strong communication and presentation skills for technical, senior, and non-technical audiences
Strong written and spoken English

Nice to Have

Experience with Elasticsearch
Experience developing Java APIs
Experience with data ingestion solutions
Experience working with Scrum and Kanban
Interest in AI-based tools that can accelerate engineering workflows

We Offer

Hybrid work in our client's office (Kraków) 8 days a month
Working in a highly experienced and dedicated team
Benefit package tailored to your needs (medical, sport, lunch subsidy, life insurance, etc.)
Online training and certifications
Access to e-learning platform
Social events

About the Company

We are GFT Poland. WE KNOW how to tackle complex issues with an innovative approach to deliver the highest value. Our reputation has been built around one simple rule: we do not overpromise, WE DELIVER. We deliver to our employees, clients, and partners. WE GROW as you grow, so investing in you is our business strategy. Caring for each other is our priority. WE CARE who you are, what you need, how you feel. WE CARE to smile, have fun, and develop as human beings.

Why Choose GFT?

A culture of top performance
Deep tech IT engineering & consulting
1200 skilled & top-class experts
77% of the team are regular/senior
Products that contribute to a sustainable world
Competitive salary and benefits
Ambitious projects, trainings, and tools you need to flourish
Google Cloud Partner of the Year - for going above and beyond for customers

Not Ready To Apply?

Stay connected! Enter your e-mail and we will keep you informed about upcoming events and opportunities that match your interests.

Apply now »

Lead Data Engineer

Job description