Senior Data Consultant (Hadoop, Spark)

About the Position

Senior Data Consultant (Hadoop, Spark)

Join GFT Poland as a Senior Data Consultant (Hadoop, Spark) to contribute to scalable data solutions in a dynamic DevOps environment.

Responsibilities

• Work as a key member of a technical team alongside Engineers, Data Analysts, and Business Analysts.
• Contribute to a collaborative Agile development process.
• Design, develop, and maintain scalable data solutions.
• Define and contribute to software design and development using Pyspark.
• Automate testing of new and existing components.
• Promote development standards through code reviews and mentoring.
• Provide production support and troubleshooting.
• Implement tools and processes ensuring performance, scalability, and monitoring.
• Collaborate with Business Analysts to interpret and implement requirements.
• Participate in planning, sprint reviews, and retrospectives.
• Contribute to system architecture and design.

Requirements

• Experience with Pyspark or Scala development and design.
• Experience using scheduling tools such as Airflow.
• Knowledge of the Hadoop ecosystem including Spark, Hive, YARN, and ETL frameworks.
• Strong SQL and RESTful services knowledge.
• Experience working on Unix or Linux platforms.
• Hands-on experience building data pipelines using Hadoop components.
• Experience with Git, GitHub, Jenkins, Ansible, and JIRA.
• Understanding of big data modeling using relational and non-relational techniques.
• Experience debugging code and communicating findings to development teams.
• Openness to work 2 days a week from our client's office (Kraków).

Nice to Have

• Experience with Elasticsearch.
• Experience developing Java APIs.
• Experience in data ingestion processes.
• Understanding of cloud design patterns.
• Exposure to DevOps and Agile methodologies such as Scrum and Kanban.
• Experience with Spark streaming.
• Experience with Apache Airflow in production.
• Experience with the Hadoop ecosystem in enterprise environments.
• Knowledge of Python backend services.
• Experience with Scala for high-performance systems.
• Experience in data integration and ETL processes.
• Knowledge of PL/SQL.
• Experience with Linux and Unix system operations.

We Offer

• Competitive salary and benefits.
• Ambitious projects, training, and tools you need to flourish.
• A culture of top performance.
• Deep tech IT engineering & consulting.
• 1200 skilled & top-class experts.
• 77% of the team are regular/senior.
• Products that contribute to a sustainable world.
• Google Cloud Partner of the Year - for going above and beyond for customers.

About the Company

We are GFT Poland. WE KNOW how to tackle complex issues with an innovative approach to deliver the highest value. Our reputation has been built around one simple rule: we do not overpromise, WE DELIVER. We deliver to our employees, clients, and partners. WE GROW as you grow, so investing in you is our business strategy. Caring for each other is our priority. WE CARE who you are, what you need, how you feel. WE CARE to smile, have fun, and develop as human beings.

Location

• City: Kraków
• Country: PL
• Working Location: Hybrid

Salary

• Range: 125-163 PLN net/h

Apply Now

• Start applying with LinkedIn
• Apply Now