Job Description, Responsibilities & Requirements
About the Position
Big Data Platform Engineer @ING Hubs Romania
Join ING Hubs Romania as a Big Data Platform Engineer, optimizing and securing large data workloads across teams.
Responsibilities
As a Big Data Platform Engineer, you’ll be at the heart of ING Wholesale Banking’s data infrastructure, helping to shape and sustain one of the largest Data Lakes in the organization. Your mission is to ensure the platform is scalable, secure, and high-performing-supporting large data workloads and enabling seamless collaboration across data engineering, ETL, and BI teams. You’ll also play a key role in bridging platform engineering with DevOps, driving automation and reliability in our big data operations.
- Administer and optimize Cloudera Data Platform clusters (CDP/CDH/Cloudera Manager)
- Monitor and tune core Hadoop ecosystem components: HDFS, YARN, Hive, Spark
- Automate cluster operations and CI/CD workflows using Azure DevOps and pipelines
- Implement and maintain security and governance frameworks (Kerberos, Ranger, Atlas)
- Collaborate with developers and ETL engineers to troubleshoot performance issues across Spark jobs, Hive queries, and resource utilization
- Contribute to capacity planning, cluster tuning, and resource optimization strategies
Requirements
- 4+ years of hands-on experience managing production-grade Cloudera/Hadoop environments
- Deep expertise in:
- HDFS replication and management
- Hive optimization and Metastore tuning
- Spark on YARN performance tuning
- Cloudera Manager configuration and automation
- Strong scripting skills (Python, Bash, or Ansible)
- Experience with CI/CD automation using Azure DevOps
- Solid understanding of Linux systems, performance tuning, and networking fundamentals
We Offer
At ING, we believe in a world where everyone has the right to develop on your own terms. "Do your thing" applies not only to our clients, but also to our employees. We offer a unique – and sometimes even surprising – benefits package.
About the Company
ING Hubs Romania offers 130 services in software development, data management, non-financial risk & compliance, audit, and retail operations to 24 ING units worldwide, with the help of over 1,700 high-performing engineers and risk and operations professionals. We enjoy a flexible way of working and a highly collaborative environment, where fair and constructive feedback is encouraged.
For us, impact isn't a perk. It's the driver of our work. We are guided and rewarded by a shared desire to make the world a better place, one innovative solution at a time. Our colleagues make it their job to do impactful things and they love doing it in good company. Do you?