Sr Cloudera Developer (Data Engineer)

About the Position

We are seeking a Sr Cloudera Developer (Data Engineer) with 6-10 years of experience to join our team in Pune, focusing on data solutions using Cloudera technologies.

Responsibilities

• Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive
• Collaborate with data engineers to optimize data pipelines and data processing workflows
• Work closely with data analysts and data scientists to ensure data quality and integrity
• Troubleshoot and resolve issues with data processing and data storage systems
• Stay up-to-date on the latest trends and best practices in Cloudera development
• Participate in code reviews and provide feedback to team members

Requirements

• Proficiency in working with Spark
• Understanding of Spark's architecture and fault tolerance mechanisms
• Proficiency in using Spark DataFrames and Spark SQL for querying structured data
• Experience in optimizing Spark execution plan is a plus
• Skills in performing Extract Transform and Load (ETL) processes using Spark
• Experience with integrating Spark Streaming with other technologies like Kafka is an advantage
• Familiarity with the Hadoop ecosystem including tools such as HDFS, Hive, and Cloudera stack can be of advantage
• Experience with deploying and managing Spark applications on a Hadoop cluster or on GCP Dataproc
• Strong knowledge of Python; experience with Java is beneficial as well
• DevOps tools and practices: CI/CD, Docker
• Hands-on experience in GCP services: Dataproc, Cloud Function, Cloud Run, Pub/Sub, BigQuery

Qualifications and Skills

• Bachelor’s degree in computer science, Information Technology, or a related field
• Proven experience as a Cloudera Developer or similar role
• Solid understanding of Cloudera technologies such as Hadoop, Spark, and Hive
• Experience with data modeling, data warehousing, and data integration
• Strong programming skills in Java, Scala, or Python
• Excellent problem-solving and communication skills
• Ability to work independently and as part of a team

We Offer

• Competitive contract terms
• Opportunity to work with cutting-edge Cloudera technologies
• Collaborative and innovative work environment

About the Company

T-Systems Information and Communication Technology India Private Limited (T-Systems ICT India Pvt. Ltd.) is a proud recipient of the prestigious Great Place To Work® Certification™. As a wholly owned subsidiary of T-Systems International GmbH, T-Systems India operates across Pune, Bangalore, and Nagpur, boasting a dedicated team of 3500+ employees providing services to group customers. T-Systems offers integrated end-to-end IT solutions, driving the digital transformation of companies in all industries, including automotive, manufacturing, logistics, and transportation, as well as healthcare and the public sector. T-Systems develops vertical, company-specific software solutions for these sectors. T-Systems International GmbH is an information technology and digital transformation company with a presence in over 20 countries and a revenue of more than €4 billion. T-Systems is a world-leading provider of digital services and has over 20 years of experience in the transformation and management of IT systems. As a subsidiary of Deutsche Telekom and a market leader in Germany, T-Systems International offers secure, integrated information technology and digital solutions from a single source.