Lead Data Software Engineer

About the Position

We are seeking an experienced Lead Data Software Engineer to join our dynamic team and tackle rewarding challenges in India. As a Lead Engineer, you will be pivotal in creating and implementing Data solutions across various projects. The ideal candidate will possess deep experience in Data and associated technologies, strongly emphasizing Apache Spark, Python, Azure, and AWS.

Responsibilities

• Develop and execute end-to-end Data solutions for intricate business needs
• Work alongside cross-functional teams to comprehend project requirements and deliver superior software solutions
• Apply your knowledge in Apache Spark, Python, Azure, and AWS to build scalable and effective data processing systems
• Maintain the performance, security, and scalability of Big Data applications
• Keep abreast of industry trends and advancements in Big Data technologies to enhance our development processes

Requirements

• 8-12 years of hands-on experience in Data and Data-related technologies
• Expert-level knowledge and practical experience with Apache Spark
• Proficiency in Python
• Strong proficiency with Hadoop and Hive
• Experience working with native Cloud data services, specifically AWS and Azure

Nice to Have

• Background in machine learning algorithms and techniques
• Skills in data visualization tools such as Tableau or Power BI
• Knowledge of real-time data processing frameworks like Apache Flink or Apache Storm
• Understanding of containerization technologies like Docker or Kubernetes

We Offer

• Opportunity to work on technical challenges that may impact across geographies
• Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
• Opportunity to share your ideas on international platforms
• Sponsored Tech Talks & Hackathons
• Unlimited access to LinkedIn learning solutions
• Possibility to relocate to any EPAM office for short and long-term projects
• Focused individual development
• Benefit package:
  • Health benefits
  • Retirement benefits
  • Paid time off
  • Flexible benefits
• Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)