Job Description, Responsibilities & Requirements
About the Position
We are looking for an experienced Lead Data Software Engineer to join our dynamic team and address rewarding challenges.
As a Lead Engineer, you will play a key role in designing and delivering Data solutions across diverse projects. The ideal candidate should have significant expertise in Data and associated technologies, particularly Apache Spark, Python, Azure, and AWS.
Responsibilities
- Develop end-to-end Data solutions tailored to complex business demands
- Collaborate with cross-functional teams to understand project needs and ensure exceptional software solutions
- Utilize knowledge of Apache Spark, Python, Azure, and AWS to design scalable and efficient systems
- Ensure the performance, security, and scalability of Data applications
- Stay updated on emerging trends and innovations in Data technologies to improve development practices
Requirements
- 8-12 years of strong experience in Data and related technologies
- Expertise in Apache Spark
- Proficiency in Hadoop and Hive
- Skills in Python
- Competency in using native Cloud data services such as AWS and Azure
Nice to Have
- Background in machine learning algorithms and methods
- Proficiency in data visualization tools like Tableau or Power BI
- Familiarity with real-time data processing frameworks like Apache Flink or Apache Storm
- Capability to work with containerization technologies such as Docker or Kubernetes
Technologies
- Hadoop
- Hive