Senior Data Engineer - Scala
Primary stack
Job description
About the Position
We are seeking a Senior Data Engineer - Scala to join our team in Bengaluru, India. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support continuing increases in data volume and complexity.
Responsibilities
- Design, construct, install, test, and maintain highly scalable data management systems & Data Pipeline.
- Ensure systems meet business requirements and industry practices.
- Build high-performance algorithms, prototypes, predictive models, and proof of concepts.
- Research opportunities for data acquisition and new uses for existing data.
- Develop data set processes for data modeling, mining, and production.
- Integrate new data management technologies and software engineering tools into existing structures.
- Create custom software components and analytics applications.
- Install and update disaster recovery procedures.
- Collaborate with data architects, modelers, and IT team members on project goals.
- Provide senior-level technical consulting to peer data engineers during data application design and development for highly complex and critical data projects.
Requirements
- Bachelor's degree in computer science, Engineering, or related field, or equivalent work experience.
- Proven 5-8 years of experience as a Senior Data Engineer or similar role.
- Experience with big data tools: Python, Hadoop, Spark, Pyspark & Scala.
- Expert-level SQL skills for data manipulation (DML) and validation (DB2).
- Experience with data pipeline and workflow management tools.
- Experience with object-oriented/object function scripting languages: Python, Java, Go lang, etc.
- Strong problem-solving and analytical skills.
- Excellent verbal communication skills.
- Good interpersonal skills.
- Ability to provide technical leadership for the team.
We Offer
- Competitive salary
- Opportunity to work in a dynamic and innovative environment
- Professional growth and development opportunities
About the Company
[Company description if present]
© Capco. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
CAPCO POLANDCapco Poland is a global technology and management consultancy specializing in driving digital transformation across the financial services industry. We are passionate about helping our clients succeed in an ever-changing industry.Joining Capco means joining an organization committed to an inclusive working environment where you’re encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, are critical to success.We also are:-> Experts in Java, Angular, React, Mobile (Android & iOS), Big Data, DevOps, Cloud (AWS, GCP, Azure), Murex, QA-> Focused on development, automation, innovation, and long-term projects in financial services-> Committed to providing development opportunities, project continuity and professional coaching to our employees
More at Capco
All 360 rolesManaging Principal - Payments
Capco · Canada
Managing Principal (Director) - Trade & Transaction Reporting
Capco · United Kingdom
Managing Principal (Director) - Operational Resilience & Cyber
Capco · United Kingdom
Managing Principal (Director) - Financial Crime Transformation - AML Investigations, Sanctions & Fraud
Capco · United Kingdom
Similar jobs
Senior/Lead Data Engineer [Scala]
EPAM · Ukraine
Senior/Lead Data Engineer [Scala]
EPAM · Ukraine
Senior Data Software Engineer, Spark, Java, Scala
EPAM · United States
Senior Data Software Engineer, Spark, Java, Scala
EPAM · United States