Senior Pyspark Developer

About the Position

We are seeking a Senior Pyspark Developer with 8+ years of experience in data-intensive Pyspark development to join our investment bank client in the Trade Surveillance Team in Bengaluru, India.

Responsibilities

• Develop software applications based on business requirements
• Maintain software applications and make enhancements according to project specifications
• Participate in requirement analysis, design, development, testing, and implementation activities
• Propose new techniques and technologies for software development
• Perform unit testing and user acceptance testing to evaluate application functionality
• Ensure to complete the assigned development tasks within the deadlines
• Work in compliance with coding standards and best practices
• Provide assistance to Junior Developers when needed
• Perform code reviews and recommend improvements
• Review business requirements and recommend changes to develop reliable applications
• Develop coding documentation and other technical specifications for assigned projects
• Act as primary contact for development queries and concerns
• Analyze and resolve development issues accurately

Requirements

Must have

• 8+ years of experience in data-intensive Pyspark development
• Experience as a core Python developer
• Basic experience in Gen/Agentic AI
• Experience developing Classes, OOP, exception handling, parallel processing
• Strong knowledge of DB connectivity, data loading, transformation, calculation
• Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations
• Lambda Functions, Decorators
• Vector operations on Pandas dataframes/series
• Application of applymap, apply, map functions
• Concurrency and error handling data pipeline batch of size [1-10 gb]
• Ability to understand business requirements and translate them into technical requirements
• Ability to design architecture of data pipeline for concurrent data processing
• Familiar with creating/designing RESTful services and APIs
• Familiar with application unit tests
• Working with Git source control
• Service-oriented architecture, including the ability to consider integrations with other applications and services
• Debugging application

Nice to Have

• Knowledge of web backend technology
• Django, Python, PostgreSQL
• Apache Airflow
• Atlassian Jira
• Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus
• Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus

We Offer

• Competitive salary
• Opportunity to work with a leading investment bank client
• Professional growth and development

About the Company

Join our team and contribute to the development of reliable and efficient data processing solutions for a leading investment bank.

Application

Apply for Senior Pyspark Developer in Bengaluru, India.