Senior Databricks Engineer with Python

About the Position

We are seeking a Senior Databricks Engineer with Python to join our team in Pune, India, focusing on developing and optimizing reporting processes using PySpark and SQL.

Responsibilities

• Implement high-quality solutions that address business needs and adhere to industry standards
• Drive automation of manual processes to the next level
• Closely collaborate within an agile team and a global agile organization
• Translate high-level business requirements into technical requirements addressing reliability, scalability, and performance needs

Requirements

• Minimum 6+ years of hands-on application development experience using Databricks with Python
• Experience with PySpark, Pandas, NumPy, and unit testing
• Hands-on experience with SQL Server/ PostgreSQL database
• Practical experience with microservice architectures, CI/CD pipelines (preferably with GitLab)
• Good to have exposure to cloud native services on Azure
• Experience in translating high-level business requirements into IT requirements
• Excellent communication skills

Nice to Have

• Azure Data Services
• ETL & Data Processing
• Financial Data Processing, experience handling risk, compliance, and regulatory data in an investment banking environment
• Data Modeling, metadata management
• Git, GitHub, GitLab
• Jenkins
• Regulatory compliance knowledge: Basel, MiFID, GDPR
• Big Data
• Cloud security and access controls (IAM, RBAC)
• Familiarity with Docker, Kubernetes, Apache

We Offer

• Competitive salary
• Opportunity to work in a dynamic and innovative environment
• Professional growth and development opportunities

About the Company

DXC Luxoft is a leading global provider of technology, consulting, and outsourcing services. We are committed to delivering excellence and innovation to our clients.

---

Apply for Senior Databricks Engineer with Python in Pune

*Indicates a required field

Related Jobs

• Data Modeller
• Data Engineer (ETL)
• Data Engineer (ETL)

All jobs