Senior Data Engineer (Investment Data)

About the Position

We’re seeking a Senior Data Engineer with 5+ years experience in data engineering to join our team in Remote India, focusing on building and optimizing data pipelines.

Responsibilities

• Participate in requirements clarification and sprint planning sessions.
• Design technical solutions and implement them, including ETL Pipelines.
• Build robust data pipelines in PySpark to extract, transform.
• Optimize ETL Processes – Enhance and tune existing ETL processes for better performance, scalability, and reliability.
• Writing unit and integration tests.
• Support QA teammates in the acceptance process.
• Resolving PROD incidents as a 3rd line engineer.

Requirements

• Bachelor’s degree (Computer Science, Engineering, Information Systems, or related discipline).
• 5+ years experience in data engineering roles (flexible based on depth of capability).
• Strong hands-on experience with Databricks in production environments (prerequisite).
• Strong programming experience with PySpark (must) and strong SQL (must).
• Proven experience with Declarative Pipelines / pipeline orchestration on Databricks (prerequisite).
• Strong understanding of data engineering fundamentals: ingestion patterns, transformation design, incremental processing, testing, performance tuning.
• Experience delivering production-ready datasets with appropriate operational controls (monitoring, troubleshooting, reliability patterns).
• Experience with modern Lakehouse concepts (Delta tables, optimization strategies, file skipping, metadata/statistics awareness).
• Exposure to data governance practices: cataloguing, documentation, business glossary/terms, lineage.
• Experience working in enterprise environments with CI/CD pipelines and structured release processes.
• Familiarity with vendor market data feeds (e.g., Bloomberg, Refinitiv, MSCI, FactSet) or similar multi-source mastering patterns.

Nice to Have

• Strong Hands-on Expertise in Palantir Foundry. Proven experience with Foundry pipelines, ontologies, data lineage, transformations, and platform governance.
• Proven Migration Experience from Palantir / to Databricks. Demonstrated experience leading or executing platform migrations, including pipeline conversion, data model redesign, and production cutover.
• Familiarity with Dynatrace or Datadog for system observability and monitoring.
• Databricks certification, cloud certifications (Azure/AWS), or enterprise data architecture certifications.

We Offer

• Remote work from India.
• Competitive salary and benefits.
• Professional growth opportunities.

About the Company

DXC Luxoft is a leading global provider of technology, consulting, and outsourcing services. We are committed to delivering innovative solutions and exceptional service to our clients.

---

Apply for Senior Data Engineer (Investment Data) in Remote India