Senior Data Engineer (Investment Data)

About the Position

We’re looking for an experienced, hands-on Data Engineer who is capable of designing, building, and operating data pipelines and models that power analytics and applications across investment teams and Middle/Back office. The ideal candidate has financial markets familiarity (securities, prices, corporate actions, positions/holdings) and thrives in ambiguous environments-proactively shaping solutions, not waiting for tickets. You’ll own data end-to-end: from ingesting vendor and internal sources, to modeling in our lakehouse, to making data discoverable, reliable, and cost-efficient. You’ll partner closely with BAs/PMs and quants, anticipate downstream needs, and propose pragmatic architectures that balance speed, governance, and scalability.

Responsibilities

• Participate in requirements clarification and sprint planning sessions.
• Design technical solutions and implement them, including ETL Pipelines – Build robust data pipelines in PySpark to extract, transform.
• Optimize ETL Processes – Enhance and tune existing ETL processes for better performance, scalability, and reliability.
• Writing unit and integration tests.
• Support QA teammates in the acceptance process.
• Resolving PROD incidents as a 3rd line engineer.

Requirements

• Bachelor’s degree (Computer Science, Engineering, Information Systems, or related discipline).
• 5+ years experience in data engineering roles (flexible based on depth of capability).
• Strong hands-on experience with Databricks in production environments (prerequisite).
• Strong programming experience with PySpark (must) and strong SQL (must).
• Proven experience with Declarative Pipelines / pipeline orchestration on Databricks (prerequisite).
• Strong understanding of data engineering fundamentals: ingestion patterns, transformation design, incremental processing, testing, performance tuning.
• Experience delivering production-ready datasets with appropriate operational controls (monitoring, troubleshooting, reliability patterns).
• Experience with modern Lakehouse concepts (Delta tables, optimization strategies, file skipping, metadata/statistics awareness).
• Exposure to data governance practices: cataloguing, documentation, business glossary/terms, lineage.
• Experience working in enterprise environments with CI/CD pipelines and structured release processes.
• Familiarity with vendor market data feeds (e.g., Bloomberg, Refinitiv, MSCI, FactSet) or similar multi-source mastering patterns.

Nice to Have

• Strong Hands-on Expertise in Palantir Foundry. Proven experience with Foundry pipelines, ontologies, data lineage, transformations, and platform governance.
• Proven Migration Experience from Palantir / to Databricks. Demonstrated experience leading or executing platform migrations, including pipeline conversion, data model redesign, and production cutover.
• Familiarity with Dynatrace or Datadog for system observability and monitoring.
• Databricks certification, cloud certifications (Azure/AWS), or enterprise data architecture certifications.

We Offer

• Relocation options
• Experience in an international environment
• Cross-cultural experience
• Feedback culture
• Regular appraisals
• Annual holiday - 20 or 26 days. The duration of the leave depends on the overall seniority
• Occasional leave - 1 or 2 days/ depending on the circumstances
• Child care leave - 2 days or 16 hours per year
• Absence due to force majeure - 2 days or 16 hours per year
• Maternity Leave - 20 weeks
• Parental Leave - 41 weeks
• Paternity Leave - 14 days
• Expert-led tech courses covering basic to advanced topics
• Internal instructor-led soft skills courses
• Comprehensive in-house self-learning resources for both soft and hard skills
• Access to external self-learning libraries like ProQuest eBook and Udemy for Business
• Cloud Programs: MS Cloud Academy, AWS Partner Academy, Google Cloud Academy
• Custom Learning Programs: upskilling, reskilling, technical mentorship
• Leadership Programs for Managers
• Multisport card
• Possibility to order Multisport card at the corporate rate for family members
• LuxGood Program: wellbeing seminars, contests, relaxation sessions, yoga sessions, etc.
• One Team Program: Buddy for each New Joiner; seminars, meeting and workplace space to support integration with local community and culture; “Hire me” workshops for partners
• Preferential banking offer
• Preferential car leasing offer
• Cafeteria program discounts for shops, cinema tickets, holiday offers
• Luxoft Social Benefit Fund: sport and recreation benefits, the possibility to receive financial support
• Private Healthcare Insurance with unlimited access to specialists
• Full dental support
• Travel Insurance
• Possibility to add private healthcare coverage for family members at the corporate rate
• Life insurance at the corporate rate for employees and family members, including payment of the basic package for the employee by the employer
• Reimbursement for corrective glasses
• Many fun social activities organized by the Luxoft team offline in your city
• Online entertainment events for whole company and local team events
• A workplace where you’re treated with respect within a multicultural team
• Rotation between projects and accounts
• New career opportunities

About the Company

Luxoft is a global provider of digital transformation and technology services, empowering businesses to innovate and thrive in the digital age. With a strong focus on delivering cutting-edge solutions, Luxoft partners with clients to drive digital innovation, enhance operational efficiency, and achieve strategic business objectives. Our team of experts leverages the latest technologies and industry best practices to create tailored solutions that meet the unique needs of each client, ensuring success in today's fast-paced, technology-driven world.