Senior AI Data Engineer

About the Position

We are seeking a Senior AI Data Engineer to join our team in Bengaluru, India. The ideal candidate will have a strong background in Pyspark and experience in building Agentic AI pipelines for code conversion from Q KDB to Pyspark.

Responsibilities

• Design, develop, and maintain full-stack Python applications with modern frontend frameworks
• Build and optimize RAG (Retrieval-Augmented Generation) systems for AI applications
• Create and implement efficient vector databases and knowledge stores
• Develop APIs that connect frontend interfaces with backend AI services
• Implement and maintain CI/CD pipelines for AI applications
• Monitor application performance and troubleshoot issues in production
• Design and maintain data pipelines, ETL/ELT workflows, and data infrastructure to support AI and analytics workloads

Requirements

• Minimum of 5 years of experience in AI/ML solution implementation
• Minimum of 3 years of experience in Pyspark processing high volume data
• AI & ML Skills:
  • Multi-Agent System Design & Orchestration
  • Full-stack AI Integration (Frontend to Backend)
  • Advanced Prompt Engineering
  • LLM Observability, Evaluation & Monitoring (LLMOps)
• Data Engineering Skills:
  • Proficient in Pyspark coding and concepts (e.g., Lazy evaluation, window functions, spark architecture and performance finetuning such as data skew reduction (salting etc), joins (broadcast, merge sort joins etc))
  • SQL proficiency and query optimization
• Main Technologies:
  • Pyspark
  • GitHub Copilot

Nice to Have

• Proficiency in additional programming languages

We Offer

• Competitive salary
• Opportunity to work on cutting-edge AI projects
• Professional growth and development opportunities

About the Company

DXC Luxoft is a leading global provider of technology, consulting, and outsourcing services. We are committed to innovation and excellence in the AI/ML domain.

---

Apply for Senior AI Data Engineer in Bengaluru

Apply Now