Senior AI Data Engineer

About the Position

We are seeking a Senior AI Data Engineer with 5+ years experience in AI/ML solution implementation to join our team in Chennai, India. Ideal candidate is someone with strong Pyspark background coupled with proven experience building Agentic AI pipelines for code conversion from Q KDB to Pyspark.

Responsibilities

• Design, develop, and maintain full-stack Python applications with modern frontend frameworks
• Build and optimize RAG (Retrieval-Augmented Generation) systems for AI applications
• Create and implement efficient vector databases and knowledge stores
• Develop APIs that connect frontend interfaces with backend AI services
• Implement and maintain CI/CD pipelines for AI applications
• Monitor application performance and troubleshoot issues in production
• Design and maintain data pipelines, ETL/ELT workflows, and data infrastructure to support AI and analytics workloads

Requirements

• Must have
  • Minimum of 5 years of experience in AI/ML solution implementation
  • Minimum of 3 years of experience in Pyspark processing high volume data
• AI & ML Skills
  • Multi-Agent System Design & Orchestration
  • Full-stack AI Integration (Frontend to Backend)
  • Advanced Prompt Engineering
  • LLM Observability, Evaluation & Monitoring (LLMOps)
• Data Engineering Skills
  • Proficient in Pyspark coding and concepts (e.g., Lazy evaluation, window functions, spark architecture and performance finetuning)
  • SQL proficiency and query optimization
• Main Technologies
  • Pyspark
  • Git hub Copilot

Nice to Have

• Proficiency in additional programming languages

We Offer

• Competitive salary
• Opportunity to work on cutting-edge AI projects
• Professional growth and development opportunities

About the Company

[Company description if present]