ITDS logo

Senior AI Infrastructure Engineer – LLM & Retrieval Systems

ITDS·40,000 – 60,000 PLN

Primary stack

DockerReactKafkaRESTPython.NETTypeScriptMicroservicesC#Angular

Job description

About the Position

Senior AI Infrastructure Engineer – LLM & Retrieval Systems

Join our innovative team as an AI Platform Engineer and be at the forefront of developing scalable, high-impact AI infrastructure solutions. In this pivotal role, you will focus on crafting production AI services, from Retrieval-Augmented Generation (RAG) systems to agentic workflows, empowering research and engineering teams across the firm. Your expertise will shape how AI capabilities are delivered and maintained, ensuring seamless, reliable, and efficient AI operations.

Responsibilities

  • Develop and maintain internal AI services and APIs, including RAG pipelines, document ingestion, embeddings, retrieval, and relevance optimization
  • Manage vector database performance, scalability, and data freshness to ensure optimal retrieval quality
  • Design and document user-friendly APIs supporting agentic workflows
  • Integrate model serving endpoints into application services, monitoring latency, reliability, and retrieval accuracy
  • Build resilient systems with fallback mechanisms, version control, and testing frameworks
  • Implement comprehensive monitoring, logging, and tracing across AI services
  • Oversee service lifecycle management, from deployment to deprecation, and participate in operational incident response

Requirements

  • 4+ years of experience in software or platform engineering, with exposure to AI/ML or LLM-based applications
  • Strong Kubernetes expertise, particularly in GPU contexts and containerized environments
  • Proficiency with cloud infrastructure, especially AWS, networking fundamentals, and IAM
  • Hands-on experience operating production RAG systems and retrieval infrastructure
  • Solid Python skills for building production-grade APIs and services
  • Deep understanding of LLM fundamentals, including prompting, token management, and output reliability
  • Excellent communication skills and ability to collaborate across technical and non-technical teams

Nice to Have

  • Experience with agentic AI systems and workflow orchestration
  • Familiarity with LLM evaluation frameworks and quality measurement tools
  • Exposure to model serving platforms and inference optimization techniques
  • Knowledge of embedding models, retrieval performance trade-offs, and data engineering pipelines
  • Relevant AWS or Kubernetes certifications

We Offer

  • Competitive salary range: 40,000 - 60,000 PLN brutto (Employment Contract)
  • On-site position in Wroclaw, Poland
  • Opportunity to work with cutting-edge AI technologies and infrastructure

About the Company

Ready to make a significant impact in the AI space? Apply now and become a driving force behind cutting-edge AI platform innovation!

© ITDS. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

ITDS logo
ITDS

Finance & Banking,Insurance,Retail, e-Commerce & FMCG,Healthcare & Medical,Telecommunications

About the Company ITDS is a consultancy specializing in IT services for financial service providers. Established in 1998, the company has served renowned Dutch and Polish insurers, banks, and pension funds. ITDS combines accumulated experience with a focus on delivering high-quality IT solutions. Products, Services & Tech Stack Core Solutions Outsourcing of IT Specialists (Time & Material) Providing IT Specialists in the Time & Material Model Building IT Teams in the Managed Services Model Project Delivery (Fixed-Price) IT Project Maintenance Recruitment as a Service Outsourcing of AI Specialists Building AI Agents Technologies & Frameworks Artificial Intelligence (AI) Software Development Software Integration Data Engineering Cloud / DevOps / Infrastructure Cybersecurity Project Scope & Target Clients Client Base Finance & Banking Insurance Retail, e-Commerce & FMCG Healthcare & Medical Telecommunications Manufacturing, Construction & Logistics Technology & Software Automotive & Leasing Pharmaceuticals & Life Sciences Entertainment & Media Public Sector Energy Climate & Sustainability Legal Engineering Scale 10+ Years of experience 60+ Clients 50,000+ Candidates in database 600+ IT Specialists on projects

More at ITDS

All 77 roles

Popular searches