Backend Engineer – LLM Integration
Primary stack
Nice to have's
Job description
About the Position
We are seeking a skilled Backend Engineer for LLM Integration to join our team in Germany, focusing on AI/ML and automotive industry projects.
Responsibilities
- Build and maintain FastAPI microservices that orchestrate LLM calls, tool use, and agentic workflows using LangChain / LangGraph.
- Implement Kafka producers and consumers for real-time voice session data, telemetry, and event-driven AI triggers.
- Integrate with Azure OpenAI endpoints via LiteLLM abstraction; manage prompt versioning and A/B routing.
- Write unit, integration, and contract tests (pytest, Pact); maintain coverage and quality gates in Azure DevOps.
- Containerise services with Docker; deploy and operate on AKS; contribute to Helm chart and Terraform configuration.
- Participate in code reviews with Audi engineers and contribute to joint architectural decisions.
- Monitor service health using Azure Monitor / Application Insights; triage and resolve production incidents.
- Document APIs (OpenAPI) and maintain ADR entries for significant implementation decisions.
Requirements
- 3+ years professional Python development, including production web services.
- Experience with FastAPI (or Flask/Django) for REST API design.
- Familiarity with at least one LLM orchestration framework: LangChain, LangGraph, or LiteLLM.
- Apache Kafka - producer/consumer implementation; at-least-once vs exactly-once semantics.
- Docker and Kubernetes basics (deployment manifests, service configuration).
- English B2 or above.
Nice to Have
- Azure services: AKS, Azure OpenAI, Managed Identity, CosmosDB.
- Terraform or Bicep for infrastructure-as-code.
- Automotive domain or OEM project experience.
- Async Python patterns (asyncio, aiohttp).
- German language skills.
We Offer
- Competitive salary
- Opportunity to work in a cutting-edge AI/ML project
- Collaborative environment with Audi engineers
- Remote work options
About the Company
DXC Luxoft serves as the end-to-end delivery partner, collaborating closely with the client’s engineers within a joint product team on the Azure platform (AKS, Azure OpenAI, Managed Identity, Azure Monitor, Azure DevOps).
© Luxoft. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
A provider of software development services and innovative IT solutions with a worldwide customer base consisting mainly of large multinational corporations.