Senior AI Engineer, Agents (Python) (f/m/d)
Primary stack
Job description
About the Position
Senior AI Engineer, Agents (Python) (f/m/d)
Location
Munich, Bavaria, Germany
Employment Type
Full time
Department
Product & Engineering
About the Company
Bliro is the AI assistant for field sales, trusted by leading companies like igus, Lanxess, and Brillux. We have raised over €3M and are backed by 468 Capital, Lea Partners, Rockstart, and more. See Bliro in action: Bliro.
Why We're Hiring This Role
Our chat agent and voice-to-voice phone agent process and document thousands of customer interactions a week for field sales teams. Every answer has to be right, fast, and useful on the road. We need a senior AI engineer who owns agent quality: what the agents say, how well they say it, and how we prove they got better. This role is about orchestrating and evaluating models, not training them.
Responsibilities
- 30 Days: Map Bliro's chat and voice agents end to end. Partner with backend engineers, review real user conversations, identify the biggest failure modes, and ship an initial improvement.
- 60 Days: Own agent quality measurement. Build eval sets and metrics for our key use cases, benchmark models on quality, latency, and cost, and ship a change with a measurable improvement against the baseline.
- 90 Days: Establish a repeatable model for improving agent quality. Run evals on every prompt, model, and harness change, turn real conversations into new test cases automatically, and set the longer-term roadmap for agent quality.
Requirements
- Evidence of ownership and shipping LLM agents to real users and proving with data that they got better.
- Strong Python skills and the ability to debug agent behavior across prompts, tools, context, and model choice.
- Hands-on experience building eval pipelines, LLM judges, and model benchmarks, with enough statistics to tell a real gain from noise.
- Ground your decisions in real user data, using AI to help analyze them, and turn what you find into test cases, fixes, and clear priorities.
- Deep curiosity and the ability to gather context quickly, form a clear point of view, and keep pace as models and the product evolve.
- A low ego teammate who communicates clearly and owns outcomes. Familiarity with AI coding tools is expected; experience with the latest agent frameworks, real-time voice agents, and multilingual agents is a plus.
We Offer
- Real stake: Strong base salary plus meaningful equity ownership.
- Time off: 30 days of PTO, so take what you need.
- Hybrid setup: Work from our office in the heart of Munich, right next to the Frauenkirche, or from home. We value outcomes, not attendance.
- More: Free meals and drinks, Deutschlandticket, best-in-class equipment, and Wellpass.
How We Work
- Ambition: We get better every day by being curious and bold.
- Continuous improvement: Move fast and break things, but never the same thing twice.
- It's our problem: We operate as one team. We share credit, own mistakes together, and support each other when things get hard.
- Why not today? We value urgency and momentum. The fastest path to customer value usually wins.
- Build something worthy of love: Craft matters. We aim to build products customers genuinely love.
Why Bliro
- Generational impact: Build the human interface for millions of field sellers.
- Ownership culture: Many of us are former founders.
- Forward thinkers: We are the world leader in privacy-preserving transcription; we know how boundaries can be overcome.
© Bliro. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
More at Bliro
All 6 rolesAccount Executive (m/f/d)
Bliro · Munich
Dein Einstieg in Tech Sales - SDR bei Bliro (m/w/d)
Bliro · Munich
Founder's Associate Intern - AI GTM (m/w/d)
Bliro · Munich
Tech Sales Praktikum - SDR bei Bliro (m/w/d)
Bliro · Munich