Überwachung und Optimierung moderner KI-Agentensysteme im Produktivbetrieb (m/w/d)
Primary stack
Job description
About the Position
Überwachung und Optimierung moderner KI-Agentensysteme im Produktivbetrieb (m/w/d)
Masterand
Development & Consulting
St. Georgen im Schwarzwald
Hannover
What You Will Do
Modern tracing tools like MLFlow offer a variety of metrics to represent the data flows and processing steps within an AI agent system based on transformers. Depending on the complexity of the system, additional metrics are generated to complement the overall system behavior.
Here's where your thesis comes in: You will support us in developing best-practice approaches to improve system behavior based on effective evaluations and system optimizations using user feedback. You will analyze state-of-the-art tracing tools and methods, derive well-founded recommendations, and substantiate them with best-practice examples. To evaluate traces, you will use metrics that are automatically generated (e.g., heuristic metrics or LLM-as-a-Judge) and optionally supplemented by user feedback. A central aspect is the systematic linking of these different data sources and evaluation methods.
Your Tools for Everyday Life at M&M
- You are a registered student (m/w/d) in the field of General Computer Science, Technical Computer Science, Software Engineering, Business Informatics (or comparable)
- Curiosity, initiative, and enthusiasm for practical work
More Than Just a Job
- Individual Support: A dedicated supervisor will support you in your project and be available for any questions
- Networking: You can expand your professional network and establish valuable contacts within the company. This master's thesis will be supervised by our experts from the Data & AI Competence Center.
- Regular Feedback Meetings: We will regularly exchange feedback to review your progress and promote your development
- Hybrid Work: In coordination with your supervisor, you can choose a combination of remote work and office presence for more flexibility and freedom
- Generous Flextime Policy: In coordination with your supervisor, you can set your working hours according to your preferences to meet your personal needs
Your Contact Person
Fiona Laube, Specialist Recruiting & HR Marketing
[email protected]
Tel.: +49 7724 9415-36
Apply now
Related Jobs
From Data Exchange to Knowledge Exchange: Industrial AI as an Enabler for Learning Data Rooms along the Supply Chain (m/w/d)
St. Georgen im Schwarzwald
Hannover
Masterand
Development & Consulting
Don't Read, Navigate - Interactive Chat Frontends for AI Agents
St. Georgen im Schwarzwald
Hannover, 100% Remote
Internship
Development & Consulting
© M&M Software. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.