Senior Machine Learning Engineer

About the Position

We are seeking a Senior Machine Learning Engineer with 5+ years of experience to join our team in Kraków, Poland. This role focuses on performance optimization and system integration for LLM-based systems.

Responsibilities

• Build and maintain end-to-end integration flows across the AI inference pipeline (serving, orchestration, APIs, and infrastructure);
• Design, implement, and optimize LLM inference workflows, including prefill and decode stages;
• Improve system performance with a focus on throughput, latency, and interactivity;
• Write production-grade components in Python and integrate them into the broader system;
• Contribute to system-level logic such as smart hardware selection and execution strategies;
• Integrate models (open source and custom), services, and APIs into cohesive, reliable end-to-end application pipelines.

Requirements

• 5+ years of experience in software engineering or machine learning engineering;
• Strong proficiency in Python;
• Strong experience with LLM inference systems and performance optimization;
• Hands-on experience with system integration and end-to-end workflows;
• Experience with inference frameworks such as vLLM, TensorRT, SGLang, etc;
• Experience working with GPU/accelerator-based systems.

Nice to Have

• Hands-on experience with Dynamo and LLM-D for LLM inference and serving;
• Familiarity with Kubernetes and cloud environments.

We Offer

• Competitive salary up to 6000$ GROSS;
• Opportunity to work in Kraków, Poland (office/hybrid).

About the Company

Join our team and contribute to the development of cutting-edge LLM-based systems.