ML Systems Engineer – Framework Integration
Primary stack
Nice to have's
Job description
About the Position
ML Systems Engineer – Framework Integration
Köln, Germany
Hybrid
Full-time
Permanent employee
About the Company
At RooflineAI, we enable the edge-AI products you dream of. Our mission is simple: To bring the power of chips into the hands of innovators, and to make it radically easier to use cutting-edge AI models on the best hardware.
About the Role
Roofline is building a Deployment Platform to run any model on disruptive hardware at the edge. As a Systems Engineer, you’ll own the path from a model in a framework to fast code on the target, across every layer in between. You’ll find where things break, fix them at the root, and set the technical direction that keeps our engineering teams aligned.
Why Join Us?
- The opportunity to grow: Be at the forefront of building and shaping an industry-defining venture. There are plenty of opportunities to learn and evolve.
- The team succeeded: We are building the leading AI compiler team in Europe. Join our future-focused team to contribute to meaningful, disruptive innovations with us.
- The flexibility you need: Whether you need to take extra time off, adjust your schedule, or have other ideas to maximize your productivity, we’ve got your back.
- The compensation that rewards: We are looking for world-class talent and pay accordingly. We offer equity for every employee since we truly want you to participate in our success.
- The culture you desire: We actively make space to build our culture. We organize dedicated regular events and retreats for the whole team.
Responsibilities
- Own the path from a model in a ML framework down to running fast on a target hardware. Work at all levels of the software stack with a wide understanding of everything from quantization to compiler abstractions to final target code generation.
- Bring up reference models using Roofline's SDK, pinpoint which component an issue really lives in, and make sure it’s fixed at the root.
- Set technical direction across multiple teams for ML, compiler, runtime, and architecture based on your first-hand data. Define contracts and interfaces between the layers and keep the teams aligned to them.
- Turn your findings into products. Reflect on recurring blockers to craft solutions that benefit our customers and help improve our SDK. Think ahead to make sure that we always support the latest models and applications.
- Interacting with open-source community in the ML space (e.g. PyTorch).
- Raise the level of the engineers around you. Mentor junior engineers and help to maintain the best technical culture for the company.
Requirements
- 8+ years of hands-on experience in AI and embedded systems.
- Degree in Computer Science, Electrical Engineering, or related fields.
- Deep practical expertise in C/C++ and Python.
- End-to-end experience with an accelerator toolchain for NPUs, DSPs, or GPUs spanning their compiler, runtime, kernel libraries, and memory models. Strong communication and collaboration skills to align other engineers through clear ideas, abstractions, and design docs.
- Demonstrated technical influence beyond your own deliverables. Have product changes you argued for and got shipped, engineers you've mentored, or practices a team adopted because you established them.
- Ambition and curiosity to solve complex problems, a strong mindset to take ownership and drive our solutions forwards, and a collaborative attitude to foster our culture.
Nice to Have
- Experience working with hardware or architecture teams, and an understanding of how their approaches to problems and processes differ from software teams’.
- Experience working with PyTorch, ONNX, TensorFlow.
- Experience shipping an accelerated model into production under real constraints for applications such as automotive, medical, industrial, or consumer where memory budgets, certification, and time budgets apply.
We Offer
- Competitive salary
- Equity for every employee
- Professional development budget
- Flexible work arrangements
Ready to be part of our journey? Apply now including your CV, a brief cover letter, and supporting documents (e.g., degree certificate, references)!
© Roofline. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.