DevOps/MLOps Specialist

About the Position

DevOps/MLOps Specialist

bengaluru, India

Bosch Global Software Technologies Private Limited is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global suppliers of technology and services, offering end-to-end Engineering, IT, and Business Solutions. With over 27,000+ associates, it’s the largest software development center of Bosch, outside Germany, indicating that it is the Technology Powerhouse of Bosch in India with a global footprint and presence in the US, Europe, and the Asia Pacific region.

Responsibilities

• Lead the design and implementation of end-to-end MLOps and LLMOps pipelines, from model development and training to deployment and continuous monitoring in production environments.
• Develop automation for model deployment and management, ensuring scalability, efficiency, and cost-effectiveness, particularly for large language models (LLMs) in cloud environments.
• Implement and manage CI/CD pipelines for both ML and LLM models, integrating them seamlessly into the production environment.
• Collaborate with data scientists, ML engineers, and software developers to ensure the integration of LLMs and ML models into scalable, production-ready systems.
• Build data pipelines and workflows for training and serving models, ensuring efficient data processing and pipeline orchestration using tools like Kubeflow, Airflow, or MLflow.
• Create robust monitoring systems for tracking model performance, diagnosing issues, and ensuring the reliability and health of both traditional ML and LLM-based systems.
• Optimize the performance of deployed models, focusing on cost optimization, speed, and accuracy, including hardware acceleration (GPUs, TPUs).
• Maintain version control, governance, and model lifecycle management for both ML and LLM models using industry-standard tools.
• Stay up-to-date with the latest advancements in MLOps, LLMOps, and Generative AI, implementing best practices and innovative approaches to improve the deployment lifecycle.

Requirements

• Education: Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field.
• Experience: 5+ years of experience in MLOps with at least 2 years working specifically with LLMOps pipelines for large language models.
• Skills:
  • MLOps & LLMOps Expertise: Solid understanding of MLOps best practices and LLMOps workflows for large language models, ensuring seamless integration of AI systems into production environments.
  • Cloud Infrastructure & Deployment: Extensive experience with cloud platforms (AWS, GCP, Azure) for deploying and scaling ML/LLM solutions. Expertise in containerization (Docker, Kubernetes) for model deployment and orchestration.
  • CI/CD Pipelines & Automation: Proficiency in developing and managing CI/CD pipelines for machine learning models using tools like Jenkins, GitLab CI, or CircleCI, and automation tools like Terraform or Ansible.
  • Model Serving & Monitoring: Hands-on experience deploying models using frameworks such as TensorFlow Serving, TorchServe, Kubeflow, or MLflow. Strong understanding of model monitoring and alerting (e.g., Prometheus, Grafana).
  • Machine Learning Frameworks: Strong knowledge of popular machine learning frameworks like TensorFlow, PyTorch, Hugging Face, and others, with a particular focus on deploying and fine-tuning large language models (e.g., GPT, BERT).
  • Data Engineering & Pipelines: Expertise in building and managing robust data pipelines using tools like Apache Kafka, Apache Airflow, or Apache Beam to support ML and LLM workflows.
  • Performance Optimization: Ability to optimize the performance of AI models, including working with distributed systems, model compression, and hardware acceleration (GPUs, TPUs).
  • Security & Governance: Deep understanding of security and governance best practices for AI systems, including model versioning, compliance with privacy regulations (GDPR), and ethical AI frameworks.
  • Programming & Scripting: Strong programming skills in Python.

We Offer

• Competitive salary
• Opportunity to work with cutting-edge technologies
• Professional development opportunities
• Collaborative and innovative work environment

About the Company

Bosch Global Software Technologies Private Limited is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global suppliers of technology and services, offering end-to-end Engineering, IT, and Business Solutions. With over 27,000+ associates, it’s the largest software development center of Bosch, outside Germany, indicating that it is the Technology Powerhouse of Bosch in India with a global footprint and presence in the US, Europe, and the Asia Pacific region.