Intellias logo

Platform Engineer – Agent Promotion & Rollback

Intellias·Salary not specified

Primary stack

PythonAWS

Nice to have's

AWS AgentCore Evaluation API hands-on usageAgent regression testing and version comparisonBlue/green or canary deployment patterns for LLM agentsAgent health monitoring post-deployment

Job description

About the Position

We are looking for a Platform Engineer to build and automate agent deployment, promotion, and rollback capabilities for an enterprise AI Agent Platform being developed from the ground up.

The role will focus on creating reliable multi-environment release workflows for AI agents, introducing automated quality gates, version management, regression validation, and safe rollback mechanisms to ensure agents can progress from development to production in a controlled and predictable way.

Responsibilities

  • Design and implement agent promotion workflows across development, QA, and production environments.
  • Build automated quality gates that validate agents before promotion to higher environments.
  • Implement rollback mechanisms to safely restore previous production agent versions.
  • Automate post-deployment validation including health checks and smoke tests.
  • Manage AWS AgentCore Runtime versions and endpoints to support environment-specific deployments.
  • Build Python automation for agent deployment, promotion, versioning, and rollback operations.
  • Integrate agent evaluation results into deployment pipelines to prevent releases that fail quality, safety, or workflow accuracy checks.
  • Implement agent version comparison and regression testing using consistent evaluation suites.
  • Support safe deployment strategies such as blue/green and canary patterns for AI agents.
  • Monitor agent health following deployments and support automated detection of release issues.
  • Collaborate with AI and platform engineering teams to establish reliable CI/CD and lifecycle management practices for agents.

Requirements

  • Skills:

    • Agent promotion workflow - environment progression (dev → qa → prod) with evaluation gate enforcement
    • Agent rollback mechanism - revert production agent to previous version with validation (health check, smoke test)
    • AWS AgentCore Runtime endpoint management - DEFAULT alias for latest, named endpoints for environment pinning
    • Agent evaluation gates - block promotion to qa/prod if agent fails quality checks (PII safety, workflow accuracy)
    • Agent version comparison - run same evaluation suite against two agent versions to detect regression
    • Python automation for agent lifecycle operations
  • Experience:

    • 4+ years platform or backend engineering with AI/ML systems
    • Multi-environment deployment and promotion workflows
    • Rollback automation and safety validation
    • Quality gate enforcement in deployment pipelines

Nice to Have

  • AWS AgentCore Evaluation API hands-on usage
  • Agent regression testing and version comparison
  • Blue/green or canary deployment patterns for LLM agents
  • Agent health monitoring post-deployment

We Offer

At Intellias, where technology takes center stage, people always come before processes. By creating a comfortable atmosphere in our team, we empower individuals to unlock their true potential and achieve extraordinary results. That’s why we offer a range of benefits that support your well-being and charge your professional growth.

We are committed to fostering equity, diversity, and inclusion as an equal opportunity employer. All applicants will be considered for employment without discrimination based on race, color, religion, age, gender, nationality, disability, sexual orientation, gender identity or expression, veteran status, or any other characteristic protected by applicable law.

We welcome and celebrate the uniqueness of every individual. Join Intellias for a career where your perspectives and contributions are vital to our shared success.

About the Company

Our client is a large global enterprise operating across multiple markets, with a complex technology landscape and a strong focus on digital transformation and innovation. The organization is actively investing in modern cloud, data, and AI capabilities to enable scalable, secure, and highly automated solutions across its business.

© Intellias. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

The company develops projects in IoT, Artificial Intelligence, Data Science, UX/UI, Big Data, Cloud, DevOps, and other technologies.

More at Intellias

All 126 roles

Popular searches