Observability Engineer – Behavioral & Auditability Signals

About the Position

We are seeking an Observability Engineer to build behavioral monitoring and auditability capabilities for an enterprise AI Agent Platform being developed from the ground up. The role will focus on transforming agent telemetry, behavioral anomalies, safety signals, and governance events into actionable dashboards and alerts.

You will work at the intersection of observability, AI agent behavior, and governance, helping ensure that production agent activity can be effectively monitored, validated, and surfaced for both operational and audit purposes.

About the Client

Our client is a large global enterprise operating across multiple markets, with a complex technology landscape and a strong focus on digital transformation and innovation. The organization is actively investing in modern cloud, data, and AI capabilities to enable scalable, secure, and highly automated solutions across its business.

About the Project

The project is focused on building an enterprise-grade AI Agent Platform from the ground up. The platform will provide a standardized foundation for developing, deploying, orchestrating, securing, and observing AI agents across multiple teams and use cases.

The initiative covers the full agent lifecycle and brings together agent orchestration, observability, security, governance, integrations, evaluation, and platform engineering. Engineers joining the project will have an opportunity to influence key architectural and technical decisions and contribute to a new platform rather than maintaining an existing solution.

Responsibilities

• Design and implement behavioral monitoring dashboards and alerts using New Relic and NRQL.
• Define and monitor behavioral signals including anomalies, drift, safety events, and policy denials.
• Build auditability views that surface relevant governance and compliance evidence.
• Maintain clear segregation between technical observability and audit/security evidence across monitoring systems.
• Configure, tune, and validate alerts based on production agent telemetry.
• Verify dashboard accuracy and telemetry consistency to ensure monitoring data is reliable.
• Develop Python-based utilities for metrics emission, validation, and observability testing.
• Implement monitoring patterns for AI agent anomaly and behavioral drift detection.
• Validate that sensitive information, including PII, is appropriately handled in telemetry and traces.
• Incorporate security and governance signals, such as policy decisions and access denials, into behavioral monitoring.
• Collaborate with security and governance stakeholders to support enterprise compliance and audit requirements.

Requirements

• Skills:

  • New Relic and NRQL for behavioral dashboards and alert conditions
  • Behavioral monitoring signals (anomaly detection, drift, safety signals, policy denials)
  • Auditability views surfacing governance evidence for consumption
  • Observability domain segregation (Technical in CloudWatch/New Relic vs Audit in dedicated evidence/SIEM stores)
  • Alert validation and dashboard data-accuracy verification
  • Python (metrics emission and validation)

• Experience:

  • 4+ years of observability engineering
  • Behavioral / anomaly monitoring and alert tuning on production telemetry
  • Working in environments with formal audit/compliance evidence requirements

Nice to Have

• Anomaly/drift detection techniques for agent telemetry
• PII redaction validation in traces surfaced through dashboards
• Cedar policy decisions / Contract-Policy Engine denials as monitoring inputs
• Enterprise security/compliance standards mapping

We Offer

At Intellias, where technology takes center stage, people always come before processes. By creating a comfortable atmosphere in our team, we empower individuals to unlock their true potential and achieve extraordinary results. That’s why we offer a range of benefits that support your well-being and charge your professional growth.

We are committed to fostering equity, diversity, and inclusion as an equal opportunity employer. All applicants will be considered for employment without discrimination based on race, color, religion, age, gender, nationality, disability, sexual orientation, gender identity or expression, veteran status, or any other characteristic protected by applicable law.

We welcome and celebrate the uniqueness of every individual. Join Intellias for a career where your perspectives and contributions are vital to our shared success.

Locations

• Bulgaria
• Croatia
• Egypt
• Poland
• Portugal

Work Location Type

Remote

Apply

Apply for this job

Refer a friend for this job