Senior Observability Engineer (New Relic Consolidation)

About the Position

We are seeking a Senior Observability Engineer to own the multi-tenant New Relic consolidation layer aggregating telemetry across our agent estate, as part of an Enterprise Agent Development Platform enabling engineering teams to define, orchestrate, deploy, and observe AI agents at scale across the organization.

Responsibilities

• Own and administer the multi-tenant New Relic consolidation layer across the agent estate
• Aggregate telemetry from multiple project tenants using cross-account NRQL queries
• Build and maintain dashboards-as-code and alert-policy-as-code using Terraform and Crossplane
• Configure New Relic alert policies routed to Opsgenie, with future migration to ServiceNow
• Manage OpenTelemetry / ADOT ingestion into New Relic via OTLP and Firehose pipelines
• Design metric dimensions and low-cardinality facets for large-scale agent estates
• Establish cross-account and cross-tenant telemetry aggregation and reporting processes
• Maintain segregation across Technical, Business, and Audit observability models
• Collaborate with engineering teams to standardize agent observability practices across the platform

Requirements

• 5+ years of experience in observability or SRE engineering
• Hands-on experience consolidating observability/telemetry for AI agent estates in a production agentic AI project, such as multi-tenant New Relic aggregation, cost/token attribution for GenAI workloads, or AgentCore GenAI Observability integration
• Expertise in New Relic administration at scale, including management account setup and cross-account configuration
• Proficiency in NRQL for cross-account queries aggregating telemetry from multiple project tenants
• Skills in dashboards-as-code and alert-policy-as-code using Terraform New Relic provider and Crossplane
• Knowledge of New Relic alert policies routed to Opsgenie, with familiarity with ServiceNow
• Understanding of OpenTelemetry / ADOT consumption fundamentals, including OTLP and Firehose ingestion into New Relic
• Competency in metric dimension design for large agent estates, ensuring stable, low-cardinality facets
• Background in operating New Relic or equivalent SaaS observability platforms as a multi-tenant consolidation layer
• Experience working within a Technical / Business / Audit observability segregation model

Nice to Have

• Familiarity with AWS Bedrock AgentCore observability, including Transaction Search and GenAI Observability
• Knowledge of Kinesis Firehose metric and log forwarding pipelines from CloudWatch to New Relic
• Skills in cost/token attribution modeling for GenAI workloads
• Understanding of Crossplane-based provisioning of observability resources

We Offer

With us you can:

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Relocation opportunities may be available for eligible candidates, depending on the role and openings at other EPAM locations
• Participate in volunteer, charity programs and communities (both technical and interest-based)

We focus on your professional growth:

• You can plan your individual career path together with your manager
• Receive regular feedback from colleagues
• Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
• Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
• Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
• Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
• Study at EPAM Solution Architecture School with the instructors who are practicing architects
• Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
• Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)

Vacation and sick leave (including a sick leave without a medical certificate)

• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children