EPAM logo

Lead Observability Engineer (New Relic)

EPAM·Salary not specified

Primary stack

New RelicOpenTelemetryCloudWatchTerraform

Nice to have's

Kinesis Firehosecost / token attribution modeling for GenAI workloadsCrossplane-based provisioning of observability resources

Job description

About the Position

We are seeking a Lead Observability Engineer (New Relic) to build an Enterprise Agent Development Platform - a production-grade, cloud-native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale. The platform standardizes agent development across the organization using LangGraph and Strands Agents on AWS AgentCore Runtime. This initiative spans agent framework design, runtime architecture, marketplace integration, CI/CD automation, and enterprise-grade observability - reducing agent development from months to days while enforcing consistent security, quality, and governance standards.

Responsibilities

  • Own the multi-tenant New Relic consolidation layer aggregating telemetry across the agent estate
  • Administer New Relic at scale, including management account setup and cross-account configuration
  • Build and maintain cross-account NRQL queries that aggregate telemetry from multiple project tenants
  • Develop dashboards-as-code and alert-policy-as-code using the Terraform New Relic provider and Crossplane
  • Configure New Relic alert policies routed to Opsgenie, with future migration to ServiceNow
  • Consume OpenTelemetry / ADOT data through OTLP and Firehose ingestion into New Relic
  • Design metric dimensions for large agent estates, ensuring stable, low-cardinality facets
  • Maintain segregation across Technical, Business, and Audit observability models

Requirements

  • 6+ years of experience in observability or SRE engineering
  • Hands-on experience consolidating observability/telemetry for AI agent estates in a production agentic AI project, such as multi-tenant New Relic (or equivalent) aggregation of agent telemetry, cost/token attribution for GenAI workloads, or AgentCore GenAI Observability integration
  • Expertise in New Relic (or equivalent SaaS observability platforms) operated as a multi-tenant consolidation layer
  • Skills in cross-account / cross-tenant telemetry aggregation and reporting
  • Familiarity with working within a Technical / Business / Audit observability segregation model
  • Proficiency in NRQL, dashboards-as-code, and alert-policy-as-code practices
  • Knowledge of OpenTelemetry / ADOT consumption fundamentals

Nice to Have

  • Familiarity with AWS Bedrock AgentCore observability (Transaction Search, GenAI Observability)
  • Background in Kinesis Firehose metric / log forwarding pipelines (CloudWatch → New Relic)
  • Knowledge of cost / token attribution modeling for GenAI workloads
  • Skills in Crossplane-based provisioning of observability resources

We Offer

  • Stable pay
  • Participation in the Employee Stock Purchase Plan with a 15% discount
  • Benefits package (health insurance, multisport, shopping vouchers)
  • Referral bonuses up to $2,000
  • Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee, and more
  • Corporate, social, and well-being events

Note: Benefits listed above are available to employees only. We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually. We will reach out to selected candidates exclusively.

About the Company

We gather like-minded people: Top tech minds driving innovation in AI, cloud, and digital platform modernization. Supportive team and agile, startup-like culture. Hybrid by design mode and opportunity to work remotely within Poland. Chance to work abroad for up to 60 days annually. Business-driven relocation opportunities. We provide growth opportunities: Career development programs, thought leadership, mentoring, soft skills, and well-being programs. Certification (Anthropic, Gemini, GCP, Azure, AWS). English classes.

© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.

More at EPAM

All 3139 roles

Popular searches