EPAM logo

Senior Golang Software Engineer

EPAM·Salary not specified

Primary stack

TestNGKubernetesGoPostgreSQLRedisMicroservicesCI/CD

Nice to have's

LLMGenAIAPI gatewaysgRPCcloud SDKsAPI securitycost optimizationUX/product teams

Job description

About the Position

We are looking for a Senior Golang Software Engineer to join a team building a comprehensive platform designed to evaluate Large Language Model performance and provide inference endpoints for Generative AI applications at enterprise scale.

The platform enables stakeholders to systematically assess, compare, and select the most suitable LLMs for use cases, including natural language processing, customer service automation, content generation, and data analysis. It routes, secures, and governs LLM inference across multiple model providers.

In this role, you will design and build scalable, production-ready backend systems using Go in a microservices architecture. You will own critical backend services, integrate with external LLM providers, and ensure reliability, performance, and security at scale. The project is in its initial strategic phase - defining personas, mapping user journeys, designing UX, and establishing a development roadmap with epics and user stories to guide future investment.

This is a high-impact engineering role requiring independent execution, technical leadership, and cross-functional collaboration in ambiguous problem spaces.

Responsibilities

  • Design and implement production-grade backend features using Go in a microservices-style architecture
  • Build and maintain provider integration frameworks for external LLM vendors (OpenAI, Anthropic, cloud AI services)
  • Own backend service quality through robust unit and integration testing; continuously improve CI/CD quality gates
  • Improve data access reliability and performance across PostgreSQL and Redis
  • Collaborate cross-functionally on architecture, scalability, security, and operational excellence
  • Lead technical design discussions and deliver solutions independently end-to-end
  • Work with product teams on API requirements, troubleshoot issues, and identify new requirements
  • Contribute to platform roadmap through technical input on feasibility, trade-offs, and system design

Requirements

  • 7+ years of professional software engineering experience with strong backend ownership
  • Deep expertise in Go, including idiomatic design, interfaces, concurrency, context management, and error handling
  • Hands-on experience building HTTP APIs, middleware, and service-oriented architectures
  • Strong experience with PostgreSQL - schema design, query optimization, and database migration workflows
  • Practical experience with Redis - caching strategies, counters, and distributed rate-limiting patterns
  • Experience designing or working with authorization and policy systems (RBAC/ABAC concepts)
  • Strong testing discipline in Go (table-driven tests, mocks, integration tests, and test containers)
  • Experience operating production systems with observability tooling (OpenTelemetry metrics and tracing, dashboards, and alerting)
  • Solid experience with Kubernetes and Helm deployments
  • Strong CI/CD experience (GitHub Actions or equivalent)
  • Demonstrated ability to lead technical design and execute independently
  • Familiarity with GenAI concepts and OpenAI APIs, with a drive for self-learning
  • Familiarity with AI-assisted development while maintaining strong quality and architectural standards
  • Good communication and collaboration skills
  • B2+ English level (written and verbal)

Nice to Have

  • Experience building LLM gateways, API gateways, or multi-provider AI/ML integration platforms
  • Experience with gRPC, cloud SDKs, or service integrations on AWS, Azure, or GCP
  • Familiarity with API platform security controls - API keys, OIDC, secrets management, and abuse prevention
  • Exposure to cost and performance optimization for high-volume inference or request-processing workloads
  • Experience contributing to platform roadmap planning (epics, user stories, backlog prioritization)
  • Background working with UX/product teams during early-stage platform definition

We Offer

  • Remote work options in Georgia, Armenia
  • Competitive salary
  • Opportunity to work on cutting-edge technology in the field of Generative AI

About the Company

[Company description if present]

© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.

More at EPAM

All 2376 roles

Popular searches