GenAI Solutions Architect

About the Position

GenAI Solutions Architect

We are seeking a GenAI Solutions Architect with 7+ years of experience in solution architecture to join our team in Buffalo, New York. This role involves designing AI use cases aligned with enterprise standards.

Responsibilities

• Solution Architecture & Design Consulting

  • Serve as the consulting architect for AI use-case teams across the bank.
  • Shape solution designs, data flows, model access patterns, and integration approaches aligned to the enterprise AI platform and gateway architecture.
  • Produce and maintain reference architectures, design patterns, and working examples for common use-case shapes.
  • Review solution designs against platform standards and governance requirements before build; document findings and drive remediation with delivery teams.
  • Advise on model selection, prompt/context architecture, retrieval design, and oversight/guardrail patterns appropriate to each use case's risk tier.

• Platform Alignment & Standards Adoption

  • Ensure all designs route model access through the governed enterprise gateway with correct entitlements, quotas, and logging.
  • Translate governance standards into architecture requirements delivery teams can implement.
  • Partner with platform engineering on the evolution of platform capabilities based on real use-case demand.
  • Document network, identity, data-classification, and environment-separation considerations for solution designs.
  • Partner with Cybersecurity architecture on AI threat modeling, prompt-injection risk, and adversarial-testing requirements for solution designs.

• Enablement & Capability Transfer

  • Pair with application teams that lack AI delivery experience; provide hands-on design and build guidance through their first implementations.
  • Create and deliver architecture enablement materials, design guides, and pattern documentation in the bank's repositories.
  • Support solution reviews in governance forums with clear, evidence-based architecture assessments.
  • Transfer patterns, documentation, and working knowledge to bank FTEs throughout the engagement so capability persists post-contract.

Requirements

Must Have

• Minimum of 7 years' experience in solution architecture, application architecture, or senior engineering roles, including hands-on delivery of cloud-native applications.
• Hands-on experience architecting and delivering GenAI/LLM-based solutions: model integration, RAG pipelines, prompt/context engineering, and agent or workflow patterns.
• Strong Azure experience: Azure OpenAI/AI services, API Management, Entra ID, Key Vault, networking and landing-zone concepts, and environment separation.
• Demonstrated experience producing reference architectures, integration patterns, and design documentation adopted by multiple teams.
• Experience designing within security, risk, and compliance constraints in a regulated environment.
• Strong consulting skills: stakeholder communication, design facilitation, and the ability to influence without authority.

Nice to Have

• Financial services experience and familiarity with banking SDLC governance (design gates, architecture review, permit-to-build/operate models).
• Experience with AI gateway/governance patterns: model allowlisting, entitlement-based access, usage controls, audit logging.
• Experience with vector stores, retrieval services, evaluation harnesses, and MCP/tool-integration patterns.
• Experience mentoring teams new to AI delivery.

Languages

• English: C1 Advanced

We Offer

• Competitive salary
• Opportunity to work in a dynamic and innovative environment
• Professional development opportunities

About the Company

Join our team in Buffalo, New York, and contribute to the cutting-edge development of AI solutions that align with enterprise standards.