AI LLM Technology Architecture Manager

About the Position

AI LLM Technology Architecture Manager

We are entering into a new decade of Data & AI that will reshape work and society. Accenture is stepping boldly into this future with a clear strategy and purpose: to help clients optimize and reinvent their business with data & AI - backed by a $3B investment and commitment to our people to do industry-defining work.

With over 77,000 professionals dedicated to Data & AI, Accenture’s Data & AI organization is powered by experienced innovation, strategic investment, exceptional talent, and our power ecosystem.

Responsibilities

As an experienced and senior AI/LLM Architect, you will play a pivotal role in designing and delivering end-to-end AI platform architectures that power the modern, reinvented enterprise. Operating at the intersection of business and engineering, you will own the technical design of advanced AI systems - spanning classical machine learning, generative AI, and agentic systems - ensuring they are purposefully architected to meet client business objectives and enterprise-grade standards.

• Translate business strategy into a technical vision by defining the non-functional requirements (NFRs) necessary to meet operational goals for performance, reliability, and cost.
• Lead stakeholder workshops to align on technical feasibility, define project scope, and manage expectations with clients and leadership.
• Drive the technology selection process, evaluating build-vs-buy decisions for AI platforms and foundational models.
• Architect model- and tool-agnostic multi-agent systems governed by an MCP Control Plane.
• Design and implement the Agent Registry and AI Gateway for runtime policy enforcement.
• Design and implement a certification gate to ensure no uncertified agents enter production.
• Architect the end-to-end data pipeline for AI systems, including data ingestion, preprocessing, and synchronization for fine-tuning and RAG.
• Design and implement the context layer-spanning knowledge graphs, vector search, and semantic retrieval-to create reliable, grounded RAG pipelines.
• Architect foundation model adaptation strategies, including dynamic, cost-and-performance-aware model routing and selection.
• Design, implement, and prototype high-throughput, low-latency inferencing solutions.
• Define security, governance, and observability as centrally-enforced, by-design controls for all AI systems.
• Architect a robust, defense-in-depth security framework, including per-agent identity with IAM/IAP binding and layered guardrails.
• Design and implement FinOps controls enforced at the AI Gateway.
• Establish the framework for comprehensive system evaluation, adopting productized tools and instrumenting observability with OTel.
• Define and maintain the enterprise-wide AI reference architecture, reusable design patterns, and a library of approved software components.
• Independently design, implement, build, and deliver proof-of-concept prototypes and foundational software components to validate architectural decisions.
• Produce and own authoritative architecture artifacts, including blueprints, sequence diagrams, design specifications, and Architectural Decision Records (ADRs).
• Mentor and guide cross-functional engineering teams on architectural best practices and design patterns.
• Continuously research and integrate emerging AI patterns, frameworks, and technologies to maintain a forward-looking architecture.

Requirements

• Bachelor's Degree or equivalent
• Minimum of 5 years of experience in designing & deploying enterprise grade advanced AI solutions using agentic, generative and classical AI/ML using at least one cloud vendor.
• Minimum of 2 years of experience in the Agentic, LLM and Generative AI space.
• Minimum of 4 years of coding experience using Python.
• Minimum of 2 years of experience architecting and operationalizing LLM driven application architecture patterns.
• Minimum of 4 years in coding engineering, machine learning, deep learning and NLP solutions and applications.
• Minimum of 4 years of experience as a machine learning architect in the industry designing big data, machine learning, large scale analytical engineering solutions.

Locations

• Sydney, Australia
• Brisbane, Australia
• Melbourne, Australia

We Offer

• Competitive salary
• Opportunity to work in a dynamic and innovative environment
• Professional development opportunities
• Inclusive and diverse workplace

About the Company

At Accenture, we recognize that our people are multi-dimensional, and we create a work environment where all people feel like they can bring their authentic selves to work, every day.

Our unwavering commitment to inclusion and diversity unleashes innovation and creates a culture where everyone feels they have equal opportunity. Our range of progressive policies support flexibility in ‘where’, ‘when’ and ‘how’ our people work to ensure that Accenture is an organisation where you can strive for more, achieve great things and maintain the balance and wellbeing you need.

We encourage applications from all people, and we are committed to removing barriers to the recruitment process and employee lifecycle. All employment decisions shall be made without regard to age, disability status, ethnicity, gender, gender identity or expression, religion or sexual orientation and we do not tolerate discrimination. If you require any accommodations or adjustments for interviews and/or at work, please reach out to [email protected] or contact us at +61 2 9005 5000 (Australia) or +64 44666056 (New Zealand).

To ensure our workplace is inclusive and diverse we are setting bold goals and taking comprehensive action. To achieve these goals, we collect information that allows us to track the effectiveness of our Inclusion and Diversity programs. Learn how Accenture protects your personal data and know your rights in relation to your personal data. Read more about our Privacy Statement.

We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.

We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.

At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World’s Best Workplaces™.

Join Accenture to work at the heart of change. Visit us at www.accenture.com.