Experimentation Manager

London, England, United Kingdom; Manchester, United Kingdom

About the Position

We are seeking a highly organised and meticulously detail-oriented Experimentation Manager to ensure the flawless execution and ongoing management of our client's market-specific and regionally tailored experimentation-led growth initiatives. Reporting directly to the Experimentation Lead, this role is centered on management through to comprehensive performance reporting and communications. Your primary focus will be the reliable ingestion, accurate dissemination, and diligent monitoring of experiments, ensuring they run efficiently, deliver trustworthy data, and are delivered on time, to specification, and are appropriately localised for target markets/regions. You will be instrumental in the day-to-day operational success of our experimentation program, acting as the crucial link between strategy and technical delivery for diverse geographical markets.

Responsibilities

Operational Execution of Global Experimentation Activities

• Execute, coordinate, and monitor the day-to-day tactical operations for the client's market-specific and regional testing roadmaps, ensuring experiments are launched and monitored precisely according to plan and instructions, and are adapted for local market nuances.
• Support the Experimentation Lead by meticulously preparing and executing high-impact, experimentation-based growth opportunities, ensuring all technical and operational aspects are addressed with regional considerations in mind.
• Track and update project timelines, dependencies, and resource allocation specific to experimentation initiatives, utilising project management tools (e.g., Jira, Asana) for ticket creation and status updates to ensure successful, on-schedule, and in-scope delivery of tests and learning agendas across various regions.
• Assist in resource allocation for experiments, considering regional priorities and market differences, diligently monitor testing throughput, and accurately contribute to tracking the Return on Investment (ROI) of experimentation within established guidelines.
• Generate and disseminate clear, concise performance reports on experimentation outcomes and insights for the Experimentation Lead and relevant stakeholders, ensuring data accuracy and timely delivery, with a clear breakdown of regional performance and insights.
• Assist in maintaining robust communication channels with client stakeholders, providing regular updates on experimentation planning, execution status, and results across diverse global regions, highlighting regional performance differences as directed.
• Proactively communicate the status of experiment backlogs, planned activities, and potential blockers to the Experimentation Lead and relevant teams, including market-specific deployment considerations.

Experimentation Implementation & Operations Support

• Support the practical, hands-on application of Experimentation-Led Growth (ELG) principles across the organisation through meticulous execution, fostering a mindset of continuous learning and data-driven operations, with a focus on adapting strategies for different market needs.
• Meticulously follow and execute within the comprehensive ELG framework, methodologies, and best practices as established and directed by the Experimentation Lead, ensuring adherence to regional guidelines and requirements.
• Coordinate with cross-functional teams, including regional marketing, product, and localisation teams, to meticulously configure, execute, and support the analysis of experiments according to predefined designs, ensuring all operational steps are completed accurately and on time.
• Operate the infrastructure for continuous testing, learning, and iteration, focusing on the efficient and timely delivery of experiment setups and launches, troubleshooting operational issues as they arise, particularly those related to regional deployments.
• Extract and summarise key findings and raw data from experiment results, preparing them for detailed review and interpretation by the Experimentation Lead, including regional data anomalies and successes.

Technical Delivery & Platform Configuration

• Execute the technical configuration, setup, and launch of all experimentation programs as per detailed instructions, leveraging in-depth knowledge of the underlying technology stack crucial for testing. This includes, but is not limited to, advanced experimentation platforms, comprehensive analytics suites (for measurement), and Customer Data Platforms (CDPs) (for market-specific audience segmentation).
• Configure and implement integrated solutions by applying your understanding of the capabilities, limitations, and interoperability of these experimentation-focused technologies, ensuring they are strategically deployed precisely to maximise testing velocity, accuracy, and deliver against growth objectives, and regional market effectiveness.
• Create and manage tickets for technical tasks, bug fixes, and data requests related to experiment setup and monitoring, especially for regional deployments and localisation.

Requirements

• Flawless Execution & Project Coordination

  • Adept at meticulously executing experiments, planning steps, managing and overseeing multiple market-specific and regional initiatives by ensuring on-time and in-scope delivery as per established plans.
  • Proficiency in project coordination tools (e.g., Jira, Asana, Trello) and methodologies (e.g., Agile, Waterfall), effectively creating and tracking tickets, managing dependencies, and escalating risks specific to experimentation projects, especially those impacting regional launches.
  • Instrumental in meticulously following and applying efficient processes, adhering to and contributing to the refinement of repeatable frameworks for experimentation setup, technical delivery, and reporting, ensuring consistency and accuracy across all tasks, and adaptability for regional nuances.

• Data-Driven Support & Commercial Awareness

  • Supports data-driven decision-making by accurately extracting, compiling, and organising data from experiments, preparing it for analysis. This includes strong analytical skills, an understanding of A/B testing principles, and the ability to interpret raw datasets from experiment results to populate reports, with an emphasis on regional performance metrics.
  • Understands the commercial implications of meticulous execution, consistently tying technical delivery and accurate experiment data back to measurable business value and contributing to ROI tracking, and how market variations influence commercial outcomes.
  • Excels at generating and communicating performance reports, based on predefined templates and data sources, ensuring complex results and insights are presented clearly and accurately to diverse audiences as instructed, with a clear breakdown of regional performance and insights.

• Exceptional Stakeholder Coordination & Communication

  • Success in this role hinges on effectively coordinating and communicating with key client stakeholders across all levels and global regions. You will be a reliable point of contact for execution updates, practicing active listening and diligent expectation management around experiment delivery timelines and status, especially with regional stakeholders, understanding and addressing their unique market challenges and opportunities.
  • Collaborates effectively across functions internally, serving as a key coordinator with product, engineering, marketing, and data science teams to ensure smooth execution of experimental setups, data delivery, and problem resolution, especially with regional business units and localisation teams.
  • Strong ability to articulate operational processes, technical requirements, and experiment statuses clearly and concisely, including regional deployment considerations and performance.

We Offer

Alongside the opportunity to work with some of the most exciting brands around the world, we’ll also prioritise your career development and help you grow your skills. We’ll empower you to make a difference, allow you to be yourself, and respect who you are.

Permanent only:

We offer a great benefits package including a discretionary bonus scheme, training opportunities, competitive pension, medical insurance, life assurance, social events, opportunities to buy and sell holidays, family friendly policies, discounts with hundreds of retailers and much more.

Our culture thrives on our core values, designed for impact-driven individuals: Heart, Brains and Courage.

We lead with Heart, fostering empathy and trust where genuine connections and human-centric work flourish.

We empower your Brains for innovation, valuing relentless curiosity and collaborative intelligence to solve complex challenges.

And we champion Courage, inspiring you to speak up, embrace experimentation, and advocate for bold solutions that push our thinking to be better than yesterday.

About the Company

VML is a global creative company that combines brand experience, customer experience, and commerce to create connected brands that drive growth. Guided by a Human First philosophy, VML is known for its innovative work for brands and consistently ranks among the world’s leading creative companies, including the WARC Creative 100. VML’s global network spans 55+ markets with principal offices in Buenos Aires, Kansas City, London, New York, São Paulo, Shanghai and Singapore.

VML is part of WPP, the trusted growth partner for the world's leading brands. Powered by exceptional talent and our agentic marketing platform WPP Open, WPP unites cutting-edge media intelligence and data solutions, creativity, production, enterprise solutions and expert strategic counsel.

For more information, please visit www.vml.com and follow along on  LinkedIn #WeAreVML.