Experimentation Masters

Gavin Bryant
  • 5.0 (1)
  • BUSINESS

The leading resource for product experimentation. Learn practical tips, methods and techniques from world-leading experts in experimentation. Design better experiments, lead with more confidence and have more impact in your organisation. Learn faster. Make better decisions.

  1. 02/26/2025

    EP025 - Bjarn Brunenberg - TomTom - A Strategic Experimentation Framework

    Send us Feedback Bjarn Brunenberg, Experimentation Lead, TomTom shares his strategic framework for experimentation. Bjarn discusses what a strategic experimentation framework is, why it's important to use a strategic approach for experimentation to maximise impact, and, from a practical sense, how a strategic experimentation framework can be used in your organisation. --- Bjarn Brunenberg is the Experimentation Lead at TomTom. TomTom is a Dutch multinational developer and creator of location technology and consumer electronics, operating in 29 countries and with revenues of €585M. At TomTom, he is responsible for accelerating growth in the eCommerce team through Conversion Rate Optimisation, Experimentation and strategic GTM plans. He has grown App revenue at TomTom by 100%+ YoY. Key to this growth was developing and implementing a systemic experimentation process, which improved experiment throughput from 20 experiments to over 200 experiments. Prior to this, Bjarn worked as a Growth Marketer at Mollie, Netherlands and also as a Digital Marketing Specialist at Accenture, supporting Google projects. He is a keynote speaker and two-time winner of the Experimentation Culture awards, also creating the Strategic Experimentation Framework, which helps organisations link experimentation to their OKRs and big-picture goals. ---- Want more? Head to the First Principles website for the episode transcript, resources and reading lists - https://www.firstprinciples.ventures/ep025-bjarn-brunenberg-a-strategic-experimentation-framework Add Beat The Odds newsletter to your inbox for practical tips from world-leading experts in Experimentation, Growth & Product Design. https://www.firstprinciples.ventures/newsletter Follow Gavin on LinkedIn at : https://www.linkedin.com/in/gavinbryant/ Follow Gavin on Twitter @signalnotnoise

    58 min

  2. 02/12/2025

    EP024 - Melanie Kyrklund - Specsavers - Establishing a Global Experimentation Centre of Excellence

    Send us Feedback Melanie Kyrklund, Global Head of Experimentation, Specsavers shares her personal journey of establishing a global Centre of Excellence experimentation operating model at Specsavers. Melanie discusses the business triggers for the change, the planning and preparation involved, and the key measures of success for the transition. --- Melanie Kyrklund is the Global Head of Experimentation at Specsavers. Specsavers is a multinational optical retail chain, operating in 11 countries with revenues of €4.1B. She has more than 15+ years’ experience gained in global roles across analytics, experimentation, digital marketing, and product management. At Specsavers, her primary responsibility is to facilitate enablement of experimentation across the organisation - building processes, tooling, data, and technical governance to scale experimentation reliably. Prior to this, Melanie has worked as Head of Site Optimisation at Staples Europe, eCommerce Product Owner at Booking.com and Optimisation Consultant at Liberty Global. She is passionate about translating data insights into actionable business strategies and customer solutions through continuous learning via experimentation. ---- Want more? Head to the First Principles website for the episode transcript, resources and reading lists - https://www.firstprinciples.ventures/ep024-melanie-kyrklund-establishing-a-global-experimentation-centre-of-excellence Add Beat The Odds newsletter to your inbox for practical tips from world-leading experts in Experimentation, Growth & Product Design. https://www.firstprinciples.ventures/newsletter Follow Gavin on LinkedIn at : https://www.linkedin.com/in/gavinbryant/ Follow Gavin on Twitter @signalnotnoise

    55 min

  3. 11/21/2024

    EP023 - Tracey Reed - Air New Zealand - Creating The Airline Of The Future With Experimentation

    Send us Feedback Tracey Reed, Senior Conversion Optimisation Specialist, Air New Zealand discusses how the airline uses experimentation to create elite customer experiences. Tracey shares how to solve the right customer problems, influencing for impact at multiple levels of your organisation and why experimentation needs to be less confronting for the uninitiated. --- Tracey Reed is a Senior CRO Specialist at Air New Zealand, with over twelve years of experience in the digital landscape. Her expertise spans customer-centric sectors, including travel, financial services, and media. By employing data-driven strategies, Tracey enhances customer experiences and drives commercial growth through effective conversion rate optimisation (CRO). At Air New Zealand, she has been instrumental in developing and advancing the company’s CRO initiatives, leading to significant improvements in program maturity. A true advocate for the customer, Tracey utilises a variety of data sources to gain deep insights into challenges, collaborating with cross-functional teams to optimise digital experiences. Her diverse skill set includes performance analytics, digital strategy, behavioural science, and online marketing. With a strong command of various digital media products and technologies, Tracey excels in dynamic, fast-paced environments. ---- Want more? Head to the First Principles website for the episode transcript, resources and reading lists - https://www.firstprinciples.ventures/ep023-tracey-reed-creating-the-airline-of-the-future Add Beat The Odds newsletter to your inbox for practical tips from world-leading experts in Experimentation, Growth & Product Design. https://www.firstprinciples.ventures/newsletter Follow Gavin on LinkedIn at : https://www.linkedin.com/in/gavinbryant/ Follow Gavin on Twitter @signalnotnoise

    43 min

  4. 11/19/2024

    EP022 - Adam Furness - Designing Growth Experiments: Experiences Your Customers Will Love & Pay For

    Send us Feedback In this episode of the podcast, Adam Furness, Design Manager - Growth, Atlassian discusses Designing Growth Experiments: Experiences Your Customers Will Love & Pay For. Adam shares why Good and Fast can co-exist, Atlassian's Good, Better, Best Framework and how designers build confidence around a new opportunity. ---  Adam Furness has spent 10+ years leading world-class product design teams that create value through design excellence. He’s worked as a design lead and manager and has built and scaled high-performing teams across APAC and the US. He’s currently Design Manager on the Growth team at Atlassian, where he’s spent the last 5 years leading full-funnel experimentation teams. He believes that ‘fast’ and ‘good’ can co-exist, values autonomous teams, and a critical, human-centred approach to product and problem-solving. Before Atlassian, Adam was design lead and manager for US sports technology company Hudl. ---- Want more? Head to the First Principles website for the episode transcript, resources and reading lists - https://www.firstprinciples.ventures/ep022-adam-furness-designing-effective-growth-experiments Add Beat The Odds newsletter to your inbox for practical tips from world-leading experts in Experimentation, Growth & Product Design. https://www.firstprinciples.ventures/newsletter Follow Gavin on LinkedIn at : https://www.linkedin.com/in/gavinbryant/ Follow Gavin on Twitter @signalnotnoise

    43 min

  5. 11/14/2024

    EP021 - Sunita Verma - H&M - Mindset Over Metrics: Using Experimentation To Develop A Data-Driven Culture

    Send us Feedback In this episode of the podcast, Sunita Verma, Test & Learn Specialist, H&M discusses why mindsets and relationship building matters the most when developing an experimentation culture. Sunita shares insights on managing a global experimentation program, how to start small and make a fast start and gaining stakeholder confidence to impact bigger strategic decisions. --- Sunita Verma is currently Test & Learn Specialist (East Asia) at global fashion mega brand H&M. She is an experimentation and growth professional with 5+ years of experience in fostering a culture of experimentation within leading organisations. Her work at Zalora and FairPrice Group has been pivotal in advancing data-driven decision-making and promoting a more agile approach to business operations.  At Zalora, an online fashion retailer, Sunita integrated experimentation techniques to enhance user experience and optimise operational processes. Her focus on data-driven strategies and testing methodologies provided valuable insights into user behaviour and preferences.  At FairPrice Group, one of Singapore’s largest supermarket chains, Sunita drove the adoption of an agile operational model. Her efforts in data analytics and iterative testing enabled FairPrice Group to make informed decisions more swiftly and respond effectively to evolving customer needs. ---- Want more? Head to the First Principles website for the episode transcript, resources and reading lists - https://www.firstprinciples.ventures/ep021-sunita-verma-mindset-over-metrics Add Beat The Odds newsletter to your inbox for practical tips from world-leading experts in Experimentation, Growth & Product Design. https://www.firstprinciples.ventures/newsletter Follow Gavin on LinkedIn at : https://www.linkedin.com/in/gavinbryant/ Follow Gavin on Twitter @signalnotnoise

    46 min

  6. 11/13/2024

    EP020 - Ken Kutyn - Amplitude - Developing High-Velocity Experimentation

    Send us Feedback In this episode of the podcast, Ken Kutyn, Principal Solutions Engineer, Amplitude discusses how to develop high-velocity experimentation in your organisation. Ken shares what a good experimentation program strategy looks like, laying a solid foundation for experimentation and critical steps for scaled experimentation. --- Ken Kutyn is a Principal Solutions Engineer at Amplitude Analytics, with over 8 years of experience at the forefront of Experimentation platforms, including Optimizely and Amplitude. Throughout his career, Ken has partnered with some of the world’s largest brands, guiding them in evaluating, implementing, and scaling their experimentation programs. His journey has taken him across major global tech hubs, including Vancouver, San Francisco, Amsterdam, London, and now Singapore. Ken brings a deep technical expertise and passion for experimentation, focusing on enabling high-velocity testing without compromising user experience. His work helps teams eliminate performance bottlenecks, prevent bugs, and ensure clean data integrity—critical factors for successful, scalable experimentation. After publishing his MBA thesis on the role of experimentation in software development, he has become a sought-after speaker, sharing best practices at conferences, webinars, and podcasts worldwide. His mission is to empower teams with the knowledge and tools to drive impactful experimentation and continuous improvement. ---- Want more? Head to the First Principles website for the episode transcript, resources and reading lists - https://www.firstprinciples.ventures/ep020-ken-kutyn-developing-high-velocity-experimentation Add Beat The Odds newsletter to your inbox for practical tips from world-leading experts in Experimentation, Growth & Product Design. https://www.firstprinciples.ventures/newsletter Follow Gavin on LinkedIn at : https://www.linkedin.com/in/gavinbryant/ Follow Gavin on Twitter @signalnotnoise

    51 min

  7. 11/12/2024

    EP019 - Jonas Alves - ABsmartly - Building & Scaling A World-Class Experimentation Platform

    Send us Feedback In this episode of the podcast, Jonas Alves, CEO ABsmartly, discusses building and scaling one of the world's leading experimentation platforms. Jonas shares why you need to keep experimentation simple, worrying less about experiment interaction effects and future directions for ABsmartly and the experimentation industry. --- Jonas Alves is the CEO and co-founder of ABsmartly, a leading experimentation platform designed for trustworthy A/B testing. He has 16+ years-experience in the field of online experimentation working in-house and consulting, with experience including design and build of experimentation platforms, democratisation and scaling of experimentation programs and conducting training with experimentation teams. Prior to ABsmartly, Jonas worked as an experimentation consultant, helping other organisations on their experimentation journey, including Catawiki.com, GetYourGuide, Viagogo, Adidas, Picnic.nl, MinDoktor.se, Match.com (OkCupid, Tinder), Remitly, SpotAHome, ParkMobile and many others. He started with experimentation in 2008 at Booking.com. Here he democratised experimentation across the organisation to many development teams. By 2012, hundreds of people were performing experiments every day.  As Product Owner (Experimentation), Jonas was responsible for experimentation training, new features, reporting and metrics. When leaving Booking.com in 2015, the business was running more than 1000 experiments simultaneously and starting 100+ new experiments every single day. ---- Want more? Head to the First Principles website for the episode transcript, resources and reading lists - https://www.firstprinciples.ventures/ep019-jonas-alves-building-an-experimentation-platform Add Beat The Odds newsletter to your inbox for practical tips from world-leading experts in Experimentation & Product Design. https://www.firstprinciples.ventures/newsletter Follow Gavin on LinkedIn at : https://www.linkedin.com/in/gavinbryant/ Follow Gavin on Twitter @signalnotnoise

    43 min

  8. 08/20/2024

    EP018 - Aleksander Fabijan - The Experimentation Flywheel - Growing A/B Testing Momentum at Scale

    Send us Feedback In this episode of the podcast, Aleksander Fabijan, Senior Product Manager Microsoft Experimentation Platform (ExP) team, provides practical strategies and lessons from his paper - It Takes a Flywheel to Fly: Kickstarting & Growing A/B Testing Momentum at Scale. Alex shares how to use the five-step experimentation flywheel to increase experimentation velocity in your organisation. --- Aleksander Fabijan is Senior Product Manager at Microsoft. He is part of a 60+ team of Data Scientists, Software Engineers and Program Managers that form the Experimentation Platform (ExP) team. The ExP team is responsible for one of the largest and most cutting-edge online experimentation systems in the industry. The mission of the team is to accelerate innovation at Microsoft through trustworthy experimentation. Major products such as Bing, MS Office, Skype, Xbox, Windows, and MS Teams all use the ExP platform to perform online controlled experiments. Aleksander holds a PhD from Malmo University where he conducted his research at Software Centre, a European collaboration of companies and universities accelerating the adoption of novel software engineering approaches. He has published and co-authored many influential research papers on large-scale online controlled experimentation. Key research interests - running trustworthy experiments, experimentation system architecture, and examination of experiments (analysis). His passions include data-driven decision-making using A/B testing, AI system design, or API design, User Experience (UX) and large-scale experimentation. * The views expressed in this podcast are Alek’s personal perspective and not necessarily reflective of Microsoft. ---- Want more? Head to the First Principles website for the episode transcript, resources and reading lists - https://www.firstprinciples.ventures/ep016-aleksander-fabijan-the-experimentation-flywheel-kickstarting-and-growing-a/b-testing-momentum-at-scale Add Beat The Odds newsletter to your inbox for practical tips from world-leading experts in Experimentation & Product Design. https://www.firstprinciples.ventures/newsletter Follow Gavin on LinkedIn at : https://www.linkedin.com/in/gavinbryant/ Follow Gavin on Twitter @signalnotnoise

    1h 3m
See All (25)

Trailer

About

The leading resource for product experimentation. Learn practical tips, methods and techniques from world-leading experts in experimentation. Design better experiments, lead with more confidence and have more impact in your organisation. Learn faster. Make better decisions.

Information

  • Creator
    Gavin Bryant
  • Years Active
    2021 - 2025
  • Episodes
    25
  • Rating
    Clean
  • Copyright
    © 2025 Experimentation Masters
  • Show Website
    Experimentation Masters