A/B Testing and Experiments

15 April, 2024Virtual

4 days
Data Analytics

Whether a website or a business model, there is a way to determine which changes are “good” and should be rolled out and which are “bad” and discarded. The A/B Testing and Experiments training will teach you everything you need to know to run your own experiments successfully. Optimize your choices, gain the skills to experiment confidently, and make informed decisions based on insightful analysis.

Book this training

Book now

Looking to upskill your team(s) or organization?

Nico will gladly help you further with custom training solutions for your organization.

Get in touch


4 days


09:00 – 13:00









What will you learn?

In our A/B Testing and Experiments training, you will acquire the knowledge and techniques to set up and validate A/B tests. You will confidently explain the underlying statistics to colleagues and management and learn best practices for replicating experiments within your organization.

Discover how to determine experiment success, minimum sample size, and apply bootstrapping. Explore multi-armed bandit algorithms and get hands-on experience with a fun experimentation game. Learn to avoid experiment pitfalls and run multiple experiments simultaneously. Gain insights into experiment duration, the importance of preventing early stopping, and how to bootstrap to estimate uncertainties.

With hands-on exercises and real-world examples, you’ll leave this training equipped to run your own experiments and drive growth. 

Key takeaways

  1. Master A/B testing for data-driven decision-making. 
  2. Understand experiment setup, metrics, and pitfalls. 
  3. Replicate and scale experiments in your organization. 
  4. Leverage multi-armed bandit algorithms. 
  5. Gain practical experience through hands-on exercises. 
  6. Boost growth with confident experimentation. 


The program consists of both theory and hands-on exercises. Topics covered during the four half-day live-virtual sessions: 

  • The importance of A/B Testing
  • Determining the success of your experiment 
  • Designing an experiment
  • Splitting the population
  • Determining the right metric for your experiment 
  • Classical hypothesis testing
  • Further techniques for conducting A/B tests
  • A/B testing duration (and why early stopping is a bad idea)
  • Bootstrapping to estimate uncertainties
  • Bandit algorithms for real-time A/B testing 

Who is it for?

Our A/B Testing and Experiments training is perfect for data scientists and analysts working in organizations that utilize testing and seek to professionalize their experimentation.   


Familiarity with statistics is required, along with basic experience using Python. If you still need to become familiar with Python, we recommend taking our  Python for Data Analysts course to prepare for this training.

Why should I follow this training?

Make confident,
data-driven decisions

Master the art of successful experimentation and optimize your choices

Professionalize your approach to testing and experimentation

What else
should I know?

After registering for this training, you will receive a confirmation email with practical information. A week before the training, we will ask you about any dietary requirements and share literature if you need to prepare.

See you soon!

This course requires a laptop. The hands-on labs are run in an online environment, eliminating the need to install software. 

As this is a live-virtual class, you will have to take care of your own lunch and accommodation. 😉 

All literature and course materials are included in the price.  

Also interesting for you

View all training courses
MLOps on Azure

This MLOps on Azure training is then a perfect next step if you’d like like to take your Machine Learning models further.

Machine Learning
3 days
In Person


7 Feb, 2024



View training
Developing Data Models with LookML

This course empowers you to develop scalable, performant LookML (Looker Modeling Language) models that provide your business users with the standardized, ready-to-use data they need to answer their questions. Upon completing this course, you will be able to start building and maintaining LookML models to curate and manage data in your organization’s Looker instance.

Data Analytics
View training
Analyzing and Visualizing Data in Looker

In this course, you learn how to do the kind of data exploration and analysis in Looker that would formerly be done primarily by SQL developers or analysts. Upon completing this course, you will be able to leverage Looker’s modern analytics platform to find and explore relevant content in your organization’s Looker instance, ask questions about your data, create new metrics as needed, and build and share visualizations and dashboards to facilitate data-driven decision-making.

Data Analytics
View training
Data Science Bootcamp

Transform into a certified Data Scientist in just 12 weeks. This boot camp will kick-start your Data Science career with Python.

Lysanne van Beek

Data Science
11 days


25 Jan, 2024



View training
Advanced Power BI – DAX and Data Modeling

Increase your PowerBI knowledge with DAX & Data Modeling. Get started now!

Juan Manuel Perafan

Data Analytics
2 days


11 – 12 Dec, 2023



View training

Can’t find the course you’re looking for? There’s more!