A/B testing on Trade Me

What is an A/B test?

An A/B test is where we show some of our members a new functionality or design. We may also offer alternative pricing, language or incentives. Members in group ‘A’ are the test group who see the changes we’re testing. Those in group ‘B’ are the control group who won’t notice anything different. Sometimes (for more complicated tests) we'll test more than two groups.

An A/B test can happen across multiple devices. However we usually run tests on our desktop site.

We’ll often run a test on a small number of members. We then look at the results and feedback we have received before we decide to release the change across the whole of Trade Me.

Why do we do A/B tests?

We want to see how effective the changes we’re testing are – do they achieve their purpose and give you a better experience on Trade Me? If we think that the change performed well, we might consider rolling it out across the site for all members.

What does it mean for members?

Usually, members who are in the test group will have to be logged in to see any changes. The only way you’ll know if you’re in this group is if you notice a change from the normal site. If we’re looking for feedback from our members, we’ll display a banner somewhere on the page to let you know you’re part of a test and how you can provide us with your thoughts.

What are some examples of past A/B tests?

We’ve already tested the following:
  • A refreshed listing page design.
  • Notifying members if a seller offers combined shipping.
  • A new look and feel to the way search results are presented.

Want further assistance?

  • Call us on 0900 87233Available 24/7. Calls cost $1.99 + GST per minute.
  • Email us your questionWe aim to respond within 3-5 days.