Migrate to SDK v3.2

Introducing A/B tests

At Purchasely we believe that product and marketing teams should be able to iterate, test, learn and optimize without having to scatter the focus of developing teams.

We know how much important AB testing is when it comes to learn and mitigate risks of experiments. That why we have designed a built-in AB testing feature to allow you to better understand and optimize your subscription business.

To be able to use Ab testing with Purchasely the only pre-requisites are to update the SDK to 3.2 or above and to have setup at least one Placement.

Setup and start an AB test

Step 1: In Purchasely Console, Click on A/B Test --> you can either click on Start your first A/B test or New A/B Test

Step 2: Provide the mandatory fields- Name, ID, and Placement. You can add a short description of the A/B test created.

Please note:

• Name & ID- have to be unique

• Description- a short phrase about the test

• Placement- Only one placement can be selected per test. If the placement was already chosen by another test, it can be used in another test.

  Significance of the A/B test ID

Step 3: Select the paywall for A/B/C test respectively

Please note:

• ID- is created by default

• Weight- is assigned by default

• Paywall- you can choose any paywall that you have already created

• Total weight- your total weightage for all the tests you have created should be equivalent to 100. You can click on equalize to make them=100

You can click on Save as a draft if you haven't finalized the test yet.

⚠️ Attention:

• Once you have started the A/B test:

  • You can neither edit the Placement nor the paywall

Interpreting results through Data

You have created and started a new A/B test for your desired Placement. Once the test is started, it goes live without any further dependency.

Data Table

1. Name- of the paywall test variant

2. Repartition- Weightage of the test variant

3. Unique Viewers- the total number of the distinctive viewer of the paywall in the subject

4. Subscription Started- the total number of users who started their subscription with the regular price( Do not include the free trial or intro price)

5. Trial Started- the total number of users who started their free trial or intro price or promo code

6. Trial Converted- the total number of users who started their free trial/intro price/promo code and converted to the regular price subscription

7. Trial Ended- the total number of users whose trial period ended(free trial/intro price/promo code)

8. View to Paid- the sum of the subscription started and the trial converted.

   The % of views to paid= (Subscription Started+Trial converted)/Unique Viewers

9. First Renewal- the total number of users who renewed their subscription while they were in the regular price cycle

Data Chart

You can choose your chart based on three dimensions

1. Plan- the plan displayed in the paywall monthly, yearly etc.

2. Platform- the mobile platform used by the user to subscribe like iOS, Android etc.

3. Country- the location of the user mobile store

Reading the chart:

If you look at the chart below,

• The Test have achieved 9 monthly subscription

• Out of which 8 of them are started with regular price cycle and 1 was started as a trial cycle

• Both the trial and the regular price subscriptions were renewed after their first subscription period

Tracking your AB tests

The A/B test involves two IDs that will allow you to track their performance using your own tools (internal or third party).

They are:

1. The A/B test ID

2. The variant(A/B/C test) ID

These ID's are sent along with the SDK events and also associated with the User subscription life cycle events.