View product page optimization results
Product page optimization helps you evaluate which version of your product page is most effective at getting users to download your app. These tests use a range of modern and rigorous Bayesian techniques and require minimal overhead to launch a test, transparently communicate changing results as they arrive, and identify the best version as quickly as possible. This methodology is designed by Apple specifically for App Store product page data, so you can evaluate results every day with the confidence that you’re receiving the most accurate and up-to-date information.
Once a test gathers enough impressions for 90% confidence, a treatment may be marked as Performing Better or Performing Worse, compared to your chosen baseline. (This baseline is the original product page by default, and can be changed to a treatment at any time.) The main measure of performance for each product page version is the conversion rate — the estimated percentage of users that downloaded or pre-ordered your app after viewing the product page. If the amount of data required to reach a high confidence level is more than you’ll likely receive based on your test’s traffic partway through the test, we’ll let you know that your test may be inconclusive.
Your test results will indicate an estimated conversion rate for each variant, an estimated lift in conversion between variants, and Apple’s level of confidence in the results. To calculate this data, Apple takes into account a range of prior information about the performance of your app’s product page. This helps ensure that there’s enough data to report on a difference between your variants.
Required role: Account Holder, Admin, Finance, or Sales. View role permissions.
View test results
Product page optimization helps you evaluate which version of your product page is most effective at getting users to download your app.
From App Analytics, select your app.
Click the Acquisition tab.
In the top menu bar, click Product Pages.
Click a test’s name in the Product page optimization list. Only the most recent and currently running tests are shown.
The overview of your test’s performance, includes an estimate of which treatment is performing best. By default, your original product page is the baseline. If your test has multiple treatments, you can change the baseline to one of those treatments. Use the Improvement switch to display results by Improvement or Conversion Rate. Use the menu to view different test results.
Once a test gathers enough impressions to have at least 90% confidence in the results, a treatment may be marked as either Performing Better or Performing Worse compared to your chosen baseline. By default, the baseline is your original product page, and can be changed to any of your treatments at any time.
The methodology used in product page optimization is described in Interpretive Adaptive Optimization.