Manage experiments with customer journeys
With Experiments from Next Identity, you can set up A/B type testing for a specific application so that you can determine which experience is most beneficial for your end users. This guide will help you understand how experiments work and help you setup and manage experiments using the Next Identity console tool.
Key Concepts for Experiments in the Next Identity Console
Experiment Configuration Options - At this time there are two types of experiments you can run within Next Identity:
A Journey Experiment serves different experiences to the end user to compare the results of each (for example, you could compare an OTP experience with a traditional email/password experience, or you could select a much smaller adjustment such as asking for one additional field one a registration form of one journey vs another). Each journey used to be compared needs to be configured within the Journeys Builder as a separate journey.
A Theme Experiment serves different visual experiences to the end user to compare the results of each (for example, you could compare an experience using parent company branding on a website that is a subsidiary, vs using the specific application branding or you could select a much smaller adjustment such as simply changing the logo of one of the colors in use). Each theme used in the experiment will need to be configured as a separate theme within the theme manager tool.
Experiment Controls and Variants - at this time we allow you to configure two elements to compare within an experiment.
Experiment Control - this is the default version that will be shown to end users and will reflect the current setting for your application (ex. current journey or current theme assigned to your application). This is what the application will return to showing 100% of the time once the experiment ends.
Experiment Variant - this is the variant version of the experience that will be shown to users while the experiment is running. This will no longer be shown to users once the experiment concludes.
Accessing Experiments in the Next Identity Console
To manage Experiments:
Navigate to Applications in the left menu of the Next Identity Console.
Choose an Application that you would like to manage experiments.
In the application details page, choose the Experiments tab.
Note: Access to this feature is role-based. Refer to the Roles and Permissions page for more details.
Experiment Management Features
You can create, view, edit, and delete experiments for an application directly from the Next Identity Console.
Creating an Experiment
On the Experiments Management Screen, select New Experiment.
Enter a descriptive Experiment Name that reflects its purpose.
Optionally enter an Experiment Description and an Experiment Hypothesis.
Use the Experiment Configuration section to configure what type of experiment you would like to perform.
Choose Journey Experiment to test different authentication flows and user journeys
Choose Theme Experiment to test different visual themes and styling approaches
Important:
To run a journey experiment, you must have more than one journey configured in your console.
to run a theme experiment, you must have more than one theme configured in your console.
For either experiment type, you will need to select a Control and a test variant (for either a journey or a theme), and define what percentage of the time the different versions should be shown to end users using the sliding scale from 0-100%.
Use the Timeline section to set a time window in which your experiment will run. Select a start date and an end date to determine when your experiment will begin and end. (note: times set are in UTC)
Once configured, select Create experiment to finalize and return to the Experiment Management Screen.
Viewing an Experiment
In the Experiment Management Screen, locate the desired experiment and select the View icon (eyeball) from the three dots menu in the upper right of the experiment card.
View the experiment's key configurations (name, configurations, variants, timeline) in the modal that pops up.
If everything looks good, you can click Close. If you would like to make changes, you can click Edit Experiment.
Editing an Experiment
In the Experiment Management Screen, locate the desired experiment and select the Edit icon (pencil) from the three dots menu in the upper right of the experiment card. You can also navigate to the edit screen from the view experiments screen.
Modify the experiment's basic information or timeline from the modal that pops up.
You can make minimal changes to the experiment configuration (such as the percentage of time the experiment variations are shown to end users), but you cannot modify the experiment type of the experiment variants.
After adjustments, select Save Changes to apply changes and return to the Experiment Management Screen.
Deleting an Experiment
Locate the experiment in the Experiment Management Screen.
Select the Delete icon (trash) from the three dots dropdown menu in the upper right corner of the Experiment card.
Confirm the deletion in the dialog box.
Need Assistance?
If you have any questions or need additional help with managing Experiments, our support team is ready to assist you.
📘 Still have questions?
Reach out to your Next Identity Consultant or contact our support team for expert guidance.
