A split test node is a two-part node comprised of two required parts: a Producer and a Consumer. A Producer will assign a randomly-selected variant to the transaction it is processing at that time, and save two outputs: Selected Variant and Consumer ID.
The split test node can accomplish several tasks, including the following:
For example, you can use a split test node to do the following actions:
For example, the following split test node has four variants: red, blue, green, and yellow. The yellow variant is displayed more frequently, and is the favored outcome:
When implemented, a split test node performs the following actions:
Clicking the Producer node in the graph displays the Producer results pane to the right of the page, which updates every 60 seconds.
Notes
You can enable one of the following options based on your use case:
By selecting the Enable Adaptive Learning check box, you can change the distribution based on the winning variant, and reassign the probability of selecting a variant to favor the winner.
1000
100
95
After the Minimum Responses Consumed threshold is met, the node selects variants based on the winning rank and the selection distribution. In the previous example screenshot, after 10 responses are received, a winner is chosen. The winner will be recommended 90% of the time, then second place variant will be chosen 10% of the time.
If you select the Create New Test On Deploy check box, the split test node will be reset and all information (including the winning variant) learned up to that point will be reset.
To create a split test node as part of an existing graph, perform the following actions:
After creating a blank split test node, perform the following actions to configure it:
From the projects list, identify the project you want to modify, and click its title. Acquia Journey will display the Overview tab for your project.
Click the Graphs tab.
Scroll to identify the split test node you want to modify, and click its name.
In the upper-left of the Split Test Editor section, click Create Variant.
Enter a name for the test, and then click Create Variant.
Note
After you save a variant’s name, you cannot edit the name.
To set the likelihood of this variant being selected, in the gray
field to the right of the variant’s name, enter a number between
1
and 100
.
Create additional variants as needed. You must have at least two variants defined for the split test node to be valid.
Acquia Journey saves your changes as you configure the split test node.
To use your split test node, you must add a producer variant and a consumer variant to your graph. The consumer variant can be added to a different graph than the producer depending upon your requirements. Complete the following steps to add the node to your graph:
Note
You should create the Producer node in the graph that determines the A/B group variant, while placing the Consumer node in the graph that tracks engagement data.
Warning | Solution |
---|---|
Split test Meta Data must be set to a valid data reference | Ensure that the ‘Selected Variant’ and the ‘Consumer ID’ are saved to a location in the schema |
All split tests must have at least 2 variants to be valid | Ensure that the split test node has at least two variants to randomly select from for the A/B testing |
A project must have at least one consumer node per split test | Ensure that a process in the project has a Consumer node version of the split test node to identify a winning variant |
A project can only have one producer node per split test | Ensure that the same split test node does not have two Producers in the same project |