> For the complete documentation index, see [llms.txt](https://help.recart.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://help.recart.com/sms/sms-campaign-a-b-testing-randomizer.md). # SMS Campaign A/B Testing (Randomizer) Learn how to run split tests within SMS flows. #### Table of Contents * [What is the SMS Randomizer?](#whatis) * [How to use Split Tests within an SMS flow](#howtouse) * [Hold-out Tests](#hold-out) * [Tips & Tricks](#tips-tricks) *** ### What is the SMS Randomizer? The SMS Randomizer feature is used to conduct **split testing** between SMS messages in a flow. Split testing, also known as A/B testing, is a crucial component of SMS marketing flows that involves experimenting with different variations of messages to identify the most effective approach. * you can send out **multiple versions of a message to different segments of your audience** to **determine which one yields the best results** in terms of engagement, conversion, ROI, and other key performance indicators. * By analyzing the results of these tests, you can **refine and optimize** your SMS campaigns, ensuring that you deliver the most impactful and relevant messages to your audiences. ### How to use Split Tests within an SMS Flow 1. In your chosen **SMS Flow**, click on the `+ icon` and select `Randomizer` ![RD 1](https://2167119381-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2I45aTZ733MBi8Vps3Ib%2Fuploads%2FZb5RWIT9r5CRa8mrToyn%2Fsms-campaign-a-b-testing-randomizer-1.jpg?alt=media) 2. Click on the `Randomizer block` to open the editor on the left-hand side of the screen * here you can change the percentage of audiences receiving the message or add more splits ![Randomizer](https://2167119381-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2I45aTZ733MBi8Vps3Ib%2Fuploads%2Fctf22kXUTgkrRLmhFLIZ%2Fsms-campaign-a-b-testing-randomizer-2.jpg?alt=media) 3. If you choose to add a **third split** (or more), but the sum of your percentages no longer adds up to 100%, you will receive an error message ![RD 3](https://2167119381-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2I45aTZ733MBi8Vps3Ib%2Fuploads%2FL3BxL3dZ2Yue2RruUUIa%2Fsms-campaign-a-b-testing-randomizer-3.jpg?alt=media) 4. To rectify this you can: 1. **manually** enter amounts adding up to **100%** 2. click `split traffic evenly` - it will then automatically be split into equal segments adding up to 100% ![RD 4](https://2167119381-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2I45aTZ733MBi8Vps3Ib%2Fuploads%2FyDDuaPReykc94NKWwyVF%2Fsms-campaign-a-b-testing-randomizer-4.jpg?alt=media) ![RD 5](https://2167119381-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2I45aTZ733MBi8Vps3Ib%2Fuploads%2Fylht9ebYCTkjNHCtuTmF%2Fsms-campaign-a-b-testing-randomizer-5.jpg?alt=media) 5. Once you have created your randomizer split, **add different messages** to each percentage. You can experiment in many ways, including: 1. sending out **different discount values** or **different types of deals** (percentage off, dollar value off, free gift, etc.) to see which is more successful 2. experiment with **different wording** 3. Include **specific conditions or delays** before one of the messages to test different days/times/specific product deals (see more ideas below) ![RD 6a](https://2167119381-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2I45aTZ733MBi8Vps3Ib%2Fuploads%2FOZ492ji3FEE2XX9Rty1Z%2Fsms-campaign-a-b-testing-randomizer-6.jpg?alt=media) ![RD 7](https://2167119381-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2I45aTZ733MBi8Vps3Ib%2Fuploads%2FtZ1TeF4Qigtf19qZ7lmz%2Fsms-campaign-a-b-testing-randomizer-7.jpg?alt=media) ### Hold-out Tests * You can also leave a percentage of the split test **disconnected** from any messages. * the percentage must still add up to 100% ![RD3](https://2167119381-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2I45aTZ733MBi8Vps3Ib%2Fuploads%2FUk65Q7WvyK16S5zrarq1%2Fsms-campaign-a-b-testing-randomizer-8.jpg?alt=media) * This creates a **hold-out test** * The purpose of a hold-out test is to measure the impact and effectiveness of your SMS marketing efforts by comparing the response rates and behaviors of the group that received the message (the test group) with those of the group that did not receive it (the control group). * Holdout tests are valuable because they provide a way to measure the true impact of your SMS marketing efforts. By having a control group that doesn't receive the message, you can more accurately attribute any changes in behavior or response to your SMS campaign, rather than other factors that may be influencing your audience at the same time. * Before you can save or activate an SMS flow that contains a disconnected randomizer split, you will need to **confirm** that this is your intention through a popup warning ![RD1](https://2167119381-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2I45aTZ733MBi8Vps3Ib%2Fuploads%2FOwH9pOCQsnSEl6qOkgSW%2Fsms-campaign-a-b-testing-randomizer-9.jpg?alt=media) ### Tips & Tricks Here are a few things you can test with split tests: 1. #### Discounts * use different values of discounts/offers to learn what people want ie. 10% vs 15%, 10% vs $10, or even 10% vs a free gift 2. #### Message content * change the language of the messages to determine what resonates better with your audiences 3. #### Timing & delays * try sending messages out a different times of the day or on different days to test when your audiences are likely to buy 4. #### Calls-to-action * try various calls to action, such as visiting a specific page for a discount or redirecting to customer reviews to see what hooks your audiences 5. #### Audiences * send messages to different audiences, testing out which content works for each one If you have any questions, feel free to [reach out to our team](https://help.recart.com/en/articles/360794-how-to-contact-recart-support) and we'll get back to you as soon as we can! 😊 --- # Agent Instructions This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com. ## Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter: ``` GET https://help.recart.com/sms/sms-campaign-a-b-testing-randomizer.md?ask=&goal= ``` `ask` is the immediate question: it should be specific, self-contained, and written in natural language. `goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.