Automate testing Genesys' Web Messenger

Manually testing chatbots can be a slow and error prone process, especially when testing all potential customer journeys. The quicker and more reliable approach to testing is to rely on automated tests, which can be triggered with a click of a button, test all the functionality in a fraction of the time and even act as documentation.

In this article I will guide you through how to write automated tests for Genesys’ Web Messenger using a tool I wrote (in the absence of any others) aptly named Genesys Web Messaging Tester. As an aside, we use this tool at OVO as part of a CI/CD process to test our chatbots before they’re deployed to production.

If you want to see the tool and its code head on over to Genesys Web Messaging Tester on GitHub.

Writing automated tests

The tool I’ve written uses Web Messenger’s guest API to simulate a customer talking to a Web Messenger Deployment. Once the tool starts an interaction it follows instructions defined in a file called a ‘test-script’, which tells it what to say and what it should expect in response. If the response deviates from the test-script then the tool flags the test as a failure, otherwise the test passes.

It’s all pretty straight forward, and as a bonus, because the test-script looks a lot like a transcript (as you’ll see later) it can be shared with the wider business as documentation on how your messenger flow works from a customer’s perspective.

Now we have an overview let’s press on with installing the tool and writing a test for a highly contrived chatbot…

1. Install the prerequisites

Firstly, we need to download and install the Node.js runtime. This will allow you to install and run the testing tool.

2. Install the tool

Next install the Genesys Web Messaging Tester tool by running the following in Command Prompt for Windows, or Terminal for Mac/Linux:

npm install -g @ovotech/genesys-web-messaging-tester-cli

Once installed you can run the command web-messaging-tester --help to see how to use the tool.

$ web-messaging-tester --help
Usage: index [options] <filePath>

Arguments:
  filePath                             Path of the YAML test-script file

Options:
  -id, --deployment-id <deploymentId>  Web Messenger Deployment's ID
  -r, --region <region>                Region of Genesys instance that hosts the Web Messenger Deployment
  -o, --origin <origin>                Origin domain used for restricting Web Messenger Deployment
  -p, --parallel <number>              Maximum scenarios to run in parallel (default: 1)
  -h, --help                           display help for command

3. Write a Test-Script

We are now ready to write a test-script for a Web Messenger Deployment.

The highly contrived chatbot that we’ll use as the subject of our test does the following:

  1. Asks the customer for their name
  2. Greets them by their name and asks how it may help

The test-script for such as simple bot is equally as simple:

# test-script.yaml

config:
  deploymentId: 12345c7d-123a-123a-1f3d-a104e02a86a7
  region: usw2.pure.cloud
scenarios:
  "Customer is greeted by the name they provide":
    - say: hi
    - waitForReplyContaining: what is your name?
    - say: Lucas
    - waitForReplyContaining: Hello Lucas, how may I help you today?

The test-script is written in a format known as YAML, and is comprised of two sections:

Config

This section contains the attributes necessary for the tool to find the Messenger Deployment it will test:

Scenarios

This section contains a list of scenarios that you want to test, along with the instructions of what to say/expect beneath each of them. In this case there is only one scenario, but in reality you’d have many more.

4. Run the test

The final and most satisfying part is now upon us, running the tests! It’s pretty straightforward, you just point the Web Messaging Tester tool at the test-script file:

web-messaging-tester test-script.yaml

Then watch it test the deployment:

Conclusion

Hopefully this article has whet your appetite for automating the testing of your Web Messenger flows.

This article on automating testing of Genesys' Web Messenger was originally written for my personal blog, where I'll be writing more articles of this nature. If you have any suggestions on how I can improve it, or my writing then please let me know @SketchingDev, or leave a comment.