watsonx Assistant

 View Only
Expand all | Collapse all

A/B testing capability in Watson Assistant

  • 1.  A/B testing capability in Watson Assistant

    Posted Tue December 21, 2021 01:26 PM
    I am trying to see if Watson Assistant supports A/B testing and how can we do A/B testing with the assistant chatbot.

    ------------------------------
    Utsav Nirgudkar
    ------------------------------

    #WatsonAssistant


  • 2.  RE: A/B testing capability in Watson Assistant

    Posted Mon January 03, 2022 11:26 AM

    Utsav,

      You would need to set up A and B environments yourself.  Most of the customers that do this will have automated deployments of their chatbot versions, which they then deploy and provision in some sort of A/B split.

      When assessing chatbots, most of our customers prefer to do canary deployments, in order to check out the effectiveness of their new chatbot features and capabilities.  I don't have a lot of customers doing A/B experiments to determine if features will be incorporated or not.



    ------------------------------
    Daniel Toczala
    Community Leader and Customer Success Manager - Watson
    dtoczala@us.ibm.com
    ------------------------------