Hi, I'm trying to make an assistant and integrate it with Watson Discovery. I'm using Bahasa Indonesia as the language for both the assistant and the document in discovery. I used the user-defined model options and splits the document by it's subtitle. My goal is that when the chatbot user asks something related to a subtitle, the assistant return the related text. When I try to ask with the exact sentence as the subtitle in the document, there is no problem. But when I ask the same intent with a different sentence, the assistant can't find the answer. For example, in the document there is a subtitle "Definition of XYZ", but when I try to ask "What is XYZ?" the assistant can't find the answer. I don't know if it is related with the language that I used. I want to know what is the problem here and is there any possible way to overcome this problem?

Thanks
#Watson Assistant #Watson Discovery

------------------------------
IRFAN SETYANTO
------------------------------

The reason to not retrieving the answer may be related to the language. Discovery seems to be trained to recognize concepts without the need to phrase the question in a very specific way because it was trained to identify keywords, synonyms, etc. It may have not been trained for that for the language you are using. A solution to that may be to ask questions in different ways, then go in and train the Discovery yourself by marking the questions to the correct answer. This way Watson Discovery will be taught to make associations between related concepts.

For example, when you ask "What is XYZ" and it is not able to return an answer, go in and train Discovery to associate that question to the right answer that you get when you ask the exact subtitle "Definition of XWY". This way it may be able to learn to associate "What is" to "definition of" in your language.

------------------------------
Antonel Neculai
------------------------------

Yes, I also thought that it was caused by language I used. Anyway, I really appreciate your suggestion and I will definitely give it a try.

Thank you again for your response.


------------------------------
IRFAN SETYANTO
------------------------------

Original Message:
Sent: Mon January 30, 2023 09:05 AM
From: Antonel Neculai
Subject: Watson Discovery Integration

The reason to not retrieving the answer may be related to the language. Discovery seems to be trained to recognize concepts without the need to phrase the question in a very specific way because it was trained to identify keywords, synonyms, etc. It may have not been trained for that for the language you are using. A solution to that may be to ask questions in different ways, then go in and train the Discovery yourself by marking the questions to the correct answer. This way Watson Discovery will be taught to make associations between related concepts.

For example, when you ask "What is XYZ" and it is not able to return an answer, go in and train Discovery to associate that question to the right answer that you get when you ask the exact subtitle "Definition of XWY". This way it may be able to learn to associate "What is" to "definition of" in your language.

------------------------------
Antonel Neculai
------------------------------